Metrics Guide

Introduction

While reviewing Response Metrics on your dashboard, you'll encounter several acronyms such as MTTD, MTTA, MTTI, and MTTC. Understanding these terms is essential for effectively managing your Security Operations Center (SOC) workflows.

We totally get that these metrics can seem like alphabet soup, especially if you're new to them or if there's one that's unfamiliar. In fact, we at Dropzone AI coined the term Mean Time to Conclusion (MTTC) to help illustrate how our product fits seamlessly into your existing Security Operations Center (SOC) workflows. Whether you’re new to these concepts or just need a refresher, we’re here to make everything clear and manageable.

This guide is designed to offer a comprehensive understanding of these key metrics. We’ll break down each term, explore how they connect, and show you how Dropzone AI can streamline and enhance your SOC operations for greater efficiency and effectiveness.

We invite you to explore this guide to gain deeper insights into these important metrics and discover how they can benefit your organization.

Key SOC Metrics

Let's kick things off talking about what metrics Dropzone measures, and how each measurement is defined:

Metric

Mean Time to Detect (MTTD)

Mean Time to Acknowledge (MTTA)

Mean Time to Investigate (MTTI)

Mean Time to Conclusion (MTTC)

Definition

The average time your security tools take to detect suspicious activity after it occurs

The average time between an alert being generated and an analyst acknowledging it

The average time it takes an analyst to dive into an alert and identify is activity is a false positive or needs to be escalated

The average time from when suspicious activity happens to when a conclusion is made Or in other words, the sum of the other 3 metrics

Why It Matters

The quicker you detect an incident, the less damage can be done by attackers

Alerts are like hot potatoes—you don't want them sitting around! A speedy MTTA means your team is on the ball

Efficiency is key. A lower MTTI means quicker resolutions

MTTC shows how efficiently your SOC handles all alerts, benign or malicious

Dropzone AI's Role

We don't directly influence MTTD but ensure visibility into this metric

We reduce MTTA by kicking off investigations immediately when alerts pop up

We automate routine tasks, slashing MTTI

By reducing both MTTA and MTTI, we make a big dent in MTTC, boosting SOC performance

Understanding MTTC

So, what's the big deal with MTTC? Glad you asked!

MTTC covers the entire journey of an alert:

  1. Detection: When your security system spots something fishy

  2. Acknowledgment: When the alert is logged, and someone (or something) starts looking into it

  3. Investigation: The nitty-gritty analysis to figure out what's going on

  4. Conclusion: Deciding whether it's a false alarm or if action is needed

Why MTTC Matters

Traditional metrics are great, but they often focus on specific parts of the process. MTTC gives you the whole picture.

  • Comprehensive Insight: See how efficiently your SOC handles all alerts

  • Efficiency Measurement: Spot bottlenecks and areas ripe for improvement

  • Resource Optimization: Allocate your team's time where it counts

  • Stronger Security Posture: Faster conclusions mean threats are nipped in the bud

The Power of Statistical Measures

We believe in going beyond just averages. That's why Dropzone AI captures three key statistical measures for each metric: Mean, Median, and the 95th Percentile.

Measurement

Mean (Average)

Median

95th Percentile

What It Is

Add up all the times and divide by the number of investigations

The middle value when you line up all the times from shortest to longest

The time under which 95% of your cases fall

Pros

Gives you an overall sense of performance

Not swayed by outliers. Represents the "typical" case

Highlights the slowest 5% of cases—those alerts that take the longest

Cons

Can get thrown off by outliers (those really long or really short times)

Doesn't show the range of variation

Might overemphasize rare, extreme cases

Why Use All Three?

  • Full Spectrum Analysis: Understand both the typical and exceptional cases

  • Outlier Detection: Spot those pesky alerts that take too long

  • Informed Decisions: Make smarter choices about where to focus your efforts

How Dropzone AI Supercharges Your Metrics

Making a Real Impact

Slashing MTTA:

  • Parallel Processing: Dropzone AI handles multiple investigations at once, so nothing gets left behind

  • Immediate Action: We start processing alerts the right after they're detected

Reducing MTTI:

  • Automation: We handle the routine investigation steps, freeing your analysts for more complex tasks

  • Consistent Performance: Faster investigations across the board

MTTC Improvement:

  • Combined Effect: By cutting down MTTA and MTTI, we significantly lower your MTTC

Transparency and Collaboration

We believe in open conversations and teamwork.

  • Shared Insights: Get detailed metrics and reports at your fingertips

  • Open Communication: Provided metrics facilitate discussions on time saved, efficiency gains, and areas for improvement - Let's discuss how to make things even better

  • Value Demonstration: See the tangible benefits Dropzone AI brings to your SOC


Frequently Asked Questions (FAQ)

How is MTTC different from MTTD and MTTR?

MTTC covers the whole journey of every alert, from detection to final decision, whether it's benign or malicious. MTTD focuses on how quickly your tools detect incidents, and MTTR measures the time to respond to incidents requiring action.

Does MTTC include benign alerts?

Absolutely! MTTC accounts for all alerts. By including benign ones, you get insights into how efficiently you're handling everything that comes your way.

Will focusing on MTTC improve our security posture?

You bet! Lowering MTTC means faster threat mitigation, better resource use, and a more proactive security stance overall.

Why doesn't Dropzone AI measure MTTR?

MTTR deals with actions after the investigation phase (like containment and recovery). Since we focus on triage and investigation (MTTA and MTTI), we don't measure MTTR directly. But by speeding up the earlier phases, we help the overall response process move faster.

Can Dropzone AI reduce times across all metrics?

We don't influence MTTD (that's before the alert gets to us), but we definitely help with MTTA and MTTI. By reducing those, we make a significant dent in MTTC.

How does Dropzone AI's transparency benefit our SOC?

Transparency fosters collaboration. You'll see where time is saved, understand our impact, and we can work together to keep improving.

Why provide mean, median, and 95th percentile for each metric?

Because one size doesn't fit all! Using all three measures gives you a comprehensive understanding, helping you make more informed decisions.

How can the 95th percentile help improve our operations?

It shines a light on the slowest cases. By analyzing these outliers, we can find ways to streamline processes and reduce delays.

Can Dropzone AI affect MTTD at all?

Not directly. MTTD is about detection before we step in. But we provide visibility into MTTD so you have all the info you need.

How does Dropzone AI facilitate open conversations about performance?

With detailed metrics and transparent reporting, we enable data-driven discussions, performance tracking, and collaborative planning.


This document is intended for Dropzone AI customers to enhance understanding of key SOC metrics, the benefits of using mean, median, and 95th percentile measures, and how Dropzone AI improves Mean Time to Conclusion (MTTC) and overall SOC performance through transparency and collaborative insights.

Last updated