Tests & Operations
(Real-Time Operations Metrics)

Tests & Operations (Real-Time Operations Metrics)

Real-Time Operations Metrics is the live operations dashboard for Tests & Operations. It monitors running operations and agents in near real time and surfaces execution velocity, success rate, and health signals so you can control adversary emulation as an operational process—while it is happening.

Purpose

This report is designed for live oversight. It helps you confirm that operations are progressing, agents are active, abilities are executing, and results are being produced continuously. By exposing stalls, failures, and inactivity early, it reduces wasted run time and protects the quality of evidence used for validation and reporting.

Live KPI snapshot

The top metrics provide an at-a-glance operational summary of what is happening right now:

  • Execution Velocity: current throughput, reflecting how actively abilities are being executed.
  • Success Rate: live success percentage for the current monitoring window (stability indicator).
  • Active Operations: how many operations are currently running and their state distribution.
  • Total / Active Abilities: abilities currently in use, with quick visibility of OK vs error conditions.

Agent activity monitor

Real-time visibility depends on agent health. The Agent Activity Monitor highlights which agents are currently active and whether they are producing events. This makes it easy to detect stalled agents, connectivity issues, or missing telemetry during execution.

  • Active agent detection: verify that targets are online and responding.
  • Inactivity spotting: identify agents that have stopped producing events during a run.
  • Fast triage: decide whether to pause/stop operations or fix agent conditions before continuing.

Overall health gauge

The health gauge provides a single consolidated signal representing the current operational state. It is influenced by success/failure patterns, error presence, and event flow. This makes it easy to understand whether the run is in a stable state suitable for producing defensible evidence.

Recent activity stream

The Recent Activity feed lists the latest execution events across operations (for example ability executions, status changes, and outcomes). It provides immediate situational awareness and helps you confirm that operations are progressing and generating results continuously.

Refresh behavior

Real-Time Operations Metrics supports manual refresh so you can control when to pull the latest event snapshot. This is useful in controlled testing environments where you want predictable refresh cycles while monitoring active runs.

  • Refresh now: request the latest snapshot of live metrics and recent activity.
  • Last refresh: track recency to avoid acting on stale data.

Why it matters

Live monitoring is essential for reliable adversary emulation. Real-Time Operations Metrics reduces blind execution, shortens troubleshooting time, and ensures that operational issues (agent health, ability failures, stalled operations) are detected while they can still be corrected. This protects the integrity of test outcomes that later feed validated coverage and posture reporting.

Note: Real-time metrics are synchronized from Morgana (Caldera) execution activity. Stable, continuous event flow is a prerequisite for trustworthy evidence and meaningful validation statistics.