Offline Evals: Scenario-Driven Simulation
Test Runner
Agent Sandbox
Simulated Tools
Execution Steps
State Update
Discrete Outputs
Metrics
Completion Rate 98.5%
Tool Correctness 100%
Plan Quality High
Simulated Cost $0.05
Scenario-driven, not prompt-driven.
AI text/layout recreation from video frame; verify against source image.