AI dictionary

Trace Grading

Scoring or labeling an agent's end-to-end trace to evaluate decisions, tool calls, and outcomes.

Plain English

Instead of only grading the final answer, you grade how the agent got there.

Example

A reviewer marks that the agent chose the right source but called the wrong CRM tool.

Why it matters

Agent failures often happen inside the workflow, so trace-level evaluation helps teams find the broken step.