Grade on the dimensions that matter
A rubric grades on dimensions, the specific axes you care about, instead of a single thumbs up or down. One trace can be scored on accuracy, tone, completeness, or whatever matters to your business, all in one pass. Each dimension has a scoring type that fits the question: Pass or Fail, a 1 to 5 scale, a single choice from a list, or a checklist of items to tick. One dimension is the headline, which drives the trace’s top-line verdict. For each dimension you can add good and bad example traces. These keep reviewers aligned on the tricky, borderline cases, and they later feed the judge’s prompt so the judge learns the same standard.Know whether you can trust the results
For every dimension, Rubric Studio shows a reviewer agreement score: how often your reviewers reached the same grade on the same traces. High agreement means the standard is clear and the ground truth is solid. Low agreement is an early warning that the rubric is ambiguous, so you can fix it before you build judges or datasets on top of shaky data.Improve the rubric without losing history
Rubrics are versioned. When you refine one, past grades stay tied to the version they were made against, so your history stays accurate and you can keep sharpening the standard over time.Next steps
The operational loop
Put the rubric to work: route traces, grade them, and reuse the results