EvalGate
Email Classifier
Criticalsegmented by category5 runsemail_classifiersample data
Run vs run
Diff any two evaluations to see exactly which metrics moved — and whether the prompt or dataset changed underneath them.
5 critical · 0 warning
prompt samedataset same
Pass rate
74%
-20 pts vs A
category_match — mean score
74%
-20 pts vs A
summary_quality — mean score
100%
0 pts vs A
MetricRun ARun BΔVerdictErrored cases0.0000.0000.000okLatency (mean ms)2323+0.375okLatency (p95 ms)3328-5okPass rate0.9440.741-0.204criticalcategory_match — mean score0.9440.741-0.204criticalcategory_match — pass rate0.9440.741-0.204criticalsummary_quality — mean score1.0001.0000.000oksummary_quality — pass rate1.0001.0000.000okaccount / category_match0.9290.9290.000okaccount / summary_quality1.0001.0000.000okbilling / category_match1.0001.0000.000okbilling / summary_quality1.0001.0000.000okgeneral / category_match0.9170.083-0.833criticalgeneral / summary_quality1.0001.0000.000oktechnical / category_match0.9330.867-0.067criticaltechnical / summary_quality1.0001.0000.000okTokens per case64640.000okTotal tokens347334730.000ok