EvalGate

Email Classifier

Critical
segmented by category5 runsemail_classifiersample data

Latest

74%

-20 pts vs baseline

Baseline

94%

trusted bar

Latest run
Run #3·claude-haiku-4-5
96%pass rate
HealthyBlocks deploy

2 pts above baseline.

2 of 54 cases failing — baseline is 94% (Email Classifier #1 · claude-haiku-4-5 · Dataset v1 · Jul 18, 2026).

prompt v1dataset v12.5sp95 80ms3,352 tokvia demoJul 18, 1:04 AM

Quality by check

category_match — mean score96%
summary_quality — mean score100%

Quality by category

general92%
technical93%
account100%
billing100%
Cases54
Mean latency44ms
Tokens / case62

Why it regressed

2 critical, 0 warning

  • increased 20.79 (91.3%)+2079 pts
  • increased 47.65 (145.7%)+4765 pts

Test log

54 cases · 2 need review