EvalGate
Email Classifier
Criticalsegmented by category5 runsemail_classifiersample data
Run #5·claude-haiku-4-5
74%pass rate
CriticalBlocks deploy
20 pts below baseline.
14 of 54 cases failing — baseline is 94% (Email Classifier #1 · claude-haiku-4-5 · Dataset v1 · Jul 18, 2026).
prompt v1dataset v11.3sp95 28ms3,473 tokvia demoJul 18, 1:05 AM
Quality by check
category_match — mean score74%
summary_quality — mean score100%
Quality by category
general8%
technical87%
account93%
billing100%
Cases54
Mean latency23ms
Tokens / case64
Why it regressed
5 critical, 0 warning
- dropped 0.2037 (21.6%)-20 pts
- dropped 0.2037 (21.6%)-20 pts
- dropped 0.2037 (21.6%)-20 pts
- dropped 0.8333 (90.9%)-83 pts
- dropped 0.06667 (7.1%)-7 pts
Test log
54 cases · 14 need review