Ticket Router
CriticalLatest evaluation
Ticket Router #2 · claude-haiku-4-5 · Dataset v1 · Jul 18, 2026
Quality by check
Quality by category
What this means
Quality has dropped badly enough to block a merge.
Latest run: 13 of 20 test cases passed (65%). 7 gave a wrong answer.
Baseline: 30 points below the trusted baseline (65% vs 95%).
Trend: Quality has declined across the last 2 runs (95% → 65%).
Regressions: 5 measures got worse than the baseline, all 5 of them badly enough to block a merge. The biggest drop is in the category match check in “feature_request”, down 100 points.
Weak spot: Failures are concentrated in one place: category “feature_request” fails every one of its 4 cases, against 65% overall. Fixing that one area would move the number most.
What to do next
Investigate before merging. CI runs the same comparison and exits non-zero, so this will block the merge until the regression is fixed or a new baseline is deliberately promoted.
A merge with this run would be blocked.