Ticket Router

Critical

segmented by category2 runsticket_routersample data

Latest

65%

-30 pts vs baseline

Baseline

95%

trusted bar

Run #2·claude-haiku-4-5

65%pass rate

CriticalBlocks deploy

30 pts below baseline.

7 of 20 cases failing — baseline is 95% (Ticket Router #1 · claude-haiku-4-5 · Dataset v1 · Jul 18, 2026).

prompt v1dataset v10.4sp95 28ms894 tokvia demoJul 18, 1:06 AM

Quality by check

category_match — mean score65%

priority_match — mean score100%

Quality by category

feature_request0%

account_access60%

technical_support83%

billing100%

Cases20

Mean latency22ms

Tokens / case45

Why it regressed

5 critical, 0 warning

dropped 0.3 (31.6%)-30 pts
dropped 0.3 (31.6%)-30 pts
dropped 0.3 (31.6%)-30 pts
dropped 0.4 (40.0%)-40 pts
dropped 1 (100.0%)-100 pts

Test log

20 cases · 7 need review