Skip to main content
AI RADARModels
234•10/02/2026, 19:02•2 min read

BridgeMind launches NerfBench to detect AI model degradation after release

Executive TL;DR30s read

NerfBench tracks quality drops, token usage increases, and higher task costs in AI models after their initial release.

Users of chatbots and agents constantly report that AI models become worse after their release and/or before the next version comes out. This process has been nicknamed "nerf".

BridgeMind has released a special benchmark called NerfBench to catch such shifts.

It works as follows: on release day, the model is run through tests, and that result is treated as 100%. The model is then periodically retested, measuring quality, token usage, and task cost. A range of 90–110% is considered normal statistical variance; anything below 90% is flagged as suspicious. If the model needs more tokens or money for the same work, that is also counted as a loss of capability.

For example, many users are currently complaining that Opus 5.5 has noticeably degraded. Indeed, after the latest measurement, its score was around 94% of launch: formally still within the normal range, but no other model has weakened this much. Online, some already suggest this may signal an imminent Fable 5.5 release.

Updates to the benchmark can be followed here.

BridgeMind has also promised to allocate $10,000 to fund future rechecks: new models and more frequent measurements are planned.

Why it matters

Analysis

NerfBench gives users a practical way to monitor whether AI providers quietly reduce model quality or increase costs after release. It can help detect regressions that are not obvious from official announcements.

Discuss in community

Share your questions and insights with developers

Join Telegram
+5 Points
← Back to news feed

Related in Ecosystem

Practical guides, core terminology, and agent skills