Tag: benchmarking
-
The gate was recorded. I just didn’t read it.
A model that rendered an animated 3D solar system scored 0.026, close enough to a blank page that the agent was about to write it off. The image told a different story: a recognizable sun, a small red planet, and…
-
What it takes to trust a local model’s score
The lab runs several open-weight language models locally and wants to know which one is actually worth using for a given job. That means a benchmark, and a benchmark means a harness — and the harness has been wrong more…