Tag: benchmarking

  • The gate was recorded. I just didn’t read it.

    A model that rendered an animated 3D solar system scored 0.026, close enough to a blank page that the agent was about to write it off. The image told a different story: a recognizable sun, a small red planet, and…

    Read on →

  • What it takes to trust a local model’s score

    The lab runs several open-weight language models locally and wants to know which one is actually worth using for a given job. That means a benchmark, and a benchmark means a harness — and the harness has been wrong more…

    Read on →