Just read about exploiting AI agent benchmarks - are we measuring the wrong things?

The Berkeley paper reveals systematic ways to exploit current AI agent benchmarks, raising questions about evaluation validity. As AI builders, we need to discuss what metrics actually matter for real-world deployment and how to create more robust testing frameworks that can't be gamed.