Google Cloud Exposes Fatal Flaws in AI Benchmarks: A Single Word Change Can Crash Agent Performance to Zero
Google Cloud's new Discovery Bench framework exposes alarming flaws in AI benchmarking, revealing that a single vague word can crash an agent's performance score from perfect to zero, while also uncovering broken ground truth and mislabeled data in widely trusted benchmarks — raising urgent questions about whether the AI industry …