AI Benchmarks
Google Launches Multimodal Knowledge Agent Benchmark for Visual Tasks
Google and Artificial Analysis introduce the Multimodal Knowledge Agent benchmark to evaluate AI performance on visually complex tasks.
AI Benchmarks
OpenAI Launches BioBasicsBench to Evaluate AI in Wet-Lab Science
OpenAI introduces BioBasicsBench, a 100-task benchmark to assess AI agents' ability to interpret raw experimental data in wet-lab science.
AI Benchmarks
Harvey Unveils Initial Results of Legal AI Benchmark LAB
Harvey's Legal Agent Benchmark (LAB) reveals frontier AI models complete less than 10% of complex legal tasks end-to-end, highlighting challenges in legal AI automation.
AI Benchmarks
OpenAI Abandons SWE-bench Verified After Finding 59% of Failed Tests Were Flawed
OpenAI reveals major contamination issues in SWE-bench Verified benchmark, showing frontier AI models memorized solutions and tests rejected correct code.
AI Benchmarks
Harvey AI Launches Global Legal Benchmark for UK, Australia, Spain
Harvey's BigLaw Bench Global doubles benchmark size, testing AI legal capabilities across jurisdictions as model scores hit 90% on core tasks.