AI News List

List of AI News about benchmarks

Time Details
2026-10-08
16:00 UTC
AREX Harness Boosts Benchmarks by 10 Points

According to DeepLearningAI, AREX verifies requirements, scores 82.5 BrowseComp and 82.0 F1 WideSearch en, and its harness alone adds up to 10 points.

Source
2026-10-07
10:30 UTC
Claude Haiku 5.5 Breakthrough beats Luna

According to @TheRundownAI, Anthropic’s Claude Haiku 5.5 is faster, cheaper, and tops Luna on benchmarks, starting at $0.10 per million input tokens.

Source
2026-09-25
14:36 UTC
OpenAI AGI Claims Spark 2020 Flashback

According to @timnitGebru, OpenAI researchers said GPT3 achieved AGI in 2020, raising scrutiny of benchmarks and model evaluation standards.

Source
2026-09-24
09:49 UTC
METR Chart Replacement Sparks 2026 Analysis

According to @emollick, a new visual should replace METR’s Long Task Horizon chart, prompting fresh analysis of AI capability benchmarks.

Source
2026-09-24
08:47 UTC
Claude Sonnet 4.5 gains with Meta memory agents

According to DeepLearningAI, Meta pairs action and memory agents to curb context rot, boosting Claude Sonnet 4.5 accuracy from 37.6% to 45.9%.

Source
2026-09-16
06:40 UTC
AI benchmarks Crisis Exposed by New Paper

According to @emollick, public AI benchmarks are saturated or error ridden, severely underestimating current model abilities, as the cited paper shows.

Source
2026-09-15
06:30 UTC
Claude Fable 5.1 tops v4.2 Index

According to DeepLearning.AI, Claude Fable 5.1 leads Intelligence Index v4.2 with 57, ties OpenAI’s new model on benchmarks, and cuts agent costs via cache.

Source
2026-09-10
05:29 UTC
DeepSeek Causal Encoder‑Decoder Breakthrough

According to KyeGomezB, DeepSeek’s causal encoder‑decoder MoE cuts active params to 8B in, 16B out, promising lower cost and top benchmarks.

Source
2026-08-27
11:24 UTC
Terminal-Bench-Science Launches benchmark analysis

According to StanfordAILab, Terminal-Bench-Science v0.1 tests 70 research tasks and Claude Opus 5 solves about 30%, signaling big gaps in agent tooling.

Source
2026-08-18
19:17 UTC
Qwen 27B Sparks Debate in Agentic Benchmarks

According to Ethan Mollick, Qwen 27B is a game changer, but critics on X urge benchmarking, noting weaker agentic task performance.

Source
2026-08-06
14:58 UTC
GPT5.6 Signals Personal Finance Breakthrough

According to gdb, OpenAI’s GPT 5.x shows major gains on internal personal finance benchmarks, pointing to stronger planning and advisory performance.

Source
2026-07-24
20:41 UTC
BenchBenchBench Reveals AI Benchmarking Meta-Analysis

According to emollick, a Codex-prompted project produced BBBBB, an executable benchmark testing AI-authored conformance suites for metrics.

Source
2026-07-24
09:47 UTC
Claude Opus 5 Breakthrough beats rivals at half cost

According to TheRundownAI, Anthropic’s Claude Opus 5 leaps past 4.8 and outperforms Fable on several benchmarks at half the price.

Source
2026-07-17
01:18 UTC
Moonshot Kimi K3 Tops Benchmarks, Trails Leaders

According to @CNBC, Moonshot AI says Kimi K3 beats top OpenAI and Anthropic models on select benchmarks while still trailing overall leaders.

Source
2026-07-08
10:37 UTC
Grok 4.5 powers Cursor launch with flash speed

According to The Rundown AI, Grok 4.5 in SpaceXAI and Cursor delivers flash-level speed, strong benchmarks, and affordable pricing, boosting dev workflows.

Source
2026-07-06
03:07 UTC
Stanford AI Lab unveils ICML 2026 highlights

According to StanfordAILab, Stanford AI Lab lists ICML 2026 papers on coding agents, LLM reasoning, safety, interpretability, and science.

Source
2026-06-26
14:15 UTC
Zhipu AI narrows gap with Anthropic, OpenAI

According to CNBC... Zhipu’s GLM models gain on OpenAI and Anthropic as open source and export limits reshape AI competition, per benchmarks and funding data.

Source
2026-06-17
12:41 UTC
LifeSciBench Launches 750-task Benchmark Analysis

According to OpenAI... LifeSciBench debuts with 750 expert tasks across 7 workflows to assess AI for real-world life science research.

Source
2026-06-16
09:23 UTC
OpenAI Evals Reform Guides Next Benchmarks

According to OpenAI on X, leaders discuss better evals to forecast model progress as saturated benchmarks get gamed, outlining next judgment areas.

Source
2026-06-15
07:44 UTC
Claude3.5 Crushes benchmark rankings

According to God of Prompt, Anthropic is crushing a new benchmark, signaling Claude3.5 gains for reasoning and eval leadership.

Source