AI News List

List of AI News about inference

Time Details
2026-10-20
01:30 UTC
DeepSeek open sources DeepInfer powering DeepSeek-V4.1-Flash

According to DeepSeek on X, the company open sourced its in-house inference framework DeepInfer, which powers DeepSeek-V4.1-Flash at scale to cut compute costs and latency.

Source
2026-10-07
10:01 UTC
Claude Haiku 5.5 Slashes Costs 75%

According to AnthropicAI, Claude Haiku 5.5 runs about 75% cheaper than Haiku 4.5 while boosting speed and capability.

Source
2026-10-07
10:01 UTC
Claude Haiku 5.5 Slashes Costs by 75%

According to @claudeai, Haiku 5.5 is the fastest, cheapest small Claude model, cutting average run costs ~75% vs Haiku 4.5, enabling broader AI deployment.

Source
2026-09-29
23:51 UTC
SIE Multimodel Server Slashes Latency 12x

According to @_avichawla, SIE served 4 small models on one GPU with LRU loading, cutting concurrent workload latency from 18.58s to 1.47s.

Source
2026-09-28
10:04 UTC
Claude Sonnet 5.5 slashes costs 30%

According to AnthropicAI, Claude Sonnet 5.5 runs 30% faster and costs up to 30% less than Sonnet 5, improving speed and price for most workloads.

Source
2026-09-28
10:03 UTC
Claude Sonnet 5.5 Delivers 30% Faster, Cheaper AI

According to @claudeai, Sonnet 5.5 runs 30% faster and costs up to 30% less than Sonnet 5, improving speed to value for AI apps.

Source
2026-09-25
07:38 UTC
Anthropic Deal Lifts Akamai Shares: Street Analysis

According to CNBC... Akamai jumped after an Anthropic deal; analysts cite AI edge delivery, GPU monetization, and inference revenue upside.

Source
2026-09-22
10:25 UTC
GPT6 Sol and Luna Slash API Costs 50%

According to OpenAI on X, GPT‑6 Sol and Luna cut API prices by 50% versus GPT‑5.6 promo and bring Astra strengths with faster, more efficient inference.

Source
2026-09-22
10:12 UTC
GPT6 Sol and Luna Slash API Prices 50%

According to OpenAI... GPT6 Sol and Luna offer faster, cheaper models with 50% lower API prices than GPT5.6 and improved caching for scaled workloads.

Source
2026-09-17
13:41 UTC
Claude accelerates biomolecular models 4x

According to AnthropicAI, Claude optimized 30+ bio models with GPU code, delivering 4x faster inference and open-sourced tools for broader impact.

Source
2026-09-15
18:04 UTC
Rule-based AI Classifier Outpaces LLMs

According to emollick, a non-LLM classifier rapidly applies decision rules and runs ~10 calls per second at about $7 per hour, offering system-level gains.

Source
2026-09-09
22:10 UTC
DeepSeek V4.1 Flash Boosts Inference Speed

According to @deepseek_ai, V4.1-Flash adds native vision, faster inference, and higher throughput, scaling to larger models for real-world deployment.

Source
2026-09-03
11:44 UTC
GPT6 Astra Launches with multimodal speed

According to gdb, OpenAI unveiled GPT-6 Astra with faster multimodal inference and context upgrades, signaling new real-time agent use cases.

Source
2026-09-03
04:07 UTC
Nvidia acquires Hugging Face in $13B AI stack push

According to CNBC, Nvidia will buy Hugging Face for nearly $13B to integrate models, data, and inference, expanding its end to end AI platform.

Source
2026-08-25
09:19 UTC
OpenAI Jalapeño Boosts Inference Speed and Efficiency

According to @OpenAI, Jalapeño delivers higher throughput and lower latency per watt in one architecture without sacrificing efficiency.

Source
2026-08-21
11:34 UTC
GPT5.6 Sol Cuts API Pricing 20%+ for 3 Months

According to OpenAI... GPT-5.6 Sol API and credit prices drop 20%+ for three months, signaling efficiency gains and lower unit costs for developers.

Source
2026-08-13
19:12 UTC
OpenAI Ultrafast mode boosts GPT-5.6 speed 14x

According to OpenAI... Ultrafast mode previews GPT-5.6 Sol at up to 14x speed, first via API to select customers, expanding as capacity grows.

Source
2026-08-13
06:34 UTC
Bank of America backs data stock for AI boom

According to @CNBC, Bank of America highlighted a lesser-known data provider as a way to play the AI boom, citing rising demand for training and inference.

Source
2026-08-11
05:15 UTC
Nvidia Nemotron 3.5 Lightning debuts open model

According to @CNBC, Nvidia released Nemotron 3.5 Lightning as an open-source AI model to speed enterprise fine-tuning and reduce inference costs.

Source
2026-08-11
02:11 UTC
Nvidia Strategy Wins Wall Street Backing

According to CNBC... Investors back Jensen Huang’s accelerated computing vision, spotlighting data center, inference, and software margins.

Source