List of AI News about inference
| Time | Details |
|---|---|
|
2026-10-20 01:30 UTC |
DeepSeek open sources DeepInfer powering DeepSeek-V4.1-Flash
According to DeepSeek on X, the company open sourced its in-house inference framework DeepInfer, which powers DeepSeek-V4.1-Flash at scale to cut compute costs and latency. |
|
2026-10-07 10:01 UTC |
Claude Haiku 5.5 Slashes Costs 75%
According to AnthropicAI, Claude Haiku 5.5 runs about 75% cheaper than Haiku 4.5 while boosting speed and capability. |
|
2026-10-07 10:01 UTC |
Claude Haiku 5.5 Slashes Costs by 75%
According to @claudeai, Haiku 5.5 is the fastest, cheapest small Claude model, cutting average run costs ~75% vs Haiku 4.5, enabling broader AI deployment. |
|
2026-09-29 23:51 UTC |
SIE Multimodel Server Slashes Latency 12x
According to @_avichawla, SIE served 4 small models on one GPU with LRU loading, cutting concurrent workload latency from 18.58s to 1.47s. |
|
2026-09-28 10:04 UTC |
Claude Sonnet 5.5 slashes costs 30%
According to AnthropicAI, Claude Sonnet 5.5 runs 30% faster and costs up to 30% less than Sonnet 5, improving speed and price for most workloads. |
|
2026-09-28 10:03 UTC |
Claude Sonnet 5.5 Delivers 30% Faster, Cheaper AI
According to @claudeai, Sonnet 5.5 runs 30% faster and costs up to 30% less than Sonnet 5, improving speed to value for AI apps. |
|
2026-09-25 07:38 UTC |
Anthropic Deal Lifts Akamai Shares: Street Analysis
According to CNBC... Akamai jumped after an Anthropic deal; analysts cite AI edge delivery, GPU monetization, and inference revenue upside. |
|
2026-09-22 10:25 UTC |
GPT6 Sol and Luna Slash API Costs 50%
According to OpenAI on X, GPT‑6 Sol and Luna cut API prices by 50% versus GPT‑5.6 promo and bring Astra strengths with faster, more efficient inference. |
|
2026-09-22 10:12 UTC |
GPT6 Sol and Luna Slash API Prices 50%
According to OpenAI... GPT6 Sol and Luna offer faster, cheaper models with 50% lower API prices than GPT5.6 and improved caching for scaled workloads. |
|
2026-09-17 13:41 UTC |
Claude accelerates biomolecular models 4x
According to AnthropicAI, Claude optimized 30+ bio models with GPU code, delivering 4x faster inference and open-sourced tools for broader impact. |
|
2026-09-15 18:04 UTC |
Rule-based AI Classifier Outpaces LLMs
According to emollick, a non-LLM classifier rapidly applies decision rules and runs ~10 calls per second at about $7 per hour, offering system-level gains. |
|
2026-09-09 22:10 UTC |
DeepSeek V4.1 Flash Boosts Inference Speed
According to @deepseek_ai, V4.1-Flash adds native vision, faster inference, and higher throughput, scaling to larger models for real-world deployment. |
|
2026-09-03 11:44 UTC |
GPT6 Astra Launches with multimodal speed
According to gdb, OpenAI unveiled GPT-6 Astra with faster multimodal inference and context upgrades, signaling new real-time agent use cases. |
|
2026-09-03 04:07 UTC |
Nvidia acquires Hugging Face in $13B AI stack push
According to CNBC, Nvidia will buy Hugging Face for nearly $13B to integrate models, data, and inference, expanding its end to end AI platform. |
|
2026-08-25 09:19 UTC |
OpenAI Jalapeño Boosts Inference Speed and Efficiency
According to @OpenAI, Jalapeño delivers higher throughput and lower latency per watt in one architecture without sacrificing efficiency. |
|
2026-08-21 11:34 UTC |
GPT5.6 Sol Cuts API Pricing 20%+ for 3 Months
According to OpenAI... GPT-5.6 Sol API and credit prices drop 20%+ for three months, signaling efficiency gains and lower unit costs for developers. |
|
2026-08-13 19:12 UTC |
OpenAI Ultrafast mode boosts GPT-5.6 speed 14x
According to OpenAI... Ultrafast mode previews GPT-5.6 Sol at up to 14x speed, first via API to select customers, expanding as capacity grows. |
|
2026-08-13 06:34 UTC |
Bank of America backs data stock for AI boom
According to @CNBC, Bank of America highlighted a lesser-known data provider as a way to play the AI boom, citing rising demand for training and inference. |
|
2026-08-11 05:15 UTC |
Nvidia Nemotron 3.5 Lightning debuts open model
According to @CNBC, Nvidia released Nemotron 3.5 Lightning as an open-source AI model to speed enterprise fine-tuning and reduce inference costs. |
|
2026-08-11 02:11 UTC |
Nvidia Strategy Wins Wall Street Backing
According to CNBC... Investors back Jensen Huang’s accelerated computing vision, spotlighting data center, inference, and software margins. |