Vllm

AMD adds day-0 MiniMax-M3.1 support on Instinct MI350 GPUs
Vllm

AMD adds day-0 MiniMax-M3.1 support on Instinct MI350 GPUs

AMD says MiniMax-M3.1 now runs on Instinct MI350 GPUs with vLLM and ATOM support, MXFP4 conversion and latency gains in select decode paths.

AMD adds day-0 support for Meta's Muse Spark Open
Vllm

AMD adds day-0 support for Meta's Muse Spark Open

AMD said its Instinct MI350X and MI355X GPUs support Meta's Muse Spark Open on ROCm and vLLM, with BF16, MXFP4 and FP8 variants.

Anyscale Launches Debugging Skills to Streamline Ray and vLLM Fixes
Vllm

Anyscale Launches Debugging Skills to Streamline Ray and vLLM Fixes

Anyscale's new debugging tools simplify fixing Ray and vLLM workloads, saving hours of manual effort for developers.

Ray 2.55 Adds Fault Tolerance for Large-Scale AI Model Deployments
Vllm

Ray 2.55 Adds Fault Tolerance for Large-Scale AI Model Deployments

Anyscale's Ray Serve LLM update enables DP group fault tolerance for vLLM WideEP deployments, reducing downtime risk for distributed AI inference systems.