DISTRIBUTED COMPUTING
Anyscale Launches Agent Skills to Streamline AI on Ray
Anyscale's new Agent Skills enhance AI coding tools like Claude Code and Cursor, optimizing Ray-based workflows for speed and scalability.
Eigen Labs Launches Project Darkbloom to Turn Idle Macs Into AI Compute Network
New research initiative from Eigen Labs aims to route AI inference through underused Apple Silicon machines, claiming 50% cost reduction versus major providers.
Ray 2.55 Adds Fault Tolerance for Large-Scale AI Model Deployments
Anyscale's Ray Serve LLM update enables DP group fault tolerance for vLLM WideEP deployments, reducing downtime risk for distributed AI inference systems.
NVIDIA Launches Open-Source NIXL Library to Speed AI Inference Data Transfers
NVIDIA releases Inference Transfer Library (NIXL), an open-source tool accelerating KV cache transfers for distributed AI inference across major cloud platforms.
Ray Data and Docling Tackle Enterprise AI's Biggest Pain Point
New integration combines Ray Data's distributed processing with Docling's document parsing to process 10k+ complex files for RAG applications in hours instead of days.
Multi-Node GPU Training Guide Reveals 72B Model Scaling Secrets
Together.ai details how to train 72B parameter models across 128 GPUs, achieving 45-50% utilization with proper network tuning and fault tolerance.