Tensorrt
NVIDIA TensorRT Enhances Stable Diffusion 3.5 on RTX GPUs
NVIDIA's TensorRT SDK significantly boosts the performance of Stable Diffusion 3.5, reducing VRAM requirements by 40% and doubling efficiency on RTX GPUs.
NVIDIA Unveils TensorRT for RTX to Boost AI Application Performance
NVIDIA introduces TensorRT for RTX, a new SDK aimed at enhancing AI application performance on NVIDIA RTX GPUs, supporting both C++ and Python integrations for Windows and Linux.
NVIDIA Unveils TensorRT for RTX: Enhanced AI Inference on Windows 11
NVIDIA introduces TensorRT for RTX, an optimized AI inference library for Windows 11, enhancing AI experiences across creativity, gaming, and productivity apps.
NVIDIA's FP4 Image Generation Boosts RTX 50 Series GPU Performance
NVIDIA's latest TensorRT update introduces FP4 image generation for RTX 50 series GPUs, enhancing AI model performance and efficiency. Explore the advancements in generative AI technology.
Microsoft and NVIDIA Enhance Llama Model Performance on Azure AI Foundry
Microsoft and NVIDIA collaborate to significantly boost Meta Llama model performance on Azure AI Foundry using NVIDIA TensorRT-LLM optimizations, enhancing throughput, reducing latency, and improving cost efficiency.
NVIDIA Enhances Llama 3.3 70B Model Performance with TensorRT-LLM
Discover how NVIDIA's TensorRT-LLM boosts Llama 3.3 70B model inference throughput by 3x using advanced speculative decoding techniques.
NVIDIA's TensorRT-LLM MultiShot Enhances AllReduce Performance with NVSwitch
NVIDIA introduces TensorRT-LLM MultiShot to improve multi-GPU communication efficiency, achieving up to 3x faster AllReduce operations by leveraging NVSwitch technology.
NVIDIA Enhances Llama 3.1 405B Performance with TensorRT Model Optimizer
NVIDIA's TensorRT Model Optimizer significantly boosts performance of Meta's Llama 3.1 405B large language model on H200 GPUs.
NVIDIA Enhances TensorRT Model Optimizer v0.15 with Improved Inference Performance
NVIDIA releases TensorRT Model Optimizer v0.15, offering enhanced inference performance through new features like cache diffusion and expanded AI model support.
Enhanced AI Performance with NVIDIA TensorRT 10.0's Weight-Stripped Engines
NVIDIA introduces TensorRT 10.0 with weight-stripped engines, offering >95% compression for AI apps.