MODEL OPTIMIZATION
Model Optimization
NVIDIA Unveils NVFP4 Checkpoint for Nemotron 3 Ultra
NVIDIA introduces NVFP4 checkpoint for Nemotron 3 Ultra, delivering 5.9x inference throughput with minimal accuracy tradeoffs. Here's what you need to know.
Model Optimization
Optimizing Large Language Models with NVIDIA's TensorRT: Pruning and Distillation Explained
Explore how NVIDIA's TensorRT Model Optimizer utilizes pruning and distillation to enhance large language models, making them more efficient and cost-effective.
Model Optimization
Enhancing AI Model Efficiency: Torch-TensorRT Speeds Up PyTorch Inference
Discover how Torch-TensorRT optimizes PyTorch models for NVIDIA GPUs, doubling inference speed for diffusion models with minimal code changes.