QUANTIZATION
Quantization
NVIDIA Jetson Memory Tricks Let Edge Devices Run 10B Parameter AI Models
NVIDIA reveals optimization techniques that reclaim up to 12GB of memory on Jetson devices, enabling multi-billion parameter LLMs to run on edge hardware.
Quantization
Enhancing AI Model Efficiency with Quantization Aware Training and Distillation
Explore how Quantization Aware Training (QAT) and Quantization Aware Distillation (QAD) optimize AI models for low-precision environments, enhancing accuracy and inference performance.
Quantization
Enhancing Large Language Models: NVIDIA's Post-Training Quantization Techniques
NVIDIA's post-training quantization (PTQ) advances performance and efficiency in AI models, leveraging formats like NVFP4 for optimized inference without retraining, according to NVIDIA.
Quantization
Nexa AI Enhances DeepSeek R1 Distill Performance with NexaQuant on AMD Platforms
Nexa AI introduces NexaQuant technology for DeepSeek R1 Distills, optimizing performance on AMD platforms with improved inference capabilities and reduced memory footprint.