Redrafter
Redrafter
NVIDIA Enhances LLM Inference with ReDrafter Support in TensorRT-LLM
NVIDIA's TensorRT-LLM now supports Apple's ReDrafter, optimizing large language model inference with speculative decoding, offering significant performance boosts on NVIDIA GPUs.