NVIDIA TensorRT Model Optimizer
Open-source toolkit for accelerating models directly in production ⚡
🟢 Features:
• End-to-end optimization: quantization, pruning, distillation, speculative decoding, sparsity
• Support for Hugging Face, PyTorch, ONNX models
• Integration with NeMo, Megatron-LM, HF Accelerate
• Deployment in SGLang, TensorRT-LLM, TensorRT, vLLM.
Repository
🤖 Data Science, ML & Big Data with @DataXplore