NVIDIA

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

Stars

3.8k

Forks

604

Open beginner issues

0

Indexed issues

93

Avg merge

2d 8h

Merged PRs (30d)

142