Pinned Loading

1. NVIDIA/TensorRT-LLM NVIDIA/TensorRT-LLM Public

   TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…

   Python 12.6k 2k

2. huggingface/transformers huggingface/transformers Public

   🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

   Python 155k 31.7k

3. NVIDIA/Model-Optimizer NVIDIA/Model-Optimizer Public

   A unified library of SOTA model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks …

   Python 1.8k 236

4. huggingface/diffusers huggingface/diffusers Public

   🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.

   Python 32.5k 6.7k