Popular repositories Loading

1. llama.cpp-b4139 llama.cpp-b4139 Public

   A fork of llama.cpp-b4139 that can convert and run Llama-3_1-Nemotron-51B and DeciLM-7B-Instruct

   C++ 2

2. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++ fork to support Nemotron 51B/49B/253B

   C++

3. exllamav2 exllamav2 Public

   Forked from turboderp-org/exllamav2

   A fast inference library for running LLMs locally on modern consumer-class GPUs modified to support Llama-3_1-Nemotron-51B

   Python

4. exllamav3 exllamav3 Public

   Forked from turboderp-org/exllamav3

   An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs to support Nemotron 51B/49B

   Python