There was an error while loading. Please reload this page.
A fast inference library for running LLMs locally on modern consumer-class GPUs
Python 4.6k 340
An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
Python 1.3k 165
Web UI for ExLlamaV2
JavaScript 515 45
Loading…