Repository / RESOURCE PROFILE

quant.cpp

LLM inference with 7x longer context. Pure C, zero dependencies. Lossless KV cache compression + single-header library

github.comC
Visit source website ↗

Overview

LLM inference with 7x longer context. Pure C, zero dependencies. Lossless KV cache compression + single-header library

Topics & capabilities

llmtransformerlibrarydelta-compressionembeddableggufkv-cachellm-inferencepure-cquantization

Repository information

Repository
quantumaikr/quant.cpp ↗
Repository owner
quantumaikr
Primary language
C
Repository code license
Apache-2.0 ↗
Maintenance status
Not archived at the recorded check
Forked repository
No
GitHub stars
403
Forks
44
Default branch
main
Last repository push
Apr 26, 2026
Latest release
v0.13.0 ↗
Release published
Apr 12, 2026

Source: GitHub API · observed Oct 11, 2026. Stars and forks are recorded counts. Repository code licenses may differ from dataset or model-weight licenses.

Source links & provenance

https://github.com/quantumaikr/quant.cpp ↗

Discovery references

References explain how this resource entered the collection. They do not represent an endorsement.

Explore related resources

Sign In

Register

Reset Password

Please enter your username or email address, you will receive a link to create a new password via email.