llama.cpp
Open source · Local LLMs · ggml-org/llama.cpp
What it does
llama.cpp is the engine that runs many open models efficiently on ordinary hardware, including laptops without a big graphics card. Many friendlier local AI apps have been built on top of it.
Good for: Running models on modest hardware, or getting the most speed out of your own machine.
llama.cpp on GitHub (opens in a new tab) Project homepage (opens in a new tab)
Visitor votes, one per browser. Your own vote is kept on this device only. How votes work.
The signals we checked
- Licence
- MIT (OSI-approved open-source licence)
- Popularity
- Stars: 131,328 (checked 16 Oct 2026)
- Last commit
- 16 Oct 2026
- Open issues and PRs
- 2,548
- Status
- Active (not archived)
- Self-host
- ModeratePrebuilt downloads or build from source; you pick and download model files yourself.
- GitHub topics
- ggml
More in local llms
- Ollama Trying open models privately on your own computer, and powering other local AI tools.
- Open WebUI A private chat app for you or a small team, in front of local or cloud models.
- vLLM Serving an open model to a team or an app, where speed and cost per request matter.
- LocalAI Moving an app that already uses the OpenAI API onto your own hardware.
No affiliate links on this page, and we are not paid by this project. The summary is our own plain-English description; check the repo for current features before you rely on it.
Stars, licences and commit dates come from the GitHub API, checked 16 Oct 2026. "Last commit" is the last push to the repo. Star counts are a rough popularity signal, not a quality score. There are no affiliate links in this section: links go straight to each project.