Open source: Local LLMs
Run language models on your own computer or server, so prompts and data stay with you.
- Ollamaollama/ollama
Trying open models privately on your own computer, and powering other local AI tools.
- Open WebUIopen-webui/open-webui
A private chat app for you or a small team, in front of local or cloud models.
- llama.cppggml-org/llama.cpp
Running models on modest hardware, or getting the most speed out of your own machine.
- vLLMvllm-project/vllm
Serving an open model to a team or an app, where speed and cost per request matter.
- LocalAImudler/LocalAI
Moving an app that already uses the OpenAI API onto your own hardware.
Other categories
Agents and frameworks · Workflow automation · RAG and vector databases · Voice and TTS · Image and video · Dev tools
Stars, licences and commit dates come from the GitHub API, checked 16 Oct 2026. "Last commit" is the last push to the repo. Star counts are a rough popularity signal, not a quality score. There are no affiliate links in this section: links go straight to each project.