#157157th of 197 in Coding agents and AI editors
llama.vscode
VS Code extension for local FIM completion, chat and agentic coding on llama.cpp
- Stars
- 1.6k
- License
- MIT
- Last commit
- Nov 2026
- Last release
- Nov 2026
- Language
- TypeScript
1,241 on 21 Apr 20261,553 on 10 Nov 2026
From GitHub's daily star counts.
Checked on GitHub.
Overview
llama.vscode is a VS Code extension that sends fill-in-the-middle completion requests to a local llama.cpp server, with a ring context built from open and edited files. It also includes a chat view and Llama Agent, which works with local models or external ones such as OpenRouter and can use MCP servers installed in VS Code. Models are grouped into envs that can be selected, imported and exported together.
Who it is for: VS Code users wanting local code completion and an agent on llama.cpp
Strengths
- Completion runs locally on llama.cpp, with documented settings for under 8GB up to 64GB+ VRAM
- Ring context from open files and yanked text, with cache reuse for large contexts
- Envs switch whole model sets (completion, chat, embeddings, tools) in one step
- Agent can use MCP servers installed in VS Code and external providers like OpenRouter
Weaknesses
- Completion requires FIM-compatible models, which limits model choice
- CPU-only setups are documented as significantly lower quality
- Tied to VS Code; Vim/Neovim needs the separate llama.vim plugin
- Agent ships 9 internal tools; custom tools must be written in JavaScript
What it needs
- GPU optional
- Needs VS Code, llama.cpp
- Models: GGUF, FIM models (Qwen2.5-Coder), gpt-oss 20B, OpenRouter, Hugging Face downloads
- port 8012
Quick answers
Is llama.vscode open source?
Yes. Its code is on GitHub under the MIT license.
Also in Coding agents and AI editors
See all 197| Rank | Project | Score |
|---|---|---|
| 1 | claw-codeRust CLI coding agent harness using Anthropic and OpenAI-compatible APIs | 97 out of 100 |
| 2 | t3codeDesktop, web and mobile front end for controlling local coding agent CLIs | 94 out of 100 |
| 3 | codewhaleTerminal coding agent in Rust that works with 40+ model providers | 94 out of 100 |
| #4 | piMinimal terminal coding agent extensible with skills and packages | 92 out of 100 |
| #5 | oh-my-openagentTerminal coding agent with multi-model orchestration and git-backed memory | 92 out of 100 |