#101101st of 153 in Agent frameworks and SDKs

llamasharp

C# library for running GGUF models locally via llama.cpp bindings

Stars
3.8k
License
MIT
Last commit
Nov 2026
Last release
Oct 2026
Language
C#
Stars, last 29 weeks+229
25 Apr 2026: 3,598 stars2 May 2026: 3,609 stars9 May 2026: 3,619 stars16 May 2026: 3,639 stars23 May 2026: 3,651 stars30 May 2026: 3,659 stars6 Jun 2026: 3,666 stars13 Jun 2026: 3,677 stars20 Jun 2026: 3,682 stars27 Jun 2026: 3,693 stars4 Jul 2026: 3,697 stars11 Jul 2026: 3,707 stars18 Jul 2026: 3,713 stars25 Jul 2026: 3,719 stars1 Aug 2026: 3,731 stars8 Aug 2026: 3,745 stars15 Aug 2026: 3,752 stars22 Aug 2026: 3,763 stars29 Aug 2026: 3,766 stars5 Sept 2026: 3,770 stars12 Sept 2026: 3,774 stars19 Sept 2026: 3,781 stars26 Sept 2026: 3,785 stars3 Oct 2026: 3,794 stars10 Oct 2026: 3,798 stars17 Oct 2026: 3,803 stars24 Oct 2026: 3,808 stars31 Oct 2026: 3,815 stars7 Nov 2026: 3,823 stars14 Nov 2026: 3,827 stars

3,598 on 25 Apr 20263,827 on 14 Nov 2026

From GitHub's daily star counts.

Checked on GitHub.

Overview

LLamaSharp is a .NET library that wraps llama.cpp so C# applications can load GGUF models and run inference on CPU or GPU. It ships NuGet backend packages for CPU, CUDA 12, CUDA 13 and Vulkan, with Metal on Mac through the CPU package. Higher-level APIs cover chat sessions, executors and RAG, and the repo includes console and ASP.NET examples.

Who it is for: .NET developers embedding local LLM inference in C# apps

Strengths

  • Prebuilt NuGet backends for CPU, CUDA 12/13, Vulkan and Metal; no C++ build needed
  • Native C# API with streaming chat sessions, executors and GPU layer offload
  • Includes LLaVA multimodal examples and RAG support
  • MIT license; releases are mapped to specific llama.cpp commits

Weaknesses

  • Each release is tied to one llama.cpp commit; mismatched backends or old GGUF files crash
  • Only loads GGUF; PyTorch or Hugging Face weights need manual conversion
  • Bundled ASP.NET project is a demo, not a documented production server
  • Integrations such as BotSharp and LangChain live in separate repositories

What it needs

  • GPU optional
  • Needs llama.cpp native backend NuGet packages, .NET
  • Models: GGUF, LLaMA, Mixtral, Phi-2, LLaVA

What changed

  1. “feat(cuda): add CUDA 13.0.0 jobs to the compile workflow by @modelpath-dev in https://github.com/SciSharp/LLamaSharp/pull/1439”

  2. “Updated to llama.cpp 815a2a5915f22ce6a760c676389c5dfe8535c08f (b10221) by @martindevans in https://github.com/SciSharp/LLamaSharp/pull/1414”

  3. “Windows arm64 cpu support by @jihadkhawaja in https://github.com/SciSharp/LLamaSharp/pull/1226”

From the release notes. No flag means the note does not say so, not that the upgrade is safe.

Also in Agent frameworks and SDKs

See all 153
Also in Agent frameworks and SDKs
RankProjectScore
1ppt-masterAgent skill that turns documents into natively editable PowerPoint decks Live demo ↗ (opens in a new tab)78k starsMIT96 out of 100
2copilotkitReact and Angular SDK for adding agent chat and generative UI to apps38.8k starsMIT92 out of 100
3openai-agents-pythonPython SDK for multi-agent workflows with handoffs, guardrails and tracing30.7k starsMIT92 out of 100
#4mastraTypeScript framework for building AI agents, workflows and MCP servers29.6k starscustom license92 out of 100
#5browser-usePython library that lets an LLM agent control a web browser Live demo ↗ (opens in a new tab)121.4k starsMIT90 out of 100