#9797th of 105 in Model serving

clm

Contrastive model that scores candidate actions or answers for a given state

Releases and problems feed (RSS)

Stars
3.2k
License
Apache-2.0
Last commit
Oct 2026
Language
Python
Stars, last 8 weeks+2,272
24 Sept 2026: 940 stars1 Oct 2026: 2,678 stars8 Oct 2026: 2,918 stars15 Oct 2026: 3,026 stars22 Oct 2026: 3,099 stars29 Oct 2026: 3,128 stars5 Nov 2026: 3,163 stars12 Nov 2026: 3,192 stars19 Nov 2026: 3,212 stars

940 on 24 Sept 20263,212 on 19 Nov 2026

From GitHub's daily star counts.

Checked on GitHub.

Overview

CLM serves CLM-8B, a contrastive state-action model. It embeds a state and its candidates with a Qwen3-8B encoder served by vLLM, then scores them through 20M-parameter projection heads. A FastAPI server exposes typed questions (noul, choice, score) and a rank endpoint, plus a web playground. The repo also has a fine-tuning script and an N-candidate selection evaluation for verifier use.

Who it is for: Engineers building agent verifiers, routers or classifiers on embeddings

Strengths

  • State and action embeddings are cached separately, so repeated candidates cost a dot product
  • Returns probability distributions for typed questions via /v1/systemone and /v1/rank
  • Ships a fine-tuning script, a candidate-selection eval and a playground UI on port 8700
  • Code and CLM-8B weights are both Apache-2.0

Weaknesses

  • Needs a separate vLLM Qwen3-8B pooling server on a GPU as the encoder
  • States over 2048 tokens are truncated unless both server limits are raised
  • Selects among supplied candidates only; it does not generate text
  • Comparisons against Jev come from the authors' own blog and evaluation

What it needs

  • GPU required
  • Needs vLLM, Qwen/Qwen3-8B, PyTorch
  • Models: CLM-8B (Qwen3-8B backbone), custom projection head checkpoints (.pt)
  • port 8700

Known problems

Open now, reported in the last 90 days

Titles are the reporters' own words, taken from the project's GitHub issues and ranked by reactions. We have not tried to reproduce any of them.

Also in Model serving

See all 105
Also in Model serving
RankProjectScore
1llama.cppC/C++ inference engine for GGUF LLMs and VLMs with an OpenAI-compatible server135.9k starsMIT94 out of 100
2OllamaRuns open models locally through a CLI and REST API187.8k starsMITknown advisory in latest version91 out of 100
3LocalAISelf-hosted model server with OpenAI, Anthropic and ElevenLabs-compatible APIs50.5k starsMIT91 out of 100
#4strataDesktop and terminal app that runs GGUF models locally with OpenAI-compatible APIs46.4k stars+16,488 (+55%) in 30 daysMIT89 out of 100
#5modularMojo language and MAX inference framework with an OpenAI-compatible server30.2k stars+228 (+0.8%) in 30 dayscustom license89 out of 100