#66th of 38 in VoiceFor voice, speech and music
whisperlivekit
Real-time streaming speech-to-text server with diarization and translation
- Stars
- 11.2k
- License
- Apache-2.0
- Last commit
- Aug 2026
- Last release
- Aug 2026
- Language
- Python
9,875 on 31 Mar 202611,158 on 20 Oct 2026
From GitHub's daily star counts.
Checked on GitHub.
Overview
WhisperLiveKit is a Python server that transcribes microphone or browser audio in real time using simultaneous-decoding policies (SimulStreaming, LocalAgreement) instead of re-running Whisper on fixed chunks. It exposes a native WebSocket at /asr, an OpenAI-compatible transcription endpoint and a Deepgram-compatible WebSocket, and ships a web UI and a Chrome extension. Backends include Whisper, MLX Whisper, Voxtral, Qwen3-ASR, Canary and FunASR SenseVoice.
Who it is for: Developers self-hosting live transcription, captions or meeting STT
Ranked among open-source alternatives to ElevenLabs (#6 of 10) and Otter.ai (#7 of 10).
Strengths
- Serves OpenAI-style /v1/audio/transcriptions, Deepgram-style WebSocket and native /asr WebSocket
- Many backends: Whisper, MLX Whisper, Voxtral, Qwen3-ASR, Canary, SenseVoiceSmall
- Optional Sortformer speaker diarization and translation to and from 200 languages
- One shared engine serves multiple concurrent sessions with per-session language
Weaknesses
- Heavy extras (voxtral-hf, vLLM stacks) conflict and need separate environments
- Qwen3 causal mode is English-only; vLLM causal and Metal paths are experimental
- Qwen3 streaming plans one realtime session per GPU and needs an explicit language
- Canary on CPU is slow; GPU strongly recommended for larger backends
What it needs
- GPU optional
- Docker + Compose
- Needs PyTorch, NeMo (diarization, Canary), vLLM (optional Qwen3 backend)
- Models: Whisper, MLX Whisper, Voxtral Mini, Qwen3-ASR, Canary-1b-v2
- port 8000
Also in Voice
See all 38| Rank | Project | Score |
|---|---|---|
| 1 | voicestudioDesktop app for voice cloning, dubbing and dictation with local speech models | 83 out of 100 |
| 2 | whisper.cppC/C++ port of OpenAI Whisper for local speech-to-text transcription | 77 out of 100 |
| 3 | VoiceboxLocal voice studio for cloning, TTS, dictation and agent speech | 71 out of 100 |
| #4 | buzzOffline desktop app for transcribing and translating audio with Whisper | 69 out of 100 |
| #5 | meetilyDesktop app that records, transcribes and summarizes meetings locally | 68 out of 100 |