#77th of 26 in Voice

agents

Python framework for realtime voice and multimodal agents on LiveKit WebRTC

Stars
14.7k
License
Apache-2.0
Last commit
Oct 2026
Last release
Oct 2026
Language
Python

Missed the latest GitHub check; these facts may be older.

Overview

LiveKit Agents is a Python framework for building server-side agents that join LiveKit rooms as realtime participants. It wires together VAD, STT, LLM and TTS (or a realtime model API) through plugins, with tool calling, multi-agent handoff, job dispatch, SIP telephony and MCP tool support. A built-in test framework can run agent sessions and judge replies with an LLM.

Who it is for: Developers building realtime voice or phone agents in Python

Strengths

  • Mix STT, LLM, TTS or realtime APIs via plugins (OpenAI, Deepgram, Cartesia, Google)
  • Built-in job dispatch and AgentServer for scheduling sessions across processes
  • Telephony via LiveKit SIP for inbound and outbound calls
  • Test framework asserts on tool calls and uses LLM judges for replies

Weaknesses

  • Needs a LiveKit server (Cloud or self-hosted) and credentials beyond console mode
  • README examples default to LiveKit Inference, a LiveKit Cloud service
  • Turn detection models use the LiveKit Model License, not Apache-2.0
  • This repo is Python only; the JS/TS library is a separate repository

What it needs

  • no GPU
  • Needs LiveKit server or LiveKit Cloud, STT/LLM/TTS provider API keys or LiveKit Inference
  • Models: OpenAI, Deepgram, Cartesia, Google Gemini, OpenAI Realtime API

Also in Voice

See all 26
Also in Voice
RankProjectScore
1voicestudioDesktop app for voice cloning, dubbing and dictation with local speech models66.4k starsAGPL-3.082 out of 100
2whisper.cppC/C++ port of OpenAI Whisper for local speech-to-text transcription54.4k starsMIT76 out of 100
3buzzOffline desktop app for transcribing and translating audio with Whisper22k starsMIT74 out of 100
#4VoiceboxLocal voice studio for cloning, TTS, dictation and agent speech57.5k starsMIT70 out of 100
#5meetilyDesktop app that records, transcribes and summarizes meetings locally Live demo ↗ (opens in a new tab)31.7k starsMIT66 out of 100