realtime-ai

Set of 📝 with 🔗 to help those building Voice AI agents 🎙️🤖

Open-source realtime voice agent server in Go with WebRTC (WHIP), barge-in, streaming STT/LLM/TTS pipelines, plugin system, multi-language SDKs, SIP telephony, ESP32 support & fully local mode.

🎤💬 Full example of implementing ChatGPT's realtime voice from scratch with VAD + STT + LLM + TTS technology stack within almost one file!

Eldercare runtime: risk-gated companion with reminders, anti-fraud, family escalation, and traceability

Real-time voice agents with parallel async background sub-agents — conversations continue naturally while tasks run • Join the builders → https://discord.gg/mqxKaN3UKC

Open-source realtime voice AI with adaptive VAD, latency telemetry, interruptible TTS, an inspectable TypeScript WebSocket gateway, and experimental Ollama/local AI.

Krea-Desktop - AI real-time image generation canvas with live drawing, upscaling, and video effects.

open-source VoiceAgentRAG. Sub-millisecond predictive retrieval for voice and conversational AI

LiveKit voice app validation skill. Use when building, debugging, or declaring working any LiveKit voice agent, Agents UI app, or React/Next.js LiveKit project. Enforces evidence-based validation before reporting a session, token endpoint, worker, transcript, or end-to-end voice interaction as complete.

An AI-powered object detection system using YOLOv8 to identify and locate graffiti across various contexts including walls, buildings, over-bridges, vehicles, and other surfaces.

Realtime multimodal AI agent with voice streaming, RAG memory, and autonomous workflows

Gemini Live API voice tutor for K-12 NCERT math — Hindi/English, hand-drawn whiteboard, open source

LiveKit Agents UI demo showing a voice AI assistant that schedules roof inspections using real-time voice interaction, visualizers, and booking workflow.

Vendor-neutral Agent Skills for people who build voice agents. Read by Claude Code, Cursor, Codex, Copilot, Gemini CLI.

Bun-first TypeScript toolkit for realtime voice AI agents with pluggable telephony, WebRTC, and browser WebSocket transports.

Cosight — A realtime multimodal AI agent runtime with composable roles and capabilities.

Production-ready real-time voice AI pipeline integrating Twilio Media Streams, streaming ASR (Deepgram), LLM reasoning, and live analytics dashboard. Designed for ultra-low latency conversational intelligence in call center and healthcare environments.

Realtime Voice AI platform featuring streaming speech-to-text, multi-agent conversational orchestration, Redis Streams event processing, WebSockets, OpenAI Whisper/TTS, Prometheus-Grafana observability, and session-aware memory management, and cloud deployment.

A voice waiter that lives in the table, not in the phone. reSpeaker XVF3800 + XIAO ESP32S3 — the array hears which diner is speaking, so each dish goes to whoever asked for it.

⚡ Full-stack realtime AI voice assistant & Iron Man HUD with Gemini 2.0 Flash, Edge-TTS & Whisper STT (FastAPI, WebSockets, React & TypeScript)