Skip to content

The best open-source speech and audio AI projects in 2026

Last updated
Sep 11, 2026
Projects considered
25
Commits reviewed
0 of 25

Speech recognition, text to speech, voice cloning and audio understanding.

Mostly written in Python, TypeScript, Go, Rust and C++.

How this list is ranked. By total GitHub stars at the last daily refresh — a popularity signal, not a measure of quality, fit or safety. Star counts in the AI category are known to be inflated by fake-star campaigns, so each row leads with push activity and license instead. No commit in this collection has completed security review yet, so treat every entry as unreviewed discovery metadata.
  1. 1NVIDIA-NeMo organisation mark

    Speech

    NVIDIA-NeMo/Speech

    A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

    Pushed yesterday.Apache License 2.0PythonDeveloper tools18.7k+65
  2. 2jamiepine organisation mark

    voicebox

    jamiepine/voicebox

    The open-source AI voice studio. Clone, dictate, create.

    Pushed 28 days ago.MIT LicenseTypeScriptApps59.3k+637
  3. 3mudler organisation mark

    LocalAI

    mudler/LocalAI

    LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

    Pushed yesterday.MIT LicenseGoDeveloper tools50.2k+162
  4. 4babysor organisation mark

    MockingBird

    babysor/MockingBirdSlowing

    🚀Clone a voice in 5 seconds to generate arbitrary speech in real-time

    Last push 8 months ago.OtherPythonApps36.9k
  5. 5Zackriya-Solutions organisation mark

    meetily

    Zackriya-Solutions/meetily

    Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted, Open-source Ai meeting note taker for macOS & Windows. Understand How to write meeting minutes

    Pushed yesterday.MIT LicenseRustApps32.4k+181
  6. 6Osmantic organisation mark

    ODS

    Osmantic/ODS

    Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.

    Pushed yesterday.Apache License 2.0PythonDeveloper tools7.8k+53
  7. 7rsxdalv organisation mark

    TTS-WebUI

    rsxdalv/TTS-WebUI

    A single Gradio + React WebUI with extensions for ACE-Step, OmniVoice, Kimi Audio, Piper TTS, GPT-SoVITS, CosyVoice, XTTSv2, DIA, Kokoro, OpenVoice, ParlerTTS, Stable Audio, MMS, StyleTTS2, MAGNet, AudioGen, MusicGen, Tortoise, RVC, Vocos, Demucs, SeamlessM4T, and Bark!

    Pushed yesterday.MIT LicenseTypeScriptApps3.3k+10
  8. 8huggingface organisation mark

    transformers

    huggingface/transformers

    🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

    Pushed yesterday.Apache License 2.0PythonDeveloper tools168.5k+255
  9. 9harry0703 organisation mark

    MoneyPrinterTurbo

    harry0703/MoneyPrinterTurbo

    利用 AI 大模型和自动化工作流,根据主题或关键词一键生成高清短视频。Generate HD short videos from a topic or keyword with an automated AI workflow.

    Pushed yesterday.MIT LicensePythonApps138.0k+2.4k
  10. 10unslothai organisation mark

    unsloth

    unslothai/unsloth

    Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

    Pushed yesterday.Apache License 2.0PythonApps79.0k+386
  11. 11calesthio organisation mark

    OpenMontage

    calesthio/OpenMontage

    World's first open-source, agentic video production system. 12 production pipelines, 100+ tools, 700+ agent skill and production-knowledge files. Turn your AI coding assistant into a full video production studio.

    Pushed 6 days ago.GNU Affero General Public License v3.0PythonApps75.7k+3.4k
  12. 122noise organisation mark

    ChatTTS

    2noise/ChatTTSSlowing

    A generative speech model for daily dialogue.

    Last push 7 months ago.GNU Affero General Public License v3.0PythonApps40.0k+26
  13. 13mastra-ai organisation mark

    mastra

    mastra-ai/mastra

    Mastra is the modern TypeScript framework for AI-powered applications and agents.

    Pushed yesterday.OtherTypeScriptDeveloper tools29.3k+192
  14. 14huggingface organisation mark

    datasets

    huggingface/datasets

    🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

    Pushed 4 days ago.Apache License 2.0PythonApps22.1k+17
  15. 15modelscope organisation mark

    FunASR

    modelscope/FunASR

    Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.

    Pushed yesterday.MIT LicensePythonPlugins20.9k+80
  16. 16leon-ai organisation mark

    leon

    leon-ai/leon

    🧠 Leon is your open-source personal assistant.

    Pushed yesterday.MIT LicenseTypeScriptApps17.6k+21
  17. 17openvinotoolkit organisation mark

    openvino

    openvinotoolkit/openvino

    OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

    Pushed yesterday.Apache License 2.0C++Developer tools11.1k+27
  18. 18xorbitsai organisation mark

    inference

    xorbitsai/inference

    Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

    Pushed yesterday.Apache License 2.0PythonDeveloper tools9.6k+11
  19. 19juce-framework organisation mark

    JUCE

    juce-framework/JUCE

    JUCE is an open-source cross-platform C++ application framework for desktop and mobile applications, including VST, VST3, AU, AUv3, LV2 and AAX audio plug-ins.

    Pushed 2 days ago.OtherC++Plugins9.1k+33
  20. 20dramaclaw organisation mark

    dramaclaw

    dramaclaw/dramaclaw

    A general-purpose AIGC video engine: script to finished film in one pipeline — dramas, ads, product videos, otome games, and more. | 通用 AIGC 视频引擎 —— 从剧本到成片一条流水线,漫剧、广告、电商、乙游皆可

    Pushed yesterday.OtherPythonDeveloper tools7.1k+569
  21. 21DISTRHO organisation mark

    Cardinal

    DISTRHO/CardinalSlowing

    Virtual modular synthesizer plugin

    Last push 3 months ago.GNU General Public License v3.0C++Plugins3.2k+8
  22. 22muxinc organisation mark

    media-chrome

    muxinc/media-chrome

    Custom elements (web components) for making audio and video player controls that look great in your website or app.

    Pushed 4 days ago.MIT LicenseTypeScriptUI / Frontend2.8k+3
  23. 23microsoft organisation mark

    foundry-local

    microsoft/foundry-local

    No description provided by the repository owner.

    Pushed yesterday.OtherC++Apps2.6k+9
  24. 24free-audio organisation mark

    clap

    free-audio/clap

    Audio Plugin API

    Pushed 2 months ago.MIT LicenseCPlugins2.4k+5
  25. 25

    sonobus

    sonosaurus/sonobus

    Source code for SonoBus, a real-time network audio streaming collaboration tool.

    Pushed 2 months ago.GNU General Public License v3.0C++Plugins2.2k+13