The best LocalAI alternatives

unsloth

unslothai/unsloth

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

Choose unsloth if…

• you would rather work in Python than Go
• Apache License 2.0 suits your use better than MIT License
• you want the more widely starred option (79.0k)
• you specifically need agent or chatgpt

Shares ai, image-generation, llama, llm with LocalAI.

AstrBot

AstrBotDevs/AstrBot

AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨

Choose AstrBot if…

• you would rather work in Python than Go
• GNU Affero General Public License v3.0 suits your use better than MIT License
• you specifically need agent or astrbot

Shares ai, llama, llm, mcp with LocalAI.

mastra

mastra-ai/mastra

Mastra is the modern TypeScript framework for AI-powered applications and agents.

Choose mastra if…

• you would rather work in TypeScript than Go
• you specifically need chatbots or evals

Shares agents, ai, llm, mcp with LocalAI.

mcp-toolbox

googleapis/mcp-toolbox

MCP Toolbox for Databases is an open source MCP server for databases.

Choose mcp-toolbox if…

• Apache License 2.0 suits your use better than MIT License
• you want something your agent can install directly rather than a library to wire up yourself
• you prefer a smaller, narrower project to a large one
• you specifically need agent or bigquery

Shares agents, ai, llm, mcp with LocalAI.

koog

JetBrains/koog

Koog is a JVM (Java and Kotlin) framework for building predictable, fault-tolerant and enterprise-ready AI agents across all platforms – from backend services to Android and iOS, JVM, and even in-browser environments. Koog is based on our AI products expertise and provides proven solutions for complex LLM and AI problems

Choose koog if…

• you would rather work in Kotlin than Go
• Apache License 2.0 suits your use better than MIT License
• you prefer a smaller, narrower project to a large one
• you specifically need agentframework or agentic-ai

Shares agents, ai, llm, mcp with LocalAI.

LlamaFactory

hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Choose LlamaFactory if…

• you would rather work in Python than Go
• Apache License 2.0 suits your use better than MIT License
• you want the more widely starred option (75.9k)
• you specifically need agent or deepseek

Shares ai, llama, llm with LocalAI.

repomix

yamadashy/repomix

📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, DeepSeek, Perplexity, Gemini, Gemma, Llama, Grok, and more.

Choose repomix if…

• you would rather work in TypeScript than Go
• you specifically need anthropic or artificial-intelligence

Shares ai, llama, llm, mcp with LocalAI.

GenAI_Agents

NirDiamant/GenAI_Agents

50+ tutorials and implementations for Generative AI Agent techniques, from basic conversational bots to complex multi-agent systems.

Choose GenAI_Agents if…

• you would rather work in Jupyter Notebook than Go
• you prefer a smaller, narrower project to a large one
• you specifically need agentic-ai or ai-agents

Shares agents, ai, llm, mcp with LocalAI.

screenpipe

screenpipe/screenpipe

YC (S26) | Open Computer History | Record your screen continuously locally and provide context to your agents (Claude, Codex, Openclaw, Hermes, Runner...)

Choose screenpipe if…

• you would rather work in Rust than Go
• you prefer a smaller, narrower project to a large one
• you specifically need agi or ai-memory

Shares agents, ai, llm, mcp with LocalAI.

lemonade

lemonade-sdk/lemonade

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

Choose lemonade if…

• you would rather work in C++ than Go
• Apache License 2.0 suits your use better than MIT License
• you want something your agent can install directly rather than a library to wire up yourself
• you prefer a smaller, narrower project to a large one

Shares ai, llama, llm, mcp with LocalAI.

OpenMontage

calesthio/OpenMontage

World's first open-source, agentic video production system. 12 production pipelines, 100+ tools, 700+ agent skill and production-knowledge files. Turn your AI coding assistant into a full video production studio.

Choose OpenMontage if…

• you would rather work in Python than Go
• GNU Affero General Public License v3.0 suits your use better than MIT License
• you want the more widely starred option (75.7k)
• you specifically need agent or agentic-ai

Shares ai, image-generation, stable-diffusion with LocalAI.

khoj

khoj-ai/khoj

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.

Choose khoj if…

• you would rather work in Python than Go
• GNU Affero General Public License v3.0 suits your use better than MIT License
• you specifically need agent or assistant

Shares ai, image-generation, llm with LocalAI.