The best sglang alternatives

unsloth

unslothai/unsloth

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

Choose unsloth if…

• you want the more widely starred option (79.0k)
• you specifically need agent or ai

Shares deepseek, llama, llm, qwen with sglang.

vllm

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Choose vllm if…

• you want the more widely starred option (96.2k)
• you specifically need amd or deepseek-v3

Shares blackwell, cuda, deepseek, gpt-oss with sglang.

LlamaFactory

hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Choose LlamaFactory if…

• you want the more widely starred option (75.9k)
• you specifically need agent or ai

Shares deepseek, llama, llm, moe with sglang.

inference

xorbitsai/inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Choose inference if…

• you prefer a smaller, narrower project to a large one
• you specifically need artificial-intelligence or deployment

Shares glm, inference, llm, qwen with sglang.

transformers

huggingface/transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Choose transformers if…

• you want the more widely starred option (168.5k)
• you specifically need audio or deep-learning

Shares deepseek, glm, llm, qwen with sglang.

ollama

ollama/ollama

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

Choose ollama if…

• you would rather work in Go than Python
• MIT License suits your use better than Apache License 2.0
• you want the more widely starred option (185.8k)
• you specifically need gemma or gemma3

Shares deepseek, glm, gpt-oss, llama with sglang.

Langchain-Chatchat

chatchat-space/Langchain-Chatchat

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain

Choose Langchain-Chatchat if…

• you specifically need chatbot or chatchat

Shares llama, llm, qwen with sglang.

LocalAI

mudler/LocalAI

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

Choose LocalAI if…

• you would rather work in Go than Python
• MIT License suits your use better than Apache License 2.0
• you specifically need agents or ai

Shares llama, llm with sglang.

AstrBot

AstrBotDevs/AstrBot

AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨

Choose AstrBot if…

• GNU Affero General Public License v3.0 suits your use better than Apache License 2.0
• you specifically need agent or ai

Shares llama, llm with sglang.

claude-code-local

nicedreamzapp/claude-code-local

Run Claude Code 100% on-device with local AI on Apple Silicon. MLX-native Anthropic-API server. 6 fighters incl. Muse-Glimmer 30B (now multimodal — reads images, abliterated), Gemma 4 31B, Qwen 3.5 122B (65 tok/s), DeepSeek V4 Flash (1M ctx). Private, offline, airgap-ready. Built for NDA / legal / healthcare workflows.

Choose claude-code-local if…

• MIT License suits your use better than Apache License 2.0
• you prefer a smaller, narrower project to a large one
• you specifically need abliterated or ai-privacy

Shares llama, qwen with sglang.

repomix

yamadashy/repomix

📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, DeepSeek, Perplexity, Gemini, Gemma, Llama, Grok, and more.

Choose repomix if…

• you would rather work in TypeScript than Python
• MIT License suits your use better than Apache License 2.0
• you specifically need ai or anthropic

Shares deepseek, llama, llm with sglang.

dyad

dyad-sh/dyad

Local, open-source AI app builder for power users ✨ v0 / Lovable / Replit / Bolt alternative 🌟 Star if you like it!

Choose dyad if…

• you would rather work in TypeScript than Python
• you specifically need ai-app-builder or anthropic

Shares deepseek, llm, qwen with sglang.