The best ms-swift alternatives

transformers

huggingface/transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Choose transformers if…

• you want the more widely starred option (168.9k)
• you specifically need audio or deep-learning

Shares deepseek, glm, llm, qwen with ms-swift.

vllm

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Choose vllm if…

• you want the more widely starred option (96.8k)
• you specifically need amd or blackwell

Shares deepseek, kimi, llm, moe with ms-swift.

LlamaFactory

hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Choose LlamaFactory if…

• you want the more widely starred option (76.0k)
• you specifically need agent or ai

Shares deepseek, llm, lora, moe with ms-swift.

sglang

sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

Choose sglang if…

• you want the more widely starred option (38.8k)
• you specifically need attention or blackwell

Shares deepseek, glm, llm, moe with ms-swift.

inference

xorbitsai/inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Choose inference if…

• you specifically need artificial-intelligence or deployment

Shares glm, kimi, llm, qwen with ms-swift.

UltraRAG

OpenBMB/UltraRAG

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

Choose UltraRAG if…

• you prefer a smaller, narrower project to a large one
• you specifically need demo or easy

Shares deepseek, embedding, llm, multimodal with ms-swift.

ollama

ollama/ollama

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

Choose ollama if…

• you would rather work in Go than Python
• MIT License suits your use better than Apache License 2.0
• you want the more widely starred option (186.8k)
• you specifically need gemma or gemma3

Shares deepseek, glm, llm, qwen with ms-swift.

Soup

MakazhanAlpamys/Soup

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

Choose Soup if…

• you specifically need cli or consumer-gpu

Shares llm, lora, peft, sft with ms-swift.

project-maya

mw00/project-maya

Run GLM-5.3 (744B), GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one dashboard, OpenAI- and Anthropic-compatible API.

Choose project-maya if…

• you would rather work in C++ than Python
• MIT License suits your use better than Apache License 2.0
• you prefer a smaller, narrower project to a large one
• you specifically need anthropic-api or cuda

Shares deepseek, glm, llm, moe with ms-swift.

unsloth

unslothai/unsloth

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

Choose unsloth if…

• you want the more widely starred option (79.4k)
• you specifically need agent or ai

Shares deepseek, llm, qwen with ms-swift.

Langchain-Chatchat

chatchat-space/Langchain-Chatchat

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain

Choose Langchain-Chatchat if…

• you want the more widely starred option (38.7k)
• you specifically need chatbot or chatchat

Shares embedding, llm, qwen with ms-swift.

OmniRoute

diegosouzapw/OmniRoute

Never stop coding. Free MIT AI gateway: one endpoint, 352 providers (150+ free), 1200+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 550+ contributors

Choose OmniRoute if…

• you would rather work in TypeScript than Python
• MIT License suits your use better than Apache License 2.0
• you want the more widely starred option (86.9k)
• you specifically need a2a or ai-agents

Shares deepseek, kimi, qwen with ms-swift.