The best MTPLX alternatives

claude-code-local

nicedreamzapp/claude-code-local

Run Claude Code 100% on-device with local AI on Apple Silicon. MLX-native Anthropic-API server. 6 fighters incl. Muse-Glimmer 30B (now multimodal — reads images, abliterated), Gemma 4 31B, Qwen 3.5 122B (65 tok/s), DeepSeek V4 Flash (1M ctx). Private, offline, airgap-ready. Built for NDA / legal / healthcare workflows.

Choose claude-code-local if…

• MIT License suits your use better than Apache License 2.0
• you specifically need abliterated or ai-privacy

Shares apple-silicon, local-ai, mlx, qwen with MTPLX.

turbo-fieldfare

drumih/turbo-fieldfare

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

Choose turbo-fieldfare if…

• you would rather work in Swift than Python
• you want the more widely starred option (7.2k)
• you specifically need gemma or gemma4

Shares apple-silicon, local-ai, metal with MTPLX.

mlx-vlm

Blaizzy/mlx-vlm

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

Choose mlx-vlm if…

• MIT License suits your use better than Apache License 2.0
• you want the more widely starred option (5.8k)
• you specifically need florence2 or idefics

Shares apple-silicon, local-ai, mlx with MTPLX.

lucebox

Luce-Org/lucebox

LLM speculative inference server for heterogeneous hardware & consumer GPUs

Choose lucebox if…

• you would rather work in C++ than Python
• you specifically need cuda or cuda-kernels

Shares local-ai, qwen, speculative-decoding with MTPLX.

unsloth

unslothai/unsloth

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

Choose unsloth if…

• you want the more widely starred option (79.0k)
• you specifically need agent or ai

Shares qwen with MTPLX.

nanobot

HKUDS/nanobot

Ultra-lightweight, open-source, self-hosted personal AI agent framework in Python with WebUI, tools, memory, MCP, multi-agent workflows, automation, and chat apps

Choose nanobot if…

• MIT License suits your use better than Apache License 2.0
• you want the more widely starred option (49.8k)
• you specifically need agent-framework or ai-agent

Shares openai-compatible with MTPLX.

Langchain-Chatchat

chatchat-space/Langchain-Chatchat

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain

Choose Langchain-Chatchat if…

• you want the more widely starred option (38.7k)
• you specifically need chatbot or chatchat

Shares qwen with MTPLX.

shimmy

Michael-A-Kuykendall/shimmy

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

Choose shimmy if…

• you would rather work in Rust than Python
• you want the more widely starred option (6.0k)
• you specifically need api-server or command-line-tool

Shares local-ai, openai-compatible with MTPLX.

vllm

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Choose vllm if…

• you want the more widely starred option (96.3k)
• you specifically need amd or blackwell

Shares qwen with MTPLX.

LlamaFactory

hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Choose LlamaFactory if…

• you want the more widely starred option (75.9k)
• you specifically need agent or ai

Shares qwen with MTPLX.

sglang

sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

Choose sglang if…

• you want the more widely starred option (38.5k)
• you specifically need attention or blackwell

Shares qwen with MTPLX.

inference

xorbitsai/inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Choose inference if…

• you want the more widely starred option (9.6k)
• you specifically need artificial-intelligence or deployment

Shares qwen with MTPLX.