The best mlx-vlm alternatives

claude-code-local

nicedreamzapp/claude-code-local

Run Claude Code 100% on-device with local AI on Apple Silicon. MLX-native Anthropic-API server. 6 fighters incl. Muse-Glimmer 30B (now multimodal — reads images, abliterated), Gemma 4 31B, Qwen 3.5 122B (65 tok/s), DeepSeek V4 Flash (1M ctx). Private, offline, airgap-ready. Built for NDA / legal / healthcare workflows.

Choose claude-code-local if…

• you specifically need abliterated or ai-privacy

Shares apple-silicon, local-ai, mlx with mlx-vlm.

MTPLX

youssofal/MTPLX

3x faster speeds on MLX | Qwen 3.8 27B | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.

Choose MTPLX if…

• Apache License 2.0 suits your use better than MIT License
• you prefer a smaller, narrower project to a large one
• you specifically need anthropic-compatible or inference-engine

Shares apple-silicon, local-ai, mlx with mlx-vlm.

turbo-fieldfare

drumih/turbo-fieldfare

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

Choose turbo-fieldfare if…

• you would rather work in Swift than Python
• Apache License 2.0 suits your use better than MIT License
• you specifically need gemma or gemma4

Shares apple-silicon, llm, local-ai with mlx-vlm.

ODS

Osmantic/ODS

Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.

Choose ODS if…

• Apache License 2.0 suits your use better than MIT License
• you specifically need ai-agents or amd

Shares llm, local-ai with mlx-vlm.

Soup

MakazhanAlpamys/Soup

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

Choose Soup if…

• Apache License 2.0 suits your use better than MIT License
• you want the more widely starred option (10.1k)
• you specifically need cli or consumer-gpu

Shares llm, local-ai with mlx-vlm.

OGAM

off-grid-ai/OGAM

The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.

Choose OGAM if…

• you would rather work in TypeScript than Python
• you specifically need android or edge-ai

Shares local-ai, vision-language-model with mlx-vlm.

vllm

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Choose vllm if…

• Apache License 2.0 suits your use better than MIT License
• you want the more widely starred option (96.2k)
• you specifically need amd or blackwell

Shares llm with mlx-vlm.

LlamaFactory

hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Choose LlamaFactory if…

• Apache License 2.0 suits your use better than MIT License
• you want the more widely starred option (75.9k)
• you specifically need agent or ai

Shares llm with mlx-vlm.

AstrBot

AstrBotDevs/AstrBot

AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨

Choose AstrBot if…

• GNU Affero General Public License v3.0 suits your use better than MIT License
• you want the more widely starred option (45.8k)
• you specifically need agent or ai

Shares llm with mlx-vlm.

sglang

sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

Choose sglang if…

• Apache License 2.0 suits your use better than MIT License
• you want the more widely starred option (38.4k)
• you specifically need attention or blackwell

Shares llm with mlx-vlm.

inference

xorbitsai/inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Choose inference if…

• Apache License 2.0 suits your use better than MIT License
• you want the more widely starred option (9.6k)
• you specifically need artificial-intelligence or deployment

Shares llm with mlx-vlm.

anything-llm

Mintplex-Labs/anything-llm

Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience

Choose anything-llm if…

• you would rather work in JavaScript than Python
• you want the more widely starred option (67.9k)
• you specifically need agent-computer or agent-harness

Shares llm, local-ai with mlx-vlm.