The best lucebox alternatives

MTPLX

youssofal/MTPLX

3x faster speeds on MLX | Qwen 3.8 27B | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.

Choose MTPLX if…

• you would rather work in Python than C++
• you specifically need anthropic-compatible or apple-silicon

Shares local-ai, qwen, speculative-decoding with lucebox.

ODS

Osmantic/ODS

Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.

Choose ODS if…

• you would rather work in Python than C++
• you want the more widely starred option (7.8k)
• you specifically need ai-agents or amd

Shares llama-cpp, local-ai, strix-halo with lucebox.

vllm

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Choose vllm if…

• you would rather work in Python than C++
• you want the more widely starred option (96.2k)
• you specifically need amd or blackwell

Shares cuda, qwen with lucebox.

sglang

sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

Choose sglang if…

• you would rather work in Python than C++
• you want the more widely starred option (38.4k)
• you specifically need attention or blackwell

Shares cuda, qwen with lucebox.

inference

xorbitsai/inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Choose inference if…

• you would rather work in Python than C++
• you want the more widely starred option (9.6k)
• you specifically need artificial-intelligence or deployment

Shares llama-cpp, qwen with lucebox.

claude-code-local

nicedreamzapp/claude-code-local

Run Claude Code 100% on-device with local AI on Apple Silicon. MLX-native Anthropic-API server. 6 fighters incl. Muse-Glimmer 30B (now multimodal — reads images, abliterated), Gemma 4 31B, Qwen 3.5 122B (65 tok/s), DeepSeek V4 Flash (1M ctx). Private, offline, airgap-ready. Built for NDA / legal / healthcare workflows.

Choose claude-code-local if…

• you would rather work in Python than C++
• MIT License suits your use better than Apache License 2.0
• you specifically need abliterated or ai-privacy

Shares local-ai, qwen with lucebox.

lemonade

lemonade-sdk/lemonade

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

Choose lemonade if…

• you want something your agent can install directly rather than a library to wire up yourself
• you want the more widely starred option (6.1k)
• you specifically need ai or amd

Shares qwen, rocm with lucebox.

OGAM

off-grid-ai/OGAM

The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.

Choose OGAM if…

• you would rather work in TypeScript than C++
• MIT License suits your use better than Apache License 2.0
• you specifically need android or edge-ai

Shares llama-cpp, local-ai with lucebox.

LlamaFactory

hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Choose LlamaFactory if…

• you would rather work in Python than C++
• you want the more widely starred option (75.9k)
• you specifically need agent or ai

Shares qwen with lucebox.

turbo-fieldfare

drumih/turbo-fieldfare

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

Choose turbo-fieldfare if…

• you would rather work in Swift than C++
• you want the more widely starred option (7.1k)
• you specifically need apple-silicon or gemma

Shares local-ai with lucebox.

shimmy

Michael-A-Kuykendall/shimmy

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

Choose shimmy if…

• you would rather work in Rust than C++
• you want the more widely starred option (6.0k)
• you specifically need api-server or command-line-tool

Shares local-ai with lucebox.

llamafile

mozilla-ai/llamafile

Distribute and run LLMs with a single file.

Choose llamafile if…

• you want the more widely starred option (26.6k)
• you specifically need cross-platform or gguf

Shares llama-cpp, local-ai with lucebox.