The best Soup alternatives

LlamaFactory

hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Choose LlamaFactory if…

• you want the more widely starred option (75.9k)
• you specifically need agent or ai

Shares fine-tuning, llm, lora, peft with Soup.

inference

xorbitsai/inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Choose inference if…

• you specifically need artificial-intelligence or deployment

Shares llm, machine-learning, pytorch, transformers with Soup.

datasets

huggingface/datasets

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

Choose datasets if…

• you want the more widely starred option (22.1k)
• you specifically need ai or artificial-intelligence

Shares huggingface, llm, machine-learning, pytorch with Soup.

metaflow

Netflix/metaflow

Build, Manage and Deploy AI/ML Systems

Choose metaflow if…

• you specifically need agents or ai

Shares llm, llmops, machine-learning, python with Soup.

transformers

huggingface/transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Choose transformers if…

• you want the more widely starred option (168.5k)
• you specifically need audio or deep-learning

Shares llm, machine-learning, python, pytorch with Soup.

ray

ray-project/ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Choose ray if…

• you want the more widely starred option (44.2k)
• you specifically need data-science or deep-learning

Shares llm, machine-learning, python, pytorch with Soup.

BentoML

bentoml/BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

Choose BentoML if…

• you specifically need ai-inference or deep-learning

Shares llm, llmops, machine-learning, python with Soup.

shimmy

Michael-A-Kuykendall/shimmy

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

Choose shimmy if…

• you would rather work in Rust than Python
• you specifically need api-server or command-line-tool

Shares gguf, huggingface, local-ai, machine-learning with Soup.

DeepCamera

SharpAI/DeepCamera

Open-Source AI Camera Skills Platform, AI NVR & CCTV Surveillance. Local VLM video analysis with Qwen, DeepSeek, SmolVLM, LLaVA, YOLO26. LLM-powered agentic security camera agent — watches, understands, remembers & guards your home via Telegram, Discord or Slack. Pluggable AI skills. OpenAI, Google, Anthropic or local AI. Runs on Mac Mini & AI PC.

Choose DeepCamera if…

• you would rather work in JavaScript than Python
• MIT License suits your use better than Apache License 2.0
• you prefer a smaller, narrower project to a large one
• you specifically need ai or ai-camera

Shares llm, local-ai, machine-learning, python with Soup.

unsloth

unslothai/unsloth

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

Choose unsloth if…

• you want the more widely starred option (79.0k)
• you specifically need agent or ai

Shares fine-tuning, llm, python with Soup.

pytorch-lightning

Lightning-AI/pytorch-lightning

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

Choose pytorch-lightning if…

• you want the more widely starred option (31.4k)
• you specifically need ai or artificial-intelligence

Shares machine-learning, python, pytorch with Soup.

screenpipe

screenpipe/screenpipe

YC (S26) | Open Computer History | Record your screen continuously locally and provide context to your agents (Claude, Codex, Openclaw, Hermes, Runner...)

Choose screenpipe if…

• you would rather work in Rust than Python
• you want the more widely starred option (22.2k)
• you specifically need agents or agi

Shares llm, local-ai, machine-learning with Soup.