The best AnyJev alternatives

inference

xorbitsai/inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Choose inference if…

• you want the more widely starred option (9.7k)
• you specifically need artificial-intelligence or deployment

Shares llm, transformers, vllm with AnyJev.

StartLux-Decision

StartLuxLabs/StartLux-Decision

Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.

Choose StartLux-Decision if…

• you specifically need agents or classification

Shares calibration, llm, vllm with AnyJev.

LlamaFactory

hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Choose LlamaFactory if…

• you want the more widely starred option (76.0k)
• you specifically need agent or ai

Shares llm, transformers with AnyJev.

peft

huggingface/peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Choose peft if…

• you want the more widely starred option (21.9k)
• you specifically need adapter or diffusion

Shares llm, transformers with AnyJev.

DocsGPT

arc53/DocsGPT

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

Choose DocsGPT if…

• MIT License suits your use better than Apache License 2.0
• you want the more widely starred option (18.4k)
• you specifically need agent-builder or agents

Shares llm, transformers with AnyJev.

laya-mlx

mizorewww/laya-mlx

Native MLX runtime for Laya typed decision models — 7–14 ms short decisions on M3 Max. No text generation, PyTorch, or cloud API.

Choose laya-mlx if…

• you want the more widely starred option (7.1k)
• you specifically need apple-silicon or inference

Shares decision-model, system-one with AnyJev.

Soup

MakazhanAlpamys/Soup

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

Choose Soup if…

• you want the more widely starred option (10.5k)
• you specifically need cli or consumer-gpu

Shares llm, transformers with AnyJev.

UltraRAG

OpenBMB/UltraRAG

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

Choose UltraRAG if…

• you want the more widely starred option (5.7k)
• you specifically need deepseek or demo

Shares llm, vllm with AnyJev.

transformers

huggingface/transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Choose transformers if…

• you want the more widely starred option (168.9k)
• you specifically need audio or deep-learning

Shares llm with AnyJev.

vllm

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Choose vllm if…

• you want the more widely starred option (96.8k)
• you specifically need amd or blackwell

Shares llm with AnyJev.

ray

ray-project/ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Choose ray if…

• you want the more widely starred option (44.3k)
• you specifically need data-science or deep-learning

Shares llm with AnyJev.

BentoML

bentoml/BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

Choose BentoML if…

• you want the more widely starred option (8.9k)
• you specifically need ai-inference or deep-learning

Shares llm with AnyJev.