The best peft alternatives

LlamaFactory

hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Choose LlamaFactory if…

• you want the more widely starred option (76.0k)
• you specifically need agent or ai

Shares fine-tuning, llm, lora, peft with peft.

DocsGPT

arc53/DocsGPT

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

Choose DocsGPT if…

• MIT License suits your use better than Apache License 2.0
• you specifically need agent-builder or agents

Shares llm, python, pytorch, transformers with peft.

Soup

MakazhanAlpamys/Soup

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

Choose Soup if…

• you prefer a smaller, narrower project to a large one
• you specifically need cli or consumer-gpu

Shares fine-tuning, llm, lora, peft with peft.

transformers

huggingface/transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Choose transformers if…

• you want the more widely starred option (168.9k)
• you specifically need audio or deep-learning

Shares llm, python, pytorch with peft.

ray

ray-project/ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Choose ray if…

• you want the more widely starred option (44.3k)
• you specifically need data-science or deep-learning

Shares llm, python, pytorch with peft.

inference

xorbitsai/inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Choose inference if…

• you prefer a smaller, narrower project to a large one
• you specifically need artificial-intelligence or deployment

Shares llm, pytorch, transformers with peft.

unsloth

unslothai/unsloth

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

Choose unsloth if…

• you want the more widely starred option (79.4k)
• you specifically need agent or ai

Shares fine-tuning, llm, python with peft.

stable-diffusion-webui

AUTOMATIC1111/stable-diffusion-webui

Stable Diffusion web UI

Choose stable-diffusion-webui if…

• GNU Affero General Public License v3.0 suits your use better than Apache License 2.0
• you want the more widely starred option (165.3k)
• you specifically need ai or ai-art

Shares diffusion, pytorch with peft.

ComfyUI

Comfy-Org/ComfyUI

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.

Choose ComfyUI if…

• GNU General Public License v3.0 suits your use better than Apache License 2.0
• you want the more widely starred option (146.5k)
• you specifically need ai or comfy

Shares python, pytorch with peft.

vllm

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Choose vllm if…

• you want the more widely starred option (96.8k)
• you specifically need amd or blackwell

Shares llm, pytorch with peft.

sglang

sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

Choose sglang if…

• you want the more widely starred option (38.8k)
• you specifically need attention or blackwell

Shares diffusion, llm with peft.

kornia

kornia/kornia

🐍 Geometric Computer Vision Library for Spatial AI

Choose kornia if…

• you specifically need artificial-intelligence or computer-vision

Shares python, pytorch with peft.