The best llmfit alternatives

unsloth

unslothai/unsloth

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

Choose unsloth if…

• you would rather work in Python than Rust
• Apache License 2.0 suits your use better than MIT License
• you want the more widely starred option (79.0k)
• you specifically need agent or ai

Shares llm, unsloth with llmfit.

jan

janhq/jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

Choose jan if…

• you would rather work in TypeScript than Rust
• you specifically need chatgpt or gpt

Shares llm, localai with llmfit.

Soup

MakazhanAlpamys/Soup

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

Choose Soup if…

• you would rather work in Python than Rust
• Apache License 2.0 suits your use better than MIT License
• you prefer a smaller, narrower project to a large one
• you specifically need cli or consumer-gpu

Shares gguf, llm with llmfit.

meetily

Zackriya-Solutions/meetily

Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted, Open-source Ai meeting note taker for macOS & Windows. Understand How to write meeting minutes

Choose meetily if…

• you specifically need ai or ai-meeting-assistant

Shares llm with llmfit.

GenieX

qualcomm/GenieX

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

Choose GenieX if…

• BSD 3-Clause "New" or "Revised" License suits your use better than MIT License
• you prefer a smaller, narrower project to a large one
• you specifically need gemma4 or go

Shares llm with llmfit.

anything-llm

Mintplex-Labs/anything-llm

Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience

Choose anything-llm if…

• you would rather work in JavaScript than Rust
• you want the more widely starred option (67.9k)
• you specifically need agent-computer or agent-harness

Shares llm, localai with llmfit.

mlx-vlm

Blaizzy/mlx-vlm

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

Choose mlx-vlm if…

• you would rather work in Python than Rust
• you prefer a smaller, narrower project to a large one
• you specifically need apple-silicon or florence2

Shares llm, mlx with llmfit.

screenpipe

screenpipe/screenpipe

YC (S26) | Open Computer History | Record your screen continuously locally and provide context to your agents (Claude, Codex, Openclaw, Hermes, Runner...)

Choose screenpipe if…

• you specifically need agents or agi

Shares llm with llmfit.

shimmy

Michael-A-Kuykendall/shimmy

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

Choose shimmy if…

• Apache License 2.0 suits your use better than MIT License
• you prefer a smaller, narrower project to a large one
• you specifically need api-server or command-line-tool

Shares gguf with llmfit.

ollama

ollama/ollama

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

Choose ollama if…

• you would rather work in Go than Rust
• you want the more widely starred option (185.8k)
• you specifically need deepseek or gemma

Shares llm with llmfit.

open-webui

open-webui/open-webui

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

Choose open-webui if…

• you would rather work in Python than Rust
• you want the more widely starred option (157.6k)
• you specifically need ai or llm-ui

Shares llm with llmfit.

Langchain-Chatchat

chatchat-space/Langchain-Chatchat

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain

Choose Langchain-Chatchat if…

• you would rather work in Python than Rust
• Apache License 2.0 suits your use better than MIT License
• you specifically need chatbot or chatchat

Shares llm with llmfit.