The best anything-llm alternatives

ODS

Osmantic/ODS

Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.

Choose ODS if…

• you would rather work in Python than JavaScript
• Apache License 2.0 suits your use better than MIT License
• you prefer a smaller, narrower project to a large one
• you specifically need amd or comfyui

Shares ai-agents, llm, local-ai, rag with anything-llm.

agentic-rag-for-dummies

GiovanniPasq/agentic-rag-for-dummies

A modular Agentic RAG built with LangGraph — learn Retrieval-Augmented Generation Agents in minutes.

Choose agentic-rag-for-dummies if…

• you would rather work in Jupyter Notebook than JavaScript
• you prefer a smaller, narrower project to a large one
• you specifically need agent or agentic-rag

Shares agentic-ai, ai-agents, llm, rag with anything-llm.

GenAI_Agents

NirDiamant/GenAI_Agents

50+ tutorials and implementations for Generative AI Agent techniques, from basic conversational bots to complex multi-agent systems.

Choose GenAI_Agents if…

• you would rather work in Jupyter Notebook than JavaScript
• you prefer a smaller, narrower project to a large one
• you specifically need agents or ai

Shares agentic-ai, ai-agents, llm, rag with anything-llm.

screenpipe

screenpipe/screenpipe

YC (S26) | Open Computer History | Record your screen continuously locally and provide context to your agents (Claude, Codex, Openclaw, Hermes, Runner...)

Choose screenpipe if…

• you would rather work in Rust than JavaScript
• you prefer a smaller, narrower project to a large one
• you specifically need agents or agi

Shares hermes-agent, llm, local-ai, multimodal with anything-llm.

agents-towards-production

NirDiamant/agents-towards-production

End-to-end, code-first tutorials for building production-grade GenAI agents. From prototype to enterprise deployment.

Choose agents-towards-production if…

• you would rather work in Jupyter Notebook than JavaScript
• you prefer a smaller, narrower project to a large one
• you specifically need agent or agent-framework

Shares agentic-ai, ai-agents, llm, rag with anything-llm.

agency-agents-zh

jnMetaCode/agency-agents-zh

🎭 277 个即插即用的 AI 专家角色 — 支持 Claude Code/Cursor/Copilot 等 20 种工具，覆盖工程/设计/营销/金融等 20 个部门。含 64 个中国市场原创智能体（小红书/抖音/微信/飞书/钉钉/Qt 上位机/机械设计）。搭配编排器 agency-orchestrator，一句话即可让多位专家按 DAG 自动协作。

Choose agency-agents-zh if…

• you would rather work in Shell than JavaScript
• you prefer a smaller, narrower project to a large one
• you specifically need agency-orchestrator or agent-definitions

Shares ai-agents, hermes-agent, llm, no-code with anything-llm.

ragflow

infiniflow/ragflow

RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

Choose ragflow if…

• you would rather work in Go than JavaScript
• Apache License 2.0 suits your use better than MIT License
• you specifically need agentic-nagive or agentic-retrieval

Shares agent-harness, agentic-ai, ai-agents, rag with anything-llm.

PageIndex

VectifyAI/PageIndex

📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG

Choose PageIndex if…

• you would rather work in Python than JavaScript
• you specifically need agents or ai

Shares agentic-ai, ai-agents, llm, rag with anything-llm.

Vane

ItzCrazyKns/Vane

Vane is an AI-powered answering engine.

Choose Vane if…

• you would rather work in TypeScript than JavaScript
• you specifically need ai-search-engine or answering-engine

Shares ai-agents, llm, rag, self-hosted-ai with anything-llm.

haystack

deepset-ai/haystack

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

Choose haystack if…

• you would rather work in Python than JavaScript
• Apache License 2.0 suits your use better than MIT License
• you prefer a smaller, narrower project to a large one
• you specifically need agent-framework or agentic-rag

Shares agentic-ai, ai-agents, llm, rag with anything-llm.

yao

YaoApp/yao

✨ All your agents and workspaces in one place, on every device you own. Track tasks on a board, accessible from desktop, mobile, browser, or API. Self-hosted.

Choose yao if…

• you would rather work in Go than JavaScript
• you want something your agent can install directly rather than a library to wire up yourself
• you prefer a smaller, narrower project to a large one
• you specifically need agent-skills or agent-workspaces

Shares agent-harness, agent-orchestration, ai-agents, no-code with anything-llm.

skills

NVIDIA/skills

Agent Skills for NVIDIA products — install into Claude Code, Codex, and other coding agents to run Physical AI, robotics, simulation, CUDA, and RAG workflows end to end.

Choose skills if…

• you would rather work in Python than JavaScript
• Apache License 2.0 suits your use better than MIT License
• you want something your agent can install directly rather than a library to wire up yourself
• you prefer a smaller, narrower project to a large one

Shares agentic-ai, ai-agents, llm, rag with anything-llm.