litellm

BerriAI/litellm

Not yet reviewedDeveloper tools

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

View on GitHubCompare 12 alternatives How we review projects

Topics

ai-gateway anthropic azure-openai bedrock gateway langchain litellm llm llm-gateway llmops mcp-gateway openai openai-proxy rust rust-ai vertex-ai

Install

Not available through Techandria. A library has no Techandria install path. Running an arbitrary program is a different risk from adding a reviewed skill.

You can still get the code from the source and read it yourself:

git clone https://github.com/BerriAI/litellm

What we checked

Not yet reviewed

Discovery metadata only. Nothing has been scanned or approved, so this is a listing — not a recommendation to run the code.

Nothing has been scanned for this repository yet, so there is nothing to report. Listing here is not permission or a recommendation to run the code.

Maintain this project? Add the review badge to your README

The badge shows this project's current review state and updates on its own — including if the state changes. It links back to this page.

[![Techandria](https://techandria.com/badge/BerriAI/litellm.svg)](https://techandria.com/project/BerriAI/litellm)

README

No README could be fetched from GitHub for this repository.

gateway

Portkey-AI/gatewaySlowing

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

Last push 5 months ago.MIT LicenseTypeScriptPlugins13.3k+26

9router

decolua/9router

Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.

Pushed 7 days ago.MIT LicenseJavaScriptApps31.9k+376

bifrost

maximhq/bifrost

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

Pushed yesterday.Apache License 2.0GoPlugins9.3k+178

plano

katanemo/plano

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

Pushed 10 days ago.Apache License 2.0RustDeveloper tools7.1k+8