
vllm
vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs
Free to explore · curated by OneWave AI
1,004 apps, agents and plugins from GitHub, ranked on how actively they are maintained rather than on stars. Security review is in progress and every project shows exactly what has and has not been checked.
Review is in progress. 1,004 projects are queued and none has been approved yet. Everything unreviewed is discovery metadata imported from GitHub — listed, not vetted.
Ranked by total stars at the last daily refresh. This is not stars earned during the selected period. Star counts in the AI category are known to be inflated by fake-star campaigns, so activity and license are shown first.

A high-throughput and memory-efficient inference and serving engine for LLMs

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.

Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent with full horsepower. Maintained by Orchestra Research.

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Control panel for VLLM, Sglang, llama.cpp, exllamav3