vllm
vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs
Pushed today.Apache License 2.0PythonDeveloper tools96.8k+444
The Stacks
Wing of Developer tools
Libraries, CLIs and infrastructure for building with AI.
Free to explore · curated by OneWave AI
215 developer tools projects in this wing of the Stacks. Review status is shown for every entry.
Regular searchNames, topics, and keywords
AI searchDescribe a task, find the right tools
AI searches are sent to OpenAI.
Review is in progress. 1,407 projects are queued and none has been approved yet. Everything unreviewed is discovery metadata imported from GitHub — listed, not vetted.
Ranked by total stars at the last daily refresh. This is not stars earned during the selected period. Star counts in the AI category are known to be inflated by fake-star campaigns, so activity and license are shown first.
6 projects matching “vllm”
litellm
BerriAI/litellmThe fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Pushed today.OtherPythonDeveloper tools63.2k+421
inference
xorbitsai/inferenceSwap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Pushed today.Apache License 2.0PythonDeveloper tools9.7k+10
UltraRAG
OpenBMB/UltraRAGA Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines
Pushed yesterday.Apache License 2.0PythonDeveloper tools5.7k
StartLux-Decision
StartLuxLabs/StartLux-DecisionOpen decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.
Pushed 21 days ago.Apache License 2.0PythonDeveloper tools1.7k
AnyJev
nokia-applied-research/AnyJevTurn any LLM into a Jev-style decision model: typed decisions, real probabilities, no training. (continue updating, welcome any issue and PR request)
Pushed 22 days ago.Apache License 2.0PythonDeveloper tools1.6k