
vllm
vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs
Pushed yesterday.Apache License 2.0PythonDeveloper tools96.2k+542
Free to explore · curated by OneWave AI
130 developer tools projects. Libraries, CLIs and infrastructure for building with AI.
Review is in progress. 1,004 projects are queued and none has been approved yet. Everything unreviewed is discovery metadata imported from GitHub — listed, not vetted.
Ranked by total stars at the last daily refresh. This is not stars earned during the selected period. Star counts in the AI category are known to be inflated by fake-star campaigns, so activity and license are shown first.

A high-throughput and memory-efficient inference and serving engine for LLMs

SGLang is a high-performance serving framework for large language models and multimodal models.