
vllm
vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs

sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
Topics
Not available through Techandria. A library has no Techandria install path. Running an arbitrary program is a different risk from adding a reviewed skill.
You can still get the code from the source and read it yourself:
git clone https://github.com/sgl-project/sglangDiscovery metadata only. Nothing has been scanned or approved, so this is a listing — not a recommendation to run the code.
The badge shows this project's current review state and updates on its own — including if the state changes. It links back to this page.
[](https://techandria.com/project/sgl-project/sglang)No README could be fetched from GitHub for this repository.

A high-throughput and memory-efficient inference and serving engine for LLMs

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)