ray
ray-project/rayRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Pushed today.Apache License 2.0PythonDeveloper tools44.3k+64
The Great Hall
Every work in the library, top first
Free to explore · curated by OneWave AI
1,407 apps, agents and plugins from GitHub, ranked on how actively they are maintained rather than on stars. Security review is in progress and every project shows exactly what has and has not been checked.
tech·an·dri·a/tɛkˈændriə/n.
Regular searchNames, topics, and keywords
AI searchDescribe a task, find the right tools
AI searches are sent to OpenAI.
Review is in progress. 1,407 projects are queued and none has been approved yet. Everything unreviewed is discovery metadata imported from GitHub — listed, not vetted.
Ranked by total stars at the last daily refresh. This is not stars earned during the selected period. Star counts in the AI category are known to be inflated by fake-star campaigns, so activity and license are shown first.
10 projects matching “llm-inference”
litgpt
Lightning-AI/litgpt20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Pushed 2 days ago.Apache License 2.0PythonApps13.7k
openvino
openvinotoolkit/openvinoOpenVINO™ is an open source toolkit for optimizing and deploying AI inference
Pushed today.Apache License 2.0C++Developer tools11.2k+37
BentoML
bentoml/BentoMLThe easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
Pushed 10 days ago.Apache License 2.0PythonDeveloper tools8.9k+5
turbo-fieldfare
drumih/turbo-fieldfareGemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
Pushed 3 days ago.Apache License 2.0SwiftDeveloper tools7.3k+94
plano
katanemo/planoPlano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
Pushed 19 days ago.Apache License 2.0RustDeveloper tools7.1k+7
lemonade
lemonade-sdk/lemonadeLemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
Pushed today.Apache License 2.0C++Plugins6.2k+80
shimmy
Michael-A-Kuykendall/shimmy⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
Pushed today.Apache License 2.0RustDeveloper tools6.0k+4
project-maya
mw00/project-mayaRun GLM-5.3 (744B), GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one dashboard, OpenAI- and Anthropic-compatible API.
Pushed yesterday.MIT LicenseC++Apps2.8k