Free to explore · curated by OneWave AI

Discover open-source AI tools.

1,004 apps, agents and plugins from GitHub, ranked on how actively they are maintained rather than on stars. Security review is in progress and every project shows exactly what has and has not been checked.

tech·an·dri·a/tɛkˈændriə/n.

A library for the tools of a new age. After the Library of Alexandria, which copied every scroll that reached its harbour before it went on the shelf.

Regular searchNames, topics, and keywords

/

AI searchDescribe a task, find the right tools

AI searches are sent to OpenAI.

ActivitySort

License detectedReviewed only (0)

Review is in progress. 1,004 projects are queued and none has been approved yet. Everything unreviewed is discovery metadata imported from GitHub — listed, not vetted.

Request a review · What we check

Ranked by total stars at the last daily refresh. This is not stars earned during the selected period. Star counts in the AI category are known to be inflated by fake-star campaigns, so activity and license are shown first.

9 projects matching “llm-inference”Page 1 of 1

ray

ray-project/ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Pushed yesterday.Apache License 2.0PythonDeveloper tools44.2k+62

gitleaks

gitleaks/gitleaks

Find secrets with Gitleaks 🔑

Pushed 7 days ago.MIT LicenseGoApps30.6k+246

litgpt

Lightning-AI/litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Pushed 3 days ago.Apache License 2.0PythonApps13.7k+11

openvino

openvinotoolkit/openvino

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

Pushed yesterday.Apache License 2.0C++Developer tools11.1k+27

BentoML

bentoml/BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

Pushed 2 days ago.Apache License 2.0PythonDeveloper tools8.9k+12

turbo-fieldfare

drumih/turbo-fieldfare

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

Pushed 9 days ago.Apache License 2.0SwiftDeveloper tools7.1k+58

plano

katanemo/plano

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

Pushed 11 days ago.Apache License 2.0RustDeveloper tools7.1k+8

lemonade

lemonade-sdk/lemonade

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

Pushed yesterday.Apache License 2.0C++Plugins6.1k+87

shimmy

Michael-A-Kuykendall/shimmy

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

Pushed 3 days ago.Apache License 2.0RustDeveloper tools6.0k+12