LocalAI
mudler/LocalAILocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Pushed yesterday.MIT LicenseGoDeveloper tools50.2k+162
Free to explore · curated by OneWave AI
Discover open-source AI tools.
1,004 apps, agents and plugins from GitHub, ranked on how actively they are maintained rather than on stars. Security review is in progress and every project shows exactly what has and has not been checked.
tech·an·dri·a/tɛkˈændriə/n.
Regular searchNames, topics, and keywords
AI searchDescribe a task, find the right tools
AI searches are sent to OpenAI.
Review is in progress. 1,004 projects are queued and none has been approved yet. Everything unreviewed is discovery metadata imported from GitHub — listed, not vetted.
Ranked by total stars at the last daily refresh. This is not stars earned during the selected period. Star counts in the AI category are known to be inflated by fake-star campaigns, so activity and license are shown first.
16 projects matching “gpu”Page 1 of 1
airllm
lyogavin/airllmAirLLM 70B inference with single 4GB GPU
Pushed yesterday.Apache License 2.0Jupyter NotebookDeveloper tools41.7k+735
pytorch-lightning
Lightning-AI/pytorch-lightningPretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
Pushed 5 days ago.Apache License 2.0PythonApps31.4k+8
deeplearning4j
deeplearning4j/deeplearning4jSuite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learn...
Pushed 30 days ago.Apache License 2.0JavaDeveloper tools14.3k+2
Soup
MakazhanAlpamys/SoupFine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
Pushed yesterday.Apache License 2.0PythonApps10.1k+358
A python library built to empower developers to build applications and systems with self-contained Computer Vision capabilities
No push in 2.3 years ago.MIT LicensePythonDeveloper tools8.9k
GenieX
qualcomm/GenieXRun frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
Pushed yesterday.BSD 3-Clause "New" or "Revised" LicenseRustApps8.5k+25
turbo-fieldfare
drumih/turbo-fieldfareGemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
Pushed 8 days ago.Apache License 2.0SwiftDeveloper tools7.1k+58
Postgres with GPUs for ML/AI apps.
No push in over a year ago.MIT LicenseRustApps6.8k+1
lemonade
lemonade-sdk/lemonadeLemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
Pushed yesterday.Apache License 2.0C++Plugins6.1k+87
shimmy
Michael-A-Kuykendall/shimmy⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
Pushed 3 days ago.Apache License 2.0RustDeveloper tools6.0k+12
obs-backgroundremoval
royshil/obs-backgroundremovalAn OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.
Pushed 6 days ago.GNU General Public License v3.0C++Plugins4.7k+13
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.
No push in over a year ago.Apache License 2.0PythonDeveloper tools4.1k
OGAM
off-grid-ai/OGAMThe Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.
Pushed yesterday.MIT LicenseTypeScriptDeveloper tools3.3k+34
lucebox
Luce-Org/luceboxLLM speculative inference server for heterogeneous hardware & consumer GPUs
Pushed yesterday.Apache License 2.0C++Developer tools3.0k+13
foundry-local
microsoft/foundry-localNo description provided by the repository owner.
Pushed yesterday.OtherC++Apps2.6k+9