The Great Hall

Every work in the library, top first

Free to explore · curated by OneWave AI

1,407 apps, agents and plugins from GitHub, ranked on how actively they are maintained rather than on stars. Security review is in progress and every project shows exactly what has and has not been checked.

tech·an·dri·a/tɛkˈændriə/n.

A library for the tools of a new age. After the Library of Alexandria, which copied every scroll that reached its harbour before it went on the shelf.

Regular searchNames, topics, and keywords

/

AI searchDescribe a task, find the right tools

AI searches are sent to OpenAI.

ActivitySort

License detectedReviewed only (0)

Review is in progress. 1,407 projects are queued and none has been approved yet. Everything unreviewed is discovery metadata imported from GitHub — listed, not vetted.

Request a review · What we check

Ranked by total stars at the last daily refresh. This is not stars earned during the selected period. Star counts in the AI category are known to be inflated by fake-star campaigns, so activity and license are shown first.

12 projects matching “crawler”

firecrawl

firecrawl/firecrawl

The context API to search, scrape, and interact with the web at scale. 🔥

Pushed today.GNU Affero General Public License v3.0TypeScriptDeveloper tools201.3k+2.4k

Scrapling

D4Vinci/Scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

Pushed yesterday.BSD 3-Clause "New" or "Revised" LicensePythonPlugins102.1k+4.6k

crawl4ai

unclecode/crawl4ai

Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.

Pushed yesterday.Apache License 2.0PythonDeveloper tools87.3k

EasySpider

NaiboWang/EasySpider

A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。

Pushed 6 days ago.GNU Affero General Public License v3.0JavaScriptUI / Frontend44.8k+21

Scrapegraph-ai

ScrapeGraphAI/Scrapegraph-ai

Python scraper based on AI

Pushed 1 months ago.MIT LicensePythonDeveloper tools32.7k+223

moli

lexmount/moli

Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust

Pushed today.Apache License 2.0RustAgents23.5k

Douyin_TikTok_Download_API

Evil0ctal/Douyin_TikTok_Download_API

🚀 Self-hosted TikTok & Douyin scraper and no-watermark video downloader — async REST API, MCP server, CLI and web console for posts, profiles, comments and playlists. Self-healing identity pool, PostgreSQL archive, one docker compose up. 抖音、TikTok 数据采集与无水印视频下载 API，自托管，支持 MCP 调用与 Docker 一键部署。

Pushed 4 days ago.Apache License 2.0PythonPlugins21.4k+188

maxun

getmaxun/maxun

Turn any website into a structured API. Extract, automate, search and monitor the web.

Pushed 4 days ago.GNU Affero General Public License v3.0TypeScriptDeveloper tools18.2k

apify-mcp-server

apify/apify-mcp-server

The Apify MCP server enables your AI agents to extract data from social media, search engines, maps, e-commerce sites, or any other website using thousands of ready-made scrapers, crawlers, and automation tools available on the Apify Store.

Pushed today.MIT LicenseTypeScriptPlugins16.0k+1.1k

autoscraper

alirezamika/autoscraperSlowing

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Last push 4 months ago.MIT LicensePythonApps8.1k+11

firecrawl-mcp-server

firecrawl/firecrawl-mcp-server

🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.

Pushed today.MIT LicenseJavaScriptPlugins7.8k+45

wigolo

KnockOutEZ/wigolo

The go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.

Pushed yesterday.OtherTypeScriptPlugins5.5k+12