Scrapling
D4Vinci/Scrapling🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
Pushed yesterday.BSD 3-Clause "New" or "Revised" LicensePythonPlugins102.1k+4.6k
The Great Hall
Every work in the library, top first
Free to explore · curated by OneWave AI
1,407 apps, agents and plugins from GitHub, ranked on how actively they are maintained rather than on stars. Security review is in progress and every project shows exactly what has and has not been checked.
tech·an·dri·a/tɛkˈændriə/n.
Regular searchNames, topics, and keywords
AI searchDescribe a task, find the right tools
AI searches are sent to OpenAI.
Review is in progress. 1,407 projects are queued and none has been approved yet. Everything unreviewed is discovery metadata imported from GitHub — listed, not vetted.
Ranked by total stars at the last daily refresh. This is not stars earned during the selected period. Star counts in the AI category are known to be inflated by fake-star campaigns, so activity and license are shown first.
5 projects matching “crawling”
crawl4ai
unclecode/crawl4aiOfficial Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.
Pushed yesterday.Apache License 2.0PythonDeveloper tools87.3k
moli
lexmount/moliBest headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust
Pushed today.Apache License 2.0RustAgents23.5k
maxun
getmaxun/maxunTurn any website into a structured API. Extract, automate, search and monitor the web.
Pushed 4 days ago.GNU Affero General Public License v3.0TypeScriptDeveloper tools18.2k
exa-mcp-server
exa-labs/exa-mcp-serverExa MCP for web search and web crawling!
Pushed 7 days ago.MIT LicenseTypeScriptPlugins5.2k+17