firecrawl
firecrawl/firecrawlThe context API to search, scrape, and interact with the web at scale. 🔥
Pushed today.GNU Affero General Public License v3.0TypeScriptDeveloper tools201.3k+2.4k
The Great Hall
Every work in the library, top first
Free to explore · curated by OneWave AI
1,407 apps, agents and plugins from GitHub, ranked on how actively they are maintained rather than on stars. Security review is in progress and every project shows exactly what has and has not been checked.
tech·an·dri·a/tɛkˈændriə/n.
Regular searchNames, topics, and keywords
AI searchDescribe a task, find the right tools
AI searches are sent to OpenAI.
Review is in progress. 1,407 projects are queued and none has been approved yet. Everything unreviewed is discovery metadata imported from GitHub — listed, not vetted.
Ranked by total stars at the last daily refresh. This is not stars earned during the selected period. Star counts in the AI category are known to be inflated by fake-star campaigns, so activity and license are shown first.
20 projects matching “web-scraping”
Scrapling
D4Vinci/Scrapling🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
Pushed yesterday.BSD 3-Clause "New" or "Revised" LicensePythonPlugins102.1k+4.6k
crawl4ai
unclecode/crawl4aiOfficial Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.
Pushed yesterday.Apache License 2.0PythonDeveloper tools87.3k
ai-website-cloner-template
JCodesMore/ai-website-cloner-templateClone any website with one command using AI coding agents
Pushed 3 days ago.MIT LicenseJavaScriptDesign systems39.1k+400
Scrapegraph-ai
ScrapeGraphAI/Scrapegraph-aiPython scraper based on AI
Pushed 1 months ago.MIT LicensePythonDeveloper tools32.7k+223
stagehand
browserbase/stagehandThe SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.
Pushed today.MIT LicenseTypeScriptDeveloper tools26.0k
moli
lexmount/moliBest headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust
Pushed today.Apache License 2.0RustAgents23.5k
Douyin_TikTok_Download_API
Evil0ctal/Douyin_TikTok_Download_API🚀 Self-hosted TikTok & Douyin scraper and no-watermark video downloader — async REST API, MCP server, CLI and web console for posts, profiles, comments and playlists. Self-healing identity pool, PostgreSQL archive, one docker compose up. 抖音、TikTok 数据采集与无水印视频下载 API，自托管，支持 MCP 调用与 Docker 一键部署。
Pushed 3 days ago.Apache License 2.0PythonPlugins21.4k+188
maxun
getmaxun/maxunTurn any website into a structured API. Extract, automate, search and monitor the web.
Pushed 4 days ago.GNU Affero General Public License v3.0TypeScriptDeveloper tools18.2k
SurfSense
MODSetter/SurfSenseAir-gapped, privacy-focused, open-source NotebookLM alternative. AI agent that researches, transforms, and edits your documents. Join our Discord: https://discord.gg/ejRNvftDp9
Pushed yesterday.Apache License 2.0PythonAgents16.9k
Skill_Seekers
yusufkaraaslan/Skill_SeekersConvert documentation websites, GitHub repositories, and PDFs into Claude AI skills with automatic conflict detection
Pushed 1 months ago.MIT LicensePythonPlugins15.3k+22
nanobrowser
nanobrowser/nanobrowserOpen-source AI agent for web automation. Use your real, logged-in browser to automate daily tasks.
Pushed 3 days ago.Apache License 2.0TypeScriptPlugins14.3k
camofox-browser
jo-inc/camofox-browserStealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.
Pushed 2 days ago.MIT LicenseJavaScriptAgents12.3k+91
API-mega-list
cporter202/API-mega-listThis GitHub repo is a powerhouse collection of APIs you can start using immediately to build everything from simple automations to full-scale applications. One of the most valuable API lists on GitHub—period. 💪
Pushed 24 days ago.No license detectedJavaScriptDeveloper tools8.4k+74
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
Last push 4 months ago.MIT LicensePythonApps8.1k+11
google-maps-scraper
gosom/google-maps-scraperscrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
Pushed 5 days ago.MIT LicenseGoApps8.0k+618
firecrawl-mcp-server
firecrawl/firecrawl-mcp-server🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.
Pushed today.MIT LicenseJavaScriptPlugins7.8k+45
skills
browser-act/skillsBrowser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session operation, isolated multi-account browsing.
Pushed 9 days ago.MIT LicensePythonSkills6.3k
wigolo
KnockOutEZ/wigoloThe go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.
Pushed today.OtherTypeScriptPlugins5.5k+12
design-extract
Manavarya09/design-extractExtract any website's complete design system with one command. DTCG tokens, semantic+primitive+composite, MCP server for Claude Code/Cursor/Windsurf, multi-platform emitters (iOS SwiftUI, Android Compose, Flutter, WordPress), Tailwind v4, Figma variables, shadcn/ui, CSS health audit, WCAG remediation, Chrome extension. MIT, Playwright, Node 20+.
Pushed 2 days ago.MIT LicenseHTMLDesign systems5.1k+317