Scrapling
D4Vinci/Scrapling🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
Pushed yesterday.BSD 3-Clause "New" or "Revised" LicensePythonPlugins93.8k+3.9k
Free to explore · curated by OneWave AI
Plugins
256 plugins projects. Extensions, MCP servers and integrations for existing tools.
Regular searchNames, topics, and keywords
AI searchDescribe a task, find the right tools
AI searches are sent to OpenAI.
Review is in progress. 1,004 projects are queued and none has been approved yet. Everything unreviewed is discovery metadata imported from GitHub — listed, not vetted.
Ranked by total stars at the last daily refresh. This is not stars earned during the selected period. Star counts in the AI category are known to be inflated by fake-star campaigns, so activity and license are shown first.
5 projects matching “crawler”Page 1 of 1
Douyin_TikTok_Download_API
Evil0ctal/Douyin_TikTok_Download_API🚀 Self-hosted TikTok & Douyin scraper and no-watermark video downloader — async REST API, MCP server, CLI and web console for posts, profiles, comments and playlists. Self-healing identity pool, PostgreSQL archive, one docker compose up. 抖音、TikTok 数据采集与无水印视频下载 API，自托管，支持 MCP 调用与 Docker 一键部署。
Pushed 2 days ago.Apache License 2.0PythonPlugins21.1k+186
apify-mcp-server
apify/apify-mcp-serverThe Apify MCP server enables your AI agents to extract data from social media, search engines, maps, e-commerce sites, or any other website using thousands of ready-made scrapers, crawlers, and automation tools available on the Apify Store.
Pushed yesterday.MIT LicenseTypeScriptPlugins14.5k+1.1k
firecrawl-mcp-server
firecrawl/firecrawl-mcp-server🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.
Pushed yesterday.MIT LicenseJavaScriptPlugins7.8k+58
wigolo
KnockOutEZ/wigoloThe go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.
Pushed yesterday.OtherTypeScriptPlugins5.5k+19