The best browser automation and scraping tools in 2026

Last updated: Sep 11, 2026
Projects considered: 29
Commits reviewed: 0 of 29

Headless browsers, crawlers and structured-extraction pipelines. Check each project’s terms and the target site’s rules before you run anything.

Mostly written in JavaScript, Python, TypeScript, HTML and Go.

How this list is ranked. By total GitHub stars at the last daily refresh — a popularity signal, not a measure of quality, fit or safety. Star counts in the AI category are known to be inflated by fake-star campaigns, so each row leads with push activity and license instead. No commit in this collection has completed security review yet, so treat every entry as unreviewed discovery metadata.

1
camofox-browser
jo-inc/camofox-browser
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.
Pushed 2 days ago.MIT LicenseJavaScriptAgents12.1k+134
2
browser-use
browser-use/browser-use
Agents that use the browser.
Pushed 2 days ago.MIT LicensePythonAgents119.9k+662
3
browser-harness
browser-use/browser-harness
Browser Harness | Self-healing harness that enables LLMs to complete any task.
Pushed yesterday.MIT LicensePythonApps18.8k+189
4
Scrapling
D4Vinci/Scrapling
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
Pushed yesterday.BSD 3-Clause "New" or "Revised" LicensePythonPlugins93.8k+3.9k
5
EasySpider
NaiboWang/EasySpider
A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
Pushed yesterday.GNU Affero General Public License v3.0JavaScriptUI / Frontend44.8k+29
6
ego-lite
citrolabs/ego-lite
The fastest browser for AI agents to run browser automation, built for sharing your logged-in browser state with your AI agents, like Codex or Claude Code, without disturbing you. Zero cost, zero config.
Pushed yesterday.MIT LicenseJavaScriptAgents21.4k+1.4k
7
firecrawl-mcp-server
firecrawl/firecrawl-mcp-server
🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.
Pushed yesterday.MIT LicenseJavaScriptPlugins7.8k+58
8
firecrawl
firecrawl/firecrawl
The context API to search, scrape, and interact with the web at scale. 🔥
Pushed yesterday.GNU Affero General Public License v3.0TypeScriptDeveloper tools198.2k+2.3k
9
hyperframes
heygen-com/hyperframes
Write HTML. Render video. Built for agents.
Pushed yesterday.Apache License 2.0TypeScriptAgents78.1k+4.6k
10
chrome-devtools-mcp
ChromeDevTools/chrome-devtools-mcp
Chrome DevTools for coding agents
Pushed yesterday.Apache License 2.0TypeScriptPlugins54.7k+473
11
playwright-mcp
microsoft/playwright-mcp
Playwright MCP server
Pushed 2 days ago.Apache License 2.0TypeScriptDeveloper tools39.1k+429
12
ai-website-cloner-template
JCodesMore/ai-website-cloner-template
Clone any website with one command using AI coding agents
Pushed 15 days ago.MIT LicenseJavaScriptDesign systems38.5k+1.0k
13
Scrapegraph-ai
ScrapeGraphAI/Scrapegraph-ai
Python scraper based on AI
Pushed 29 days ago.MIT LicensePythonDeveloper tools32.5k+192
14
OpenCLI
jackwener/OpenCLI
Make Any Website into CLI & Use your logged-in browser by AI agent.
Pushed 9 days ago.Apache License 2.0JavaScriptDeveloper tools30.8k+148
15
page-agent
alibaba/page-agent
JavaScript in-page GUI agent. Control web interfaces with natural language.
Pushed yesterday.MIT LicenseTypeScriptApps29.6k+48
16
Douyin_TikTok_Download_API
Evil0ctal/Douyin_TikTok_Download_API
🚀 Self-hosted TikTok & Douyin scraper and no-watermark video downloader — async REST API, MCP server, CLI and web console for posts, profiles, comments and playlists. Self-healing identity pool, PostgreSQL archive, one docker compose up. 抖音、TikTok 数据采集与无水印视频下载 API，自托管，支持 MCP 调用与 Docker 一键部署。
Pushed 2 days ago.Apache License 2.0PythonPlugins21.1k+186
17
web-ui
browser-use/web-ui
🖥️ Run AI Agent in your browser.
Pushed 1 months ago.MIT LicensePythonAgents16.6k+19
18
docker-android
budtmo/docker-android
Android in docker solution with noVNC supported, video recording and mcp server
Pushed 2 days ago.OtherPythonPlugins16.1k+36
19
Skill_Seekers
yusufkaraaslan/Skill_Seekers
Convert documentation websites, GitHub repositories, and PDFs into Claude AI skills with automatic conflict detection
Pushed 1 months ago.MIT LicensePythonPlugins15.3k+37
20
GenericAgent
lsdefine/GenericAgent
Self-evolving agent: grows skill tree from 3.3K-line seed, achieving full system control with 6x less token consumption
Pushed yesterday.MIT LicensePythonSkills14.4k+32
21
API-mega-list
cporter202/API-mega-list
This GitHub repo is a powerhouse collection of APIs you can start using immediately to build everything from simple automations to full-scale applications. One of the most valuable API lists on GitHub—period. 💪
Pushed 15 days ago.No license detectedJavaScriptDeveloper tools8.3k+59
22
autoscraper
alirezamika/autoscraperSlowing
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
Last push 3 months ago.MIT LicensePythonApps8.1k+6
23
guizang-social-card-skill
op7418/guizang-social-card-skill
🪧 Claude Code / Codex skill — generate Xiaohongshu carousels & WeChat 21:9+1:1 cover pairs. Editorial × Swiss visual systems, 28 layouts, 10 themes, single-file HTML → PNG. 小红书图文 + 公众号封面对
Pushed 5 days ago.GNU Affero General Public License v3.0HTMLSkills7.9k+148
24
mcp
BrowserMCP/mcp
Browser MCP is a Model Context Provider (MCP) server that allows AI applications to control your browser
Pushed yesterday.Apache License 2.0TypeScriptPlugins7.3k+57
25
google-maps-scraper
gosom/google-maps-scraper
scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
Pushed 14 days ago.MIT LicenseGoApps7.2k+312
26
llm-scraper
mishushakov/llm-scraper
Turn any webpage into structured data using LLMs
Pushed 9 days ago.MIT LicenseTypeScriptApps7.0k
27
wigolo
KnockOutEZ/wigolo
The go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.
Pushed yesterday.OtherTypeScriptPlugins5.5k+19
28
design-extract
Manavarya09/design-extract
Extract any website's complete design system with one command. DTCG tokens, semantic+primitive+composite, MCP server for Claude Code/Cursor/Windsurf, multi-platform emitters (iOS SwiftUI, Android Compose, Flutter, WordPress), Tailwind v4, Figma variables, shadcn/ui, CSS health audit, WCAG remediation, Chrome extension. MIT, Playwright, Node 20+.
Pushed yesterday.MIT LicenseHTMLDesign systems4.5k+95
29
dembrandt
dembrandt/dembrandt
Extract any website’s design system into tokens in seconds: logo, colors, typography, borders & more. One command.
Pushed 3 days ago.MIT LicenseTypeScriptDesign systems3.9k+64