Drive browsers, scrape pages, and automate the web.
Drive a real browser, extract data from pages, and automate flows that never got an API. Includes headless browser control, scraping and crawling, form and session handling, and end-to-end web testing. Useful whenever the information you need exists only as a rendered page, or the task requires clicking through an interface a human would.
Ranked by GitHub stars. Search to find fast, or page through the full list.
General-purpose LinkedIn automation – fetch profiles, search people and companies, send messages, manage connections, create posts, and more. Use when the user wants to interact with LinkedIn.
Use when scraping JavaScript-heavy pages or SPAs, crawling multiple URLs concurrently, extracting structured data with reusable CSS/JSON schemas, or building automated web data pipelines. Wraps the Crawl4AI library (crwl CLI and Python SDK) with schema-generation patterns for LLM-free extraction. Triggers on crawl4ai, crwl, scrape JS-heavy site, scrape SPA, headless browser scrape, schema-based extraction, batch crawl, sitemap crawl, web data pipeline. SKIP when a static HTML page can be read with defuddle / fetch-web — those are faster cold-start and don't need a browser.