keywords:web-scraping

straw-search

A crawler and search engine for websites

afkanozdemir

published version 1.0.3, 12 days ago0 dependents licensed under $MIT

210

mcp-web-content-pick

A tool for extracting structured content from web pages with customizable selectors and crawling options

kilicmu

published version 0.0.25, 3 months ago0 dependents licensed under $MIT

169

scraperis-mcp

Model Context Protocol (MCP) integration for Scraper.is - A web scraping tool for AI assistants

tuanvt

published version 0.1.22, 2 months ago0 dependents licensed under $MIT

204

octoscrape

Advanced web scraping framework built on Puppeteer designed to bypass rate limits with smart proxy rotation and browser fingerprinting protection

hemantdua

published version 1.0.1, 25 days ago0 dependents licensed under $ISC

146

crawlee-storage-extensions

Package for Apify/Crawlee that allows to store encrypted text values into the Storages

jetmar

published version 1.0.10, 10 months ago0 dependents licensed under $MIT

158

mult-fetch-mcp-server

一个基于 MCP 协议的网页内容获取工具，支持多种模式和格式，可与 Claude 等 AI 助手集成

martinguo

published version 1.0.0, 3 months ago0 dependents licensed under $MIT

122

@screenshotbuddy/node-curl-impersonate

A wrapper around cURL-impersonate, a binary which can be used to bypass TLS fingerprinting.

screenshotbuddy

published version 1.0.6, 21 days ago0 dependents licensed under $ISC

133

Google parser is a lightweight yet powerful HTTP client based Google Search Result scraper/parser with the purpose of sending browser-like requests out of the box. This is very essential in the web scraping industry to blend in with the website traffic.

nrjdalal

published version 2.3.0, 2 years ago0 dependents licensed under $MIT

141

firecrawl-simple-mcp

Model Context Protocol (MCP) server for Firecrawl Simple - provides web scraping and crawling capabilities to LLMs

sacode

published version 1.0.2, 2 months ago0 dependents licensed under $MIT

109

content-web-extractor

MCP server for extracting content from web pages

bmen25125

published version 1.0.2, a month ago0 dependents licensed under $MIT

134

node-curl-impersonate

A wrapper around cURL-impersonate, a binary which can be used to bypass TLS fingerprinting.

wearr

published version 1.5.4, 7 months ago0 dependents licensed under $ISC

130

puremd-mcp

Model Context Protocol (MCP) server for pure.md, the markdown delivery network for LLMs

jasonbarry

published version 1.0.3, 2 months ago0 dependents licensed under $MIT

116

@mseep/firecrawl-mcp

MCP server for Firecrawl web scraping integration. Supports both cloud and self-hosted instances. Features include web scraping, batch processing, structured data extraction, and LLM-powered content analysis.

skydeckai

published version 1.9.0, a month ago0 dependents licensed under $MIT

116

waterfall-fetch

utility for web scraping and fetching the html from a url or using puppeteer to interact with the page. getHtml uses various strategies in a 'waterfall' approch to get the content of the url, depending on priorities, such as stealth, speed, freshness.

andytyler

published version 1.0.11, 4 months ago0 dependents licensed under $MIT

123

ecommmcp2

This is a minimal MCP (Multi-Command Protocol) server implementation for product search, designed to work seamlessly with Claude's tool integration. It uses `FastMCP` to expose a simple tool that allows language models to query an API for product listings