WebScraping.AI

local MCP server

Installation

Terminal

claude mcp add webscraping-ai -e WEBSCRAPING_AI_API_KEY=... -e WEBSCRAPING_AI_DEFAULT_PROXY_TYPE=... -e WEBSCRAPING_AI_DEFAULT_JS_RENDERING=... -e WEBSCRAPING_AI_CONCURRENCY_LIMIT=... -- npx -y webscraping-ai-mcp

Run in your project folder. Add --scope user to use it everywhere.

Claude Desktop, Cursor & other clients

Add to claude_desktop_config.json or .cursor/mcp.json.

{
  "mcpServers": {
    "webscraping-ai": {
      "command": "npx",
      "args": [
        "-y",
        "webscraping-ai-mcp"
      ],
      "env": {
        "WEBSCRAPING_AI_API_KEY": "...",
        "WEBSCRAPING_AI_DEFAULT_PROXY_TYPE": "...",
        "WEBSCRAPING_AI_DEFAULT_JS_RENDERING": "...",
        "WEBSCRAPING_AI_CONCURRENCY_LIMIT": "..."
      }
    }
  }
}

Fill in the environment variables with your own credentials.

Summary

Web scraping tools with Chromium JS rendering, rotating proxies, and AI question answering.

Questions

WebScraping.AI is a local MCP server distributed as the npm package webscraping-ai-mcp.

Run: claude mcp add webscraping-ai -e WEBSCRAPING_AI_API_KEY=... -e WEBSCRAPING_AI_DEFAULT_PROXY_TYPE=... -e WEBSCRAPING_AI_DEFAULT_JS_RENDERING=... -e WEBSCRAPING_AI_CONCURRENCY_LIMIT=... -- npx -y webscraping-ai-mcp

Run: codex mcp add webscraping-ai --env WEBSCRAPING_AI_API_KEY=... --env WEBSCRAPING_AI_DEFAULT_PROXY_TYPE=... --env WEBSCRAPING_AI_DEFAULT_JS_RENDERING=... --env WEBSCRAPING_AI_CONCURRENCY_LIMIT=... -- npx -y webscraping-ai-mcp

Similar MCP servers

NameStars

PyScrappyio.github.mldsveda/pyscrappy260
Maggio.github.sitbon/magg144
SAP HANA CLIio.github.SAP-samples/hana-cli113
mcp-1c-platform-toolsio.github.yellow-hammer/mcp-1c-platform-tools38
google-researcherio.github.zoharbabin/google-researcher35
agent-toolio.github.knewstimek/agent-tool24
proxy-scraperio.github.maximilianfeix/proxy-scraper21
nodebenchio.github.HomenShum/nodebench14