AI agent that can scrape webpages
n8n template #2006Summary
Use templateβοΈπ οΈππ€π¦Ύ This template is a PoC of a ReAct AI Agent capable of fetching random pages (not only Wikipedia or Google search results). On the top part there's a manual chat node connected to a LangChain ReAct Agent. The agent has access to a workflow tool for getting page content. The page content extraction starts with converting query parameters into a JSON object. There are 3 pre-defined parameters: url β an address of the page to fetch method = full / simplified maxlimit - maximum length for the final page. For longer pages an error message is returned back to the agent Page content fetching is a multistep process: An HTTP Request mode tries to get the page content. If the page content w
How to set it up
- Open template #2006 on n8n.io and click Use for free, or copy the template JSON and paste it onto an empty canvas in n8n.
- Create a credential under Credentials β Add credential: OpenAI Chat Model. Then open each of those nodes and pick the credential.
- Check the model in the AI Agent node. The template may point at a model your account can't use; swap it for one you have access to.
- Click Execute workflow and step through each node's output to confirm the data looks right.
- Toggle the workflow to Active so its trigger runs on its own.
Hand off to your agent
Prompt
Help me set up the n8n workflow "AI agent that can scrape webpages" (https://n8n.io/workflows/2006). It uses: HTTP Request, AI Agent, OpenAI Chat Model, Call n8n Workflow Tool. Import the template JSON into my n8n instance, list every credential I need to create, and walk me through testing it.
Paste into Claude Code and it will do the rest.
Apps and nodes
Questions
Yes. Eduard published it free on n8n.io as a verified creator, and it has 212K views. It runs on n8n Cloud or a self-hosted n8n instance.
OpenAI Chat Model. The other 3 nodes are built into n8n.
Similar workflows
NameViews
- Build Your First AI Data Analyst Chatbot134K
- Create a Branded AI-Powered Website Chatbot88K
- Autonomous AI crawler61K
- Telegram AI bot with LangChain nodes59K
- β¨π©·Automated Social Media Content Publishing Factory + System Prompt Composition55K
- AI Youtube Trend Finder Based On Niche55K
- Build an MCP Server with Google Calendar and Custom Functions49K
- Scrape business leads from Google Maps using OpenAI and Google Sheets44K