Autonomous AI crawler
n8n template #2315Summary
Use templateThis workflow with AI agent is designed to navigate through the page to retrieve specific type of information (in this example: social media profile links). The agent is equipped with 2 tools: text tool: to retrieve all the text from the page, URLs tool: to extract all possible links from the page. π‘ You can edit prompt and JSON schema connected to the agent in order to return other data then social media profile links. π This workflow uses Supabase as storage (input/output). Feel free to change it to any other database of your choice. π¬ See this workflow in action in my YouTube video. How it works? The workflow uses the input URL (website) as a starting point to retrieve the data (e.g. e
How to set it up
- Open template #2315 on n8n.io and click Use for free, or copy the template JSON and paste it onto an empty canvas in n8n.
- Create 2 credentials under Credentials β Add credential: Supabase, OpenAI Chat Model. Then open each of those nodes and pick the credential.
- Check the model in the AI Agent node. The template may point at a model your account can't use; swap it for one you have access to.
- Click Execute workflow and step through each node's output to confirm the data looks right.
- Toggle the workflow to Active so its trigger runs on its own.
Hand off to your agent
Prompt
Help me set up the n8n workflow "Autonomous AI crawler" (https://n8n.io/workflows/2315). It uses: HTTP Request, Supabase, HTML, AI Agent, OpenAI Chat Model, Structured Output Parser, Call n8n Workflow Tool. Import the template JSON into my n8n instance, list every credential I need to create, and walk me through testing it.
Paste into Claude Code and it will do the rest.
Apps and nodes
Questions
Yes. Oskar published it free on n8n.io as a verified creator, and it has 61K views. It runs on n8n Cloud or a self-hosted n8n instance.
Supabase, OpenAI Chat Model. The other 5 nodes are built into n8n.
Similar workflows
NameViews
- Automated Stock Analysis Reports with Technical & News Sentiment using GPT-4o37K
- Explore n8n Nodes in a Visual Reference Library5,197
- π Perplexity Research to HTML: AI-Powered Content Creation35K
- Content farming - : AI-powered blog automation for WordPress33K
- Actioning Your Meeting Next Steps using Transcripts and AI31K
- Allow your AI to call an API to fetch data21K
- Automate social media content with AI for Instagram, Facebook, LinkedIn & X16K
- β¨πMulti-AI Agent Chatbot for Postgres/Supabase DB and QuickCharts + Tool Router11K