Autonomous AI crawler
n8n template #2315Summary
Use templateThis workflow with AI agent is designed to navigate through the page to retrieve specific type of information (in this example: social media profile links). The agent is equipped with 2 tools: text tool: to retrieve all the text from the page, URLs tool: to extract all possible links from the page. 💡 You can edit prompt and JSON schema connected to the agent in order to return other data then social media profile links. 👉 This workflow uses Supabase as storage (input/output). Feel free to change it to any other database of your choice. 🎬 See this workflow in action in my YouTube video. How it works? The workflow uses the input URL (website) as a starting point to retrieve the data (e.g. e
Hand off to your agent
Prompt
Help me set up the n8n workflow "Autonomous AI crawler" (https://n8n.io/workflows/2315). It uses: HTTP Request, Supabase, HTML, AI Agent, OpenAI Chat Model, Structured Output Parser, Call n8n Workflow Tool. Import the template JSON into my n8n instance, list every credential I need to create, and walk me through testing it.
Paste into Claude Code and it will do the rest.
Apps and nodes
Similar workflows
NameViews
- Automated Stock Analysis Reports with Technical & News Sentiment using GPT-4o37K
- Explore n8n Nodes in a Visual Reference Library5,197
- Multi-language Telegram RAG chatbot with supervisor AI & automated Google Drive pipeline552
- 🔍 Perplexity Research to HTML: AI-Powered Content Creation35K
- Content farming - : AI-powered blog automation for WordPress33K
- Actioning Your Meeting Next Steps using Transcripts and AI31K
- Allow your AI to call an API to fetch data21K
- Automate social media content with AI for Instagram, Facebook, LinkedIn & X16K