Generate AI-Ready llms.txt Files from Screaming Frog Website Crawls

n8n template #3219

Summary

This workflow helps you generate an llms.txt file (if you're unfamiliar with it, check out this article) using a Screaming Frog export. Screaming Frog is a well-known website crawler. You can easily crawl a website. Then, export the "internalhtml" section in CSV format. How It Works: A form allows you to enter: The name of the website A short description The internalhtml.csv file from your Screaming Frog export Once the form is submitted, the workflow is triggered automatically, and you can download the llms.txt file directly from n8n. Downloading the File Since the last node in this workflow is "Convert to File", you will need to download the file directly from the n8n UI. However, you can

How to set it up

Open template #3219 on n8n.io and click Use for free, or copy the template JSON and paste it onto an empty canvas in n8n.
Create a credential under Credentials → Add credential: OpenAI Chat Model. Then open each of those nodes and pick the credential.
Check the model in the OpenAI Chat Model node. The template may point at a model your account can't use; swap it for one you have access to.
Click Execute workflow and step through each node's output to confirm the data looks right.
Toggle the workflow to Active so its trigger runs on its own.

Hand off to your agent

Prompt

Help me set up the n8n workflow "Generate AI-Ready llms.txt Files from Screaming Frog Website Crawls" (https://n8n.io/workflows/3219). It uses: OpenAI Chat Model, Text Classifier. Import the template JSON into my n8n instance, list every credential I need to create, and walk me through testing it.

Paste into Claude Code and it will do the rest.

Apps and nodes

OpenAI Chat Model Text Classifier

Questions

Yes. Dataki published it free on n8n.io as a verified creator, and it has 2,516 views. It runs on n8n Cloud or a self-hosted n8n instance.

OpenAI Chat Model. The other 1 node are built into n8n.

Similar workflows

NameViews