Generate AI-ready llms.txt files from Screaming Frog website crawls
Ready for 3.0Ready for 3.0. This template uses no nodes that n8n 3.0 removes. No removed nodes, versions or helpers found. Static check, last run 2026-10-19.
What this workflow does
This AI workflow has 12 nodes and runs when someone submits an n8n form (“llms.txt Generator - From Screaming Frog export”). Along the way it connects OpenAI Chat Model.
How it runs
Trigger: When someone submits an n8n form (“llms.txt Generator - From Screaming Frog export”).
- Extract data from Screaming Frog file (Extract from File): extracts data from a file (xls)
- Set useful fields (Edit Fields (Set)): sets 7 fields: url, title, description…
- Filter: keeps only the items that match a condition
- Text Classifier: classifies text into categories with AI, with model: OpenAI Chat Model
- Set Field - llms.txt Row (Edit Fields (Set)): sets 1 field: llmTxtRow
- Summarize: summarizes / groups the items
- Set Fields - llms.txt Content (Edit Fields (Set)): sets 1 field: llmsTxtFile
- Generate llms.txt file (Convert to File): converts data to a file (to text)
Services it uses
Before you upgrade to n8n 3.0
Nothing in this workflow is removed in n8n 3.0, so it should import and run after the upgrade.
Nodes used (9)
- Edit Fields (Set)
n8n-nodes-base.set - Text Classifier
@n8n/n8n-nodes-langchain.textClassifier - OpenAI Chat Model
@n8n/n8n-nodes-langchain.lmChatOpenAi - No Operation, do nothing
n8n-nodes-base.noOp - Filter
n8n-nodes-base.filter - Summarize
n8n-nodes-base.summarize - n8n Form Trigger
n8n-nodes-base.formTrigger - Extract from File
n8n-nodes-base.extractFromFile - Convert to File
n8n-nodes-base.convertToFile
From the author
This workflow helps you generate an llms.txt file (if you're unfamiliar with it, check out this article) using a Screaming Frog export. Screaming Frog is a well-known website crawler. You can easily crawl a website. Then, export the "internalhtml" section in…