Generate & Upload llms.txt for websites GEO optimization 🕸️🌐 with ScrapegraphAI
UnknownUnknown. This template uses community nodes we can't verify statically. Uses community nodes that can't be verified statically (unverified community packages are off by default in 3.0). Static check, last run 2026-10-19.
What this workflow does
This AI workflow has 12 nodes and runs manually, when you click “Execute workflow”. Along the way it connects OpenAI Chat Model and Scrapegraphai (community).
How it runs
Trigger: Manually, when you click “Execute workflow”.
- Set domain (Edit Fields (Set)): sets 1 field: your_domain
- Crawler (Scrapegraph Ai): work with smartcrawler
- Wait: waits 20 seconds
- Status crawler (Scrapegraph Ai): work with smartcrawler
- If: checks a condition and branches into true / false
- Internal Links (Edit Fields (Set)): sets 1 field: internal_links
- LLMS.txt Agent (AI Agent): runs an AI agent, with model: OpenAI Chat Model; 1 tool (Scraper)
- to Binary (Code): runs custom JavaScript code
- Upload to FTP (FTP): upload
Services it uses
Scraping pages by hand? Firecrawl is a simpler option (10% off for new users).
Before you upgrade to n8n 3.0
We can't fully verify this one: it relies on 2 community packages, and n8n 3.0 turns unverified community packages off by default (N8N_UNVERIFIED_PACKAGES_ENABLED=false).
- Check that n8n-nodes-scrapegraphai is verified or supports 3.0 (used in Status crawler, Crawler).
- Check that n8n-nodes-scrapegraphai is verified or supports 3.0 (used in Scraper).
Nodes used (10)
- Manual Trigger
n8n-nodes-base.manualTrigger - Wait
n8n-nodes-base.wait - Scrapegraph Ai
n8n-nodes-scrapegraphai.scrapegraphAi - Scrapegraph Ai Tool
n8n-nodes-scrapegraphai.scrapegraphAiTool - OpenAI Chat Model
@n8n/n8n-nodes-langchain.lmChatOpenAi - Code
n8n-nodes-base.code - AI Agent
@n8n/n8n-nodes-langchain.agent - Edit Fields (Set)
n8n-nodes-base.set - FTP
n8n-nodes-base.ftp - If
n8n-nodes-base.if
From the author
This workflow automatically generates an llms.txt file (following the llmstxt.org specification) for any given website. It uses ScrapegraphAI to crawl and scrape pages, an OpenAI chat model to process content, and finally uploads the generated file via FTP.…