Web site scraper for LLMs with Airtop
Ready for 3.0What this workflow does
This workflow has 18 nodes and runs when someone submits an n8n form (“Website scraper”) (plus 1 other trigger). Along the way it connects Google Sheets, Airtop and Google Docs.
How it runs
Trigger: When someone submits an n8n form (“Website scraper”) (plus 1 other trigger).
- Unify params (Edit Fields (Set)): sets 3 fields: Seed url, Links must contain, Depth
- Create Spreadsheet (Google Sheets): work with spreadsheet
- Info to upload into spreadsheet (Edit Fields (Set)): sets 2 fields: URL, Scraped
- Load info to spreadsheet (Google Sheets): append
- Scrape webpage (Airtop): scrape (extraction)
- Create Google Docs (Google Docs): uses Google Docs
- Write scraped content (Google Docs): update
- Should scrape more? (If): checks a condition and branches into true / false
- Read scraped webpages (Google Sheets): uses Google Sheets
- Retrieve links to scrape (Airtop): query (extraction)
…plus 6 more steps. See the full node list below.
Services it uses
Before you upgrade to n8n 3.0
Nothing in this workflow is removed in n8n 3.0, so it should import and run after the upgrade.
Nodes used (8)
- n8n Form Trigger
n8n-nodes-base.formTrigger - Edit Fields (Set)
n8n-nodes-base.set - Google Sheets
n8n-nodes-base.googleSheets - Airtop
n8n-nodes-base.airtop - Google Docs
n8n-nodes-base.googleDocs - If
n8n-nodes-base.if - Code
n8n-nodes-base.code - Execute Workflow Trigger
n8n-nodes-base.executeWorkflowTrigger
From the author
Recursive Web Scraping Use Case Automating web scraping with recursive depth is ideal for collecting content across multiple linked pages—perfect for content aggregation, lead generation, or research projects. What This Automation Does This automation reads a…