Web scraper: extract website content from sitemaps to Google Drive
Ready for 3.0What this workflow does
This workflow has 12 nodes and runs manually, when you click “Execute workflow”. Along the way it connects Google Drive.
How it runs
Trigger: Manually, when you click “Execute workflow”.
- Set Sitemap URL (Edit Fields (Set)): sets 1 field: sitemap_url
- Get Sitemap (HTTP Request): calls an HTTP API
- Parse Sitemap XML (XML): converts between XML and JSON
- Split Sitemap URLs (Split Out): splits a list into separate items
- Limit: keeps the first few items
- Loop URLs (Loop Over Items (Split in Batches)): loops over the items in batches
- Scrape Page (HTTP Request): calls an HTTP API
- Extract Content (Code): runs custom JavaScript code
- Format Content (Code): runs custom JavaScript code
- Save to Google Drive (Google Drive): create from text
…plus 1 more step. See the full node list below.
Services it uses
Before you upgrade to n8n 3.0
Nothing in this workflow is removed in n8n 3.0, so it should import and run after the upgrade.
Nodes used (10)
- Manual Trigger
n8n-nodes-base.manualTrigger - Edit Fields (Set)
n8n-nodes-base.set - HTTP Request
n8n-nodes-base.httpRequest - XML
n8n-nodes-base.xml - Split Out
n8n-nodes-base.splitOut - Limit
n8n-nodes-base.limit - Loop Over Items (Split in Batches)
n8n-nodes-base.splitInBatches - Code
n8n-nodes-base.code - Google Drive
n8n-nodes-base.googleDrive - Wait
n8n-nodes-base.wait
From the author
A reliable, no-frills web scraper that extracts content directly from websites using their sitemaps. Perfect for content audits, migrations, and research when you need straightforward HTML extraction without external dependencies. How It Works This…