Discover and log project URLs in bulk with Firecrawl and Google Sheets
Ready for 3.0What this workflow does
This workflow has 14 nodes and runs manually, when you click “Execute workflow”. Along the way it connects Google Sheets. It also calls api.firecrawl.dev over HTTP.
How it runs
Trigger: Manually, when you click “Execute workflow”.
- Get Sites from Sheet (Google Sheets): uses Google Sheets
- Keep Unprocessed Sites (Filter): keeps only the items that match a condition
- Loop Over Sites (Loop Over Items (Split in Batches)): loops over the items in batches
- Prepare Site Data (Edit Fields (Set)): sets 2 fields: site_name, site_url
- Firecrawl: Map Site (HTTP Request): calls api.firecrawl.dev (POST)
- Filter Project URLs (Code): runs custom JavaScript code
- Log Mapping Error (Google Sheets): append
- Save Mapped URLs (Google Sheets): append or update
- Mark Site as Error (Google Sheets): append or update
- Mark Site as Done (Google Sheets): append or update
…plus 2 more steps. See the full node list below.
Services it uses
HTTP calls to: api.firecrawl.dev
Uses Firecrawl. New users get 10% off with our link.
Before you upgrade to n8n 3.0
Nothing in this workflow is removed in n8n 3.0, so it should import and run after the upgrade.
Nodes used (9)
- Manual Trigger
n8n-nodes-base.manualTrigger - Google Sheets
n8n-nodes-base.googleSheets - Filter
n8n-nodes-base.filter - Loop Over Items (Split in Batches)
n8n-nodes-base.splitInBatches - No Operation, do nothing
n8n-nodes-base.noOp - Edit Fields (Set)
n8n-nodes-base.set - HTTP Request
n8n-nodes-base.httpRequest - Code
n8n-nodes-base.code - Wait
n8n-nodes-base.wait
From the author
Quick Overview This workflow manually runs through a list of websites in Google Sheets, maps each site with the Firecrawl Map API to discover project/content URLs, and writes the filtered results back to Google Sheets while marking each source site as Done or…