Fetch and cache web pages with Bright Data Web Unlocker and data tables
Ready for 3.0What this workflow does
This workflow has 15 nodes and runs when another workflow calls it. It uses only n8n's built-in nodes. It also calls api.brightdata.com over HTTP.
How it runs
Trigger: When another workflow calls it.
- Settings (Edit Fields (Set)): sets 3 fields: default_format, default_max_age_minutes, unlocker_zone
- Read The Request (Code): runs custom JavaScript code
- Look In The Cache (Data table): get
- Is It Still Fresh? (Code): runs custom JavaScript code
- Serve From Cache? (If): checks a condition and branches into true / false
- Fetch The Page (HTTP Request): calls api.brightdata.com (POST)
- Build The Answer (Code): runs custom JavaScript code
- Read What Came Back (Code): runs custom JavaScript code
- Keep It For Next Time (Data table): create or update
- Does It Need A Browser? (If): checks a condition and branches into true / false
…plus 2 more steps. See the full node list below.
HTTP calls to: api.brightdata.com
Before you upgrade to n8n 3.0
Nothing in this workflow is removed in n8n 3.0, so it should import and run after the upgrade.
Nodes used (7)
- Execute Workflow Trigger
n8n-nodes-base.executeWorkflowTrigger - Edit Fields (Set)
n8n-nodes-base.set - Code
n8n-nodes-base.code - Data table
n8n-nodes-base.dataTable - If
n8n-nodes-base.if - No Operation, do nothing
n8n-nodes-base.noOp - HTTP Request
n8n-nodes-base.httpRequest
From the author
Quick overview This sub-workflow is triggered by other n8n workflows to scrape a URL via Bright Data Web Unlocker, serving results from an n8n Data Table cache when fresh and returning a consistent response object with status, content, and error details. How…