✨ Vision-based AI agent scraper - with Google Sheets, ScrapingBee, and Gemini
Needs changesWhat this workflow does
This AI workflow has 14 nodes and runs manually, when you click “Execute workflow” (plus 1 other trigger). Along the way it connects Google Gemini Chat Model and Google Sheets. It also calls app.scrapingbee.com over HTTP.
How it runs
Trigger: Manually, when you click “Execute workflow” (plus 1 other trigger).
- Google Sheets: uses Google Sheets
- Set fields - from AI agent query (Edit Fields (Set)): sets 1 field: url
- Set fields (Edit Fields (Set)): sets 1 field: url
- ScrapingBee- Get page HTML (HTTP Request): calls app.scrapingbee.com
- ScrapingBee - Get page screenshot (HTTP Request): calls app.scrapingbee.com
- HTML to Markdown (Markdown): converts between Markdown and HTML
- Vision-based Scraping Agent (AI Agent): runs an AI agent, with model: Google Gemini Chat Model; 1 tool (HTML-based Scraping Tool); output parser: Structured Output Parser
- Split Out: splits a list into separate items
- Google Sheets: append
Services it uses
HTTP calls to: app.scrapingbee.com
Before you upgrade to n8n 3.0
1 thing in this workflow is removed in n8n 3.0. Fix it before you upgrade:
- AI Agent v1 (old agent modes) in Vision-based Scraping Agent (v1.7): replace with Latest AI Agent node (Tools Agent). For SQL Agent, use a Postgres or MySQL tool with a recent AI Agent.
Rather not rewrite it? Many of these flows can be rebuilt in Make (free plan).
| Removed in 3.0 | Replace with |
|---|---|
| AI Agent v1 (old agent modes) Vision-based Scraping Agent (v1.7) | Latest AI Agent node (Tools Agent). For SQL Agent, use a Postgres or MySQL tool with a recent AI Agent. |
Nodes used (11)
- Manual Trigger
n8n-nodes-base.manualTrigger - HTTP Request
n8n-nodes-base.httpRequest - Structured Output Parser
@n8n/n8n-nodes-langchain.outputParserStructured - Google Gemini Chat Model
@n8n/n8n-nodes-langchain.lmChatGoogleGemini - Split Out
n8n-nodes-base.splitOut - Google Sheets
n8n-nodes-base.googleSheets - Edit Fields (Set)
n8n-nodes-base.set - Call n8n Workflow Tool
@n8n/n8n-nodes-langchain.toolWorkflow - AI Agent
@n8n/n8n-nodes-langchain.agent - Execute Workflow Trigger
n8n-nodes-base.executeWorkflowTrigger - Markdown
n8n-nodes-base.markdown
From the author
Important Notes: Check Legal Regulations: This workflow involves scraping, so ensure you comply with the legal regulations in your country before getting started. Better safe than sorry! Workflow Description: 😮💨 Tired of struggling with XPath, CSS…