Scrape, structure, and store news data using Decodo, Gemini AI and Google Sheets
UnknownWhat this workflow does
This AI workflow has 13 nodes and runs on a schedule (every day). Along the way it connects Google Gemini Chat Model, Google Sheets and Decodo (community).
How it runs
Trigger: On a schedule (every day).
- Workflow Config (Edit Fields (Set)): sets 3 fields: forums, geo, sheet_id
- Split Forums (Split Out): splits a list into separate items
- Iterate Forums (Loop Over Items (Split in Batches)): loops over the items in batches
- Scrape Forum Data (Decodo): uses Decodo
- Extract Structured News Data (Basic LLM Chain): sends a prompt to an LLM, with model: Google Gemini Model; output parser: Parse JSON Output
- Split News Items (Split Out): splits a list into separate items
- Log Scrape Results (Google Sheets): append
- Generate Unique Key (Crypto): hashes or encrypts values
- Wait: waits 1 minutes
- Update Google Sheet (News) (Google Sheets): append or update
Services it uses
Before you upgrade to n8n 3.0
We can't fully verify this one: it relies on 1 community package, and n8n 3.0 turns unverified community packages off by default (N8N_UNVERIFIED_PACKAGES_ENABLED=false).
- Check that @decodo/n8n-nodes-decodo is verified or supports 3.0 (used in Scrape Forum Data).
Nodes used (11)
- Schedule Trigger
n8n-nodes-base.scheduleTrigger - Split Out
n8n-nodes-base.splitOut - Loop Over Items (Split in Batches)
n8n-nodes-base.splitInBatches - Google Gemini Chat Model
@n8n/n8n-nodes-langchain.lmChatGoogleGemini - Basic LLM Chain
@n8n/n8n-nodes-langchain.chainLlm - Structured Output Parser
@n8n/n8n-nodes-langchain.outputParserStructured - Crypto
n8n-nodes-base.crypto - Wait
n8n-nodes-base.wait - Google Sheets
n8n-nodes-base.googleSheets - Edit Fields (Set)
n8n-nodes-base.set - Decodo
@decodo/n8n-nodes-decodo.decodo
From the author
Sign up for Decodo HERE for Discount Automatically scrape, structure, and log forum or news content using Decodo and Google Gemini AI. This workflow extracts key details like titles, URLs, authors, and engagement stats, then appends them to a Google Sheet for…