Extract & store recently added n8n community workflows with ScrapeGraphAI and Gemini
UnknownWhat this workflow does
This AI workflow has 19 nodes and runs on a schedule (every day) (plus 1 other trigger). Along the way it connects Google Gemini Chat Model, OpenAI Chat Model, Google Gemini and Google Sheets and 1 more.
How it runs
Trigger: On a schedule (every day) (plus 1 other trigger).
- Scrape main page (Scrapegraph Ai): work with markdownify
- Extract "Recently added" (Basic LLM Chain): sends a prompt to an LLM, with model: Google Gemini Chat Model; output parser: Structured Output Parser
- Set array (Edit Fields (Set)): sets 1 field: workflows
- Split Out: splits a list into separate items
- Loop Over Items (Loop Over Items (Split in Batches)): loops over the items in batches
- Scrape single Workflow (Scrapegraph Ai): work with markdownify
- Information Extractor: extracts structured fields from text with AI, with model: Google Gemini Chat Model
- Main content (Basic LLM Chain): sends a prompt to an LLM, with model: Google Gemini Chat Model
- Merge: merges the data from its input branches
- Set content (Edit Fields (Set)): sets 1 field: content
…plus 2 more steps. See the full node list below.
Services it uses
Scraping pages by hand? Firecrawl is a simpler option (10% off for new users).
Before you upgrade to n8n 3.0
We can't fully verify this one: it relies on 1 community package, and n8n 3.0 turns unverified community packages off by default (N8N_UNVERIFIED_PACKAGES_ENABLED=false).
- Check that n8n-nodes-scrapegraphai is verified or supports 3.0 (used in Scrape main page, Scrape single Workflow).
Nodes used (14)
- Manual Trigger
n8n-nodes-base.manualTrigger - Google Gemini Chat Model
@n8n/n8n-nodes-langchain.lmChatGoogleGemini - Structured Output Parser
@n8n/n8n-nodes-langchain.outputParserStructured - Loop Over Items (Split in Batches)
n8n-nodes-base.splitInBatches - OpenAI Chat Model
@n8n/n8n-nodes-langchain.lmChatOpenAi - Split Out
n8n-nodes-base.splitOut - Information Extractor
@n8n/n8n-nodes-langchain.informationExtractor - Merge
n8n-nodes-base.merge - Scrapegraph Ai
n8n-nodes-scrapegraphai.scrapegraphAi - Basic LLM Chain
@n8n/n8n-nodes-langchain.chainLlm - Edit Fields (Set)
n8n-nodes-base.set - Google Gemini
@n8n/n8n-nodes-langchain.googleGemini - Google Sheets
n8n-nodes-base.googleSheets - Schedule Trigger
n8n-nodes-base.scheduleTrigger
From the author
This is an exaple of advanced automated data extraction and enrichment pipeline with ScrapeGraphAI. Its primary purpose is to systematically scrape the n8n community workflows website, extract detailed information about recently added workflows, process that…