Sync website FAQs to Pinecone weekly with GPT-4o and OpenAI embeddings
Ready for 3.0What this workflow does
This AI workflow has 19 nodes and runs on a schedule (cron 30 18 * * 0). Along the way it connects Pinecone Vector Store and Embeddings OpenAI. It also calls api.openai.com over HTTP.
How it runs
Trigger: On a schedule (cron 30 18 * * 0).
- Get Sitemap Index (HTTP Request): calls an HTTP API
- Parse Sitemap Index XML (XML): converts between XML and JSON
- Extract Sub-Sitemap URLs (Code): runs custom JavaScript code
- Fetch Sub-Sitemap (HTTP Request): calls an HTTP API
- Parse Sub-Sitemap XML (XML): converts between XML and JSON
- Flatten & Filter All URLs (Code): runs custom JavaScript code
- Loop URLs in Batches (Loop Over Items (Split in Batches)): loops over the items in batches
- Scrape Page HTML (HTTP Request): calls an HTTP API
- Extract Text, Headings & Metadata (Code): runs custom JavaScript code
- Filter: keeps only the items that match a condition
…plus 6 more steps. See the full node list below.
Services it uses
HTTP calls to: api.openai.com
Before you upgrade to n8n 3.0
Nothing in this workflow is removed in n8n 3.0, so it should import and run after the upgrade.
Nodes used (10)
- Schedule Trigger
n8n-nodes-base.scheduleTrigger - HTTP Request
n8n-nodes-base.httpRequest - XML
n8n-nodes-base.xml - Code
n8n-nodes-base.code - Filter
n8n-nodes-base.filter - Loop Over Items (Split in Batches)
n8n-nodes-base.splitInBatches - Pinecone Vector Store
@n8n/n8n-nodes-langchain.vectorStorePinecone - Embeddings OpenAI
@n8n/n8n-nodes-langchain.embeddingsOpenAi - Default Data Loader
@n8n/n8n-nodes-langchain.documentDefaultDataLoader - Wait
n8n-nodes-base.wait
From the author
Quick overview This workflow runs weekly and crawls your website sitemap, scrapes each page, generates page-specific FAQs with OpenAI GPT-4o, embeds the Q&A content using OpenAI text-embedding-3-small, and upserts the vectors into a Pinecone index to keep a…