Index legal documents for hybrid search with Qdrant, OpenAI & BM25
UnknownWhat this workflow does
This workflow has 30 nodes and runs manually, when you click “Execute workflow”. Along the way it connects Qdrant (community). It also calls datasets-server.huggingface.co and api.openai.com over HTTP.
How it runs
Trigger: Manually, when you click “Execute workflow”.
- Get Dataset Splits (HTTP Request): calls datasets-server.huggingface.co
- Check Collection Exists (Qdrant): collection exists
- Split Them All Out (Split Out): splits a list into separate items
- If: checks a condition and branches into true / false
- Get Dataset Rows (Pagination) (HTTP Request): calls an HTTP API
- Create Collection (Qdrant): create collection
- Divide Per Row (Split Out): splits a list into separate items
- Restructure for Deduplicating (Edit Fields (Set)): sets 2 fields: id_qa, text
- Deduplicate Texts (Summarize): summarizes / groups the items
- Restructure for Batching (Edit Fields (Set)): sets 3 fields: idx, text, ids_qa
…plus 19 more steps. See the full node list below.
Services it uses
HTTP calls to: datasets-server.huggingface.co, api.openai.com
Before you upgrade to n8n 3.0
We can't fully verify this one: it relies on 1 community package, and n8n 3.0 turns unverified community packages off by default (N8N_UNVERIFIED_PACKAGES_ENABLED=false).
- Check that n8n-nodes-qdrant is verified or supports 3.0 (used in Create Collection, Check Collection Exists, Upsert Points).
Nodes used (11)
- Qdrant
n8n-nodes-qdrant.qdrant - If
n8n-nodes-base.if - Manual Trigger
n8n-nodes-base.manualTrigger - Split Out
n8n-nodes-base.splitOut - HTTP Request
n8n-nodes-base.httpRequest - Loop Over Items (Split in Batches)
n8n-nodes-base.splitInBatches - Aggregate
n8n-nodes-base.aggregate - Limit
n8n-nodes-base.limit - Merge
n8n-nodes-base.merge - Summarize
n8n-nodes-base.summarize - Edit Fields (Set)
n8n-nodes-base.set
From the author
Index Legal Dataset to Qdrant for Hybrid Retrieval This pipeline is the first part of "Hybrid Search with Qdrant & n8n, Legal AI". The second part, "Hybrid Search with Qdrant & n8n, Legal AI: Retrieval", covers retrieval and simple evaluation. Overview This…