Grade LLM answers and route low-confidence results with Judgment API
UnknownWhat this workflow does
This workflow has 7 nodes and runs manually, when you click “Execute workflow”. Along the way it connects Judgment (community).
How it runs
Trigger: Manually, when you click “Execute workflow”.
- Sample Answers (Code): runs custom JavaScript code
- Grade Answers (Judgment): uses Judgment
- Verdict (Edit Fields (Set)): sets 6 fields: grade, answerId, value…
- Is the Grade Trusted? (If): checks a condition and branches into true / false
Services it uses
Before you upgrade to n8n 3.0
We can't fully verify this one: it relies on 1 community package, and n8n 3.0 turns unverified community packages off by default (N8N_UNVERIFIED_PACKAGES_ENABLED=false).
- Check that n8n-nodes-judgment is verified or supports 3.0 (used in Grade Answers).
Nodes used (6)
- Manual Trigger
n8n-nodes-base.manualTrigger - Code
n8n-nodes-base.code - Judgment
n8n-nodes-judgment.judgment - Edit Fields (Set)
n8n-nodes-base.set - If
n8n-nodes-base.if - No Operation, do nothing
n8n-nodes-base.noOp
From the author
Quick overview This workflow uses the Judgment API community node to grade multiple AI answers against a reference answer, calculates a trust verdict from probabilities and confidence, and routes each grade into “trusted” results versus items that need human…