Templates / Grade LLM answers and route low-confidence results with Judgment API

Grade LLM answers and route low-confidence results with Judgment API

Unknown

by Greg Evseev ✓ · 0 views · created 2026-09-18 · Document Extraction, AI Summarization

Unknown. This template uses community nodes we can't verify statically. Uses community nodes that can't be verified statically (unverified community packages are off by default in 3.0). Static check, last run 2026-10-19.

What this workflow does

This workflow has 7 nodes and runs manually, when you click “Execute workflow”. Along the way it connects Judgment (community).

How it runs

Trigger: Manually, when you click “Execute workflow”.

  1. Sample Answers (Code): runs custom JavaScript code
  2. Grade Answers (Judgment): uses Judgment
  3. Verdict (Edit Fields (Set)): sets 6 fields: grade, answerId, value…
  4. Is the Grade Trusted? (If): checks a condition and branches into true / false

Services it uses

Judgment (community)

Before you upgrade to n8n 3.0

We can't fully verify this one: it relies on 1 community package, and n8n 3.0 turns unverified community packages off by default (N8N_UNVERIFIED_PACKAGES_ENABLED=false).

  • Check that n8n-nodes-judgment is verified or supports 3.0 (used in Grade Answers).

Nodes used (6)

From the author

Quick overview This workflow uses the Judgment API community node to grade multiple AI answers against a reference answer, calculates a trust verdict from probabilities and confidence, and routes each grade into “trusted” results versus items that need human…

Excerpt from Greg Evseev's description on n8n.io.

View the original on n8n.io → Check your own copy

Get the weekly “what broke” email

New templates, newly broken ones, and n8n release changes. One short email a week.

Form not loading? Subscribe here.