Monitor AI quality drift with GPT-4o-mini evaluations and Slack alerts
Needs changesNeeds changes. This template uses 1 thing(s) that n8n 3.0 removes: AI Agent v1 (old agent modes). 1 breaking item(s) found. Static check, last run 2026-10-19.
What this workflow does
This AI workflow has 14 nodes and runs on Evaluation events (plus 1 other trigger). Along the way it connects Evaluation, OpenAI Chat Model, OpenAI and Slack.
How it runs
Trigger: On Evaluation events (plus 1 other trigger).
- Format eval input (Code): runs custom JavaScript code
- AI Agent: runs an AI agent, with model: OpenAI Chat Model
- Evaluating? (Evaluation): check if evaluating
- Score Response (OpenAI): uses OpenAI
- Evaluation: uses Evaluation
- Set Metrics (Evaluation): set metrics
- Check Threshold (Code): runs custom JavaScript code
- Below Threshold? (If): checks a condition and branches into true / false
- Slack: uses Slack
Services it uses
Before you upgrade to n8n 3.0
1 thing in this workflow is removed in n8n 3.0. Fix it before you upgrade:
- AI Agent v1 (old agent modes) in AI Agent (v1.9): replace with Latest AI Agent node (Tools Agent). For SQL Agent, use a Postgres or MySQL tool with a recent AI Agent.
Rather not rewrite it? Many of these flows can be rebuilt in Make (free plan).
| Removed in 3.0 | Replace with |
|---|---|
| AI Agent v1 (old agent modes) AI Agent (v1.9) | Latest AI Agent node (Tools Agent). For SQL Agent, use a Postgres or MySQL tool with a recent AI Agent. |
Nodes used (10)
- Schedule Trigger
n8n-nodes-base.scheduleTrigger - Evaluation Trigger
n8n-nodes-base.evaluationTrigger - Code
n8n-nodes-base.code - AI Agent
@n8n/n8n-nodes-langchain.agent - OpenAI Chat Model
@n8n/n8n-nodes-langchain.lmChatOpenAi - Evaluation
n8n-nodes-base.evaluation - No Operation, do nothing
n8n-nodes-base.noOp - OpenAI
@n8n/n8n-nodes-langchain.openAi - If
n8n-nodes-base.if - Slack
n8n-nodes-base.slack
From the author
Catch AI quality drift before your users do. This template ties scheduled evaluation, LLM-as-a-Judge scoring, and threshold-based alerts into a continuous monitoring loop that fires a Slack alert the moment a response drops below your quality bar. What you'll…