Templates / Split test different agent prompts with Supabase and OpenAI

Split test different agent prompts with Supabase and OpenAI

Needs changes

by Chris Carr ✓ · 8,046 views · created 2025-02-24 · Engineering, AI Chatbot

Needs changes. This template uses 1 thing(s) that n8n 3.0 removes: AI Agent v1 (old agent modes). 1 breaking item(s) found. Static check, last run 2026-10-19.

What this workflow does

This AI workflow has 9 nodes and runs when a chat message arrives. Along the way it connects Supabase, OpenAI Chat Model and Postgres Chat Memory.

How it runs

Trigger: When a chat message arrives.

  1. Define Path Values (Edit Fields (Set)): sets 2 fields: baseline_value, alternative_value
  2. Check If Session Exists (Supabase): get
  3. If: checks a condition and branches into true / false
  4. Get Correct Prompt (Edit Fields (Set)): sets 1 field: prompt
  5. Assign Path To Session (Supabase): uses Supabase
  6. AI Agent: runs an AI agent, with model: OpenAI Chat Model; memory: Postgres Chat Memory

Services it uses

SupabaseOpenAI Chat ModelPostgres Chat Memory

Before you upgrade to n8n 3.0

1 thing in this workflow is removed in n8n 3.0. Fix it before you upgrade:

  • AI Agent v1 (old agent modes) in AI Agent (v1.7): replace with Latest AI Agent node (Tools Agent). For SQL Agent, use a Postgres or MySQL tool with a recent AI Agent.

Rather not rewrite it? Many of these flows can be rebuilt in Make (free plan).

Removed in 3.0Replace with
AI Agent v1 (old agent modes)
AI Agent (v1.7)
Latest AI Agent node (Tools Agent). For SQL Agent, use a Postgres or MySQL tool with a recent AI Agent.

Nodes used (7)

From the author

Split Test Agent Prompts with Supabase and OpenAI Use Case Oftentimes, it's useful to test different settings for a large language model in production against various metrics. Split testing is a good method for doing this. What it Does This workflow randomly…

Excerpt from Chris Carr's description on n8n.io.

View the original on n8n.io → Check your own copy

Get the weekly “what broke” email

New templates, newly broken ones, and n8n release changes. One short email a week.

Form not loading? Subscribe here.