The Tester's Guide to RAG Evaluation, Part 1: Foundations
What a RAG system is, where it fails, and how to set up evaluation runs you can trust
Series
The Tester's Guide to RAG Evaluation
A ground-up guide to evaluating retrieval-augmented generation (RAG) systems, written for testers. Learn what to measure, how to build the checks, and how to prove the checks themselves work.
Posts in this series
The Tester's Guide to RAG Evaluation, Part 2: Building the Evals
Build a test set, find how your system fails, write a check for each failure, and prove your AI judges can be trusted
The Tester's Guide to RAG Evaluation, Part 3: Proving Your Evals Work
Tell real changes from noise, break the system on purpose, gate releases on quality, and make every result reproducible
