NOTES / PART 3 · RUNNING IN PRODUCTION
Knowing whether a system works, and why it failed when it doesn't.
THIS SECTION COVERS
Why evals matter, tracing, building eval sets, evaluators and LLM-as-judge, evaluating agent components and trajectories, experiments, benchmarks, and online evals.
Related: Safety and guardrails · RAG and retrieval