Encyclopedia Evalica / Tracing and instrumentation / Instrumentation

Instrumentation
/ih.nstruh.meh'ntay.shuhn/Adding code/hooks to capture traces, metadata, and events throughout the system. Good instrumentation makes failures reproducible and measurable instead of anecdotal. (noun)
“Instrumentation around retrieval made it clear the wrong index was queried.”
Related Tracing and instrumentation terms
From the docs
Get started with Evals
Braintrust is the observability platform for agents in production. By actively applying intelligence to agent traces and automatically surfacing critical patterns, Braintrust helps teams at Notion, Stripe, Box, OpenAI, and Cloudflare ship quality agents at scale.
Start building