Encyclopedia Evalica / Annotation / Annotation
Annotation
/a.nuh'tay.shuhn/The process of adding structured human feedback, labels, or corrections to traces or dataset records. Annotation turns messy free-text notes into consistent signals that can be scored and tracked. (noun)
“We added annotations to those traces based on the customer feedback in the chat logs.”
Customer example
Portola has nontechnical subject matter experts review and annotate real conversation logs and ship prompt changes directly. Read more
Related Annotation terms
From the docs
Braintrust is the observability platform for agents in production. By actively applying intelligence to agent traces and automatically surfacing critical patterns, Braintrust helps teams at Notion, Stripe, Box, OpenAI, and Cloudflare ship quality agents at scale.
Start building