Encyclopedia Evalica / Tracing and instrumentation / User feedback
User feedback
/'yoo.zer 'fee.dbak/Explicit signals like thumbs up/down or ratings captured from end users in production and attached to traces. Feedback is valuable because it links quality judgments to concrete examples. (noun)
“User feedback on that trace was a thumbs-down, so we added it to the eval set.”
Customer example
Replit uses user feedback to investigate problems by pulling tens or hundreds of related production examples, so engineers can prioritize and fix whole families of issues instead of one-off bugs. Read more
Related Tracing and instrumentation terms
From the docs
Braintrust is the observability platform for agents in production. By actively applying intelligence to agent traces and automatically surfacing critical patterns, Braintrust helps teams at Notion, Stripe, Box, OpenAI, and Cloudflare ship quality agents at scale.
Start building