Encyclopedia Evalica / Evaluation / Toxicity score

Toxicity score

/tah'ksih.suh.tee skawr/A safety metric that estimates harmful/toxic content likelihood in outputs. It's often used to monitor and gate risk-sensitive releases. (noun)

The toxicity score spiked on a small set of adversarial prompts.

Related Evaluation terms

From the docs

Get started with Evals

Braintrust is the observability platform for agents in production. By actively applying intelligence to agent traces and automatically surfacing critical patterns, Braintrust helps teams at Notion, Stripe, Box, OpenAI, and Cloudflare ship quality agents at scale.

Start building