Encyclopedia Evalica / Observability / Token usage / cost tracking
Token usage / cost tracking
/'toh.kuhn 'yoo.suhj slash kahst 'tra.kihng/Measuring input/output tokens and mapping them to cost, often per model/provider. It helps teams control spend and diagnose cost regressions. (noun)
“Token usage tracking showed retrieval context was driving most of the cost.”
Related Observability terms
- Active observability •
- AI observability •
- Alert / threshold •
- Dashboard •
- Data flywheel •
- Deep search •
- Drift •
- Error rate •
- Feedback loop •
- Logs •
- Model drift •
- Online evaluation (production scoring) •
- P50 / P95 / P99 (Percentiles) •
- Sampling rate •
- Service Level Indicator (SLI) •
- Service Level Objective (SLO) •
- Time-to-first-token (TTFT) •
- Topics
From the docs
Get started with Evals
Braintrust is the observability platform for agents in production. By actively applying intelligence to agent traces and automatically surfacing critical patterns, Braintrust helps teams at Notion, Stripe, Box, OpenAI, and Cloudflare ship quality agents at scale.
Start building