Braintrust: Jev as a typed scorer for agent responses

Braintrust added Jev as a scorer with a confidence-threshold pattern (accept above 0.95, route 0.70–0.95 to an LLM judge, flag below 0.70 for humans) and auto-instrumentation of TypeSafe client calls in its Python SDK.

Notes

Vendor integration page.

source-backed — Public repository, docs or live artifact. About this label

Destinations

Also linked

• SDK instrumentation PR #777 ↗

Filed under

• #evals
• #observability
• #braintrust

In collections

• Agent harnesses →