René's URL Explorer Experiment


Title: Custom code evaluators - Braintrust

Open Graph Title: Custom code evaluators - Braintrust

X Title: Custom code evaluators - Braintrust

Description: Write scorers and classifiers as custom code with full control over scoring logic, business rules, and pattern matching to evaluate AI outputs.

Open Graph Description: Write scorers and classifiers as custom code with full control over scoring logic, business rules, and pattern matching to evaluate AI outputs.

X Description: Write scorers and classifiers as custom code with full control over scoring logic, business rules, and pattern matching to evaluate AI outputs.

Mail addresses
support@braintrust.dev

Opengraph URL: https://docs.braintrust.dev/evaluate/custom-code

Generator: Mintlify

direct link

Domain: docs.braintrust.dev


Hey, it has json ld scripts:
{"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://docs.braintrust.dev/#organization","name":"Braintrust","url":"https://docs.braintrust.dev","logo":{"@type":"ImageObject","url":"https://mintcdn.com/braintrust/u7i5gTV-ad3TRDYt/logo/logo-light.svg?fit=max&auto=format&n=u7i5gTV-ad3TRDYt&q=85&s=23878ca308aee393dcc8c89ed8705189"}},{"@type":"WebSite","@id":"https://docs.braintrust.dev#website","name":"Braintrust","url":"https://docs.braintrust.dev","publisher":{"@id":"https://docs.braintrust.dev/#organization"}},{"@type":"WebPage","@id":"https://docs.braintrust.dev/evaluate/custom-code#webpage","url":"https://docs.braintrust.dev/evaluate/custom-code","name":"Custom code evaluators","description":"Write scorers and classifiers as custom code with full control over scoring logic, business rules, and pattern matching to evaluate AI outputs.","dateModified":"2026-11-06T16:55:59.176Z","isPartOf":{"@id":"https://docs.braintrust.dev#website"},"breadcrumb":{"@id":"https://docs.braintrust.dev/evaluate/custom-code#breadcrumb"}},{"@type":"BreadcrumbList","@id":"https://docs.braintrust.dev/evaluate/custom-code#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Evaluate","item":"https://docs.braintrust.dev/evaluate"},{"@type":"ListItem","position":2,"name":"Evaluators","item":"https://docs.braintrust.dev/evaluate/write-scorers"},{"@type":"ListItem","position":3,"name":"Custom code evaluators","item":"https://docs.braintrust.dev/evaluate/custom-code"}]},{"@type":["Article","TechArticle"],"@id":"https://docs.braintrust.dev/evaluate/custom-code#article","headline":"Custom code evaluators","name":"Custom code evaluators","description":"Write scorers and classifiers as custom code with full control over scoring logic, business rules, and pattern matching to evaluate AI outputs.","url":"https://docs.braintrust.dev/evaluate/custom-code","mainEntityOfPage":{"@id":"https://docs.braintrust.dev/evaluate/custom-code#webpage"},"image":"https://www.braintrust.dev/og?template=docs&title=Custom%20code%20evaluators","dateModified":"2026-11-06T16:55:59.176Z","publisher":{"@id":"https://docs.braintrust.dev/#organization"},"isPartOf":{"@id":"https://docs.braintrust.dev#website"}}]}
{"@context":"https://schema.org","@type":"WebSite","name":"Braintrust","publisher":{"@type":"Organization","name":"Braintrust"},"provider":{"@type":"Organization","name":"Mintlify","url":"https://mintlify.com"}}

application-nameBraintrust
og:site_nameBraintrust documentation, API reference, and changelog
og:typewebsite
og:imagehttps://www.braintrust.dev/og?template=docs&title=Custom code evaluators
og:image:width1200
og:image:height630
twitter:cardsummary_large_image
twitter:imagehttps://www.braintrust.dev/og?template=docs&title=Custom code evaluators
twitter:image:width1200
twitter:image:height630
msapplication-config/mintlify-assets/_mintlify/favicons/braintrust/Pnqso5CFAxfn5afF/_generated/favicon/browserconfig.xml
apple-mobile-web-app-titleBraintrust
msapplication-TileColor#2c1fea

Links:

/llms.txthttps://docs.braintrust.dev/llms.txt
Skip to main contenthttps://docs.braintrust.dev/evaluate/custom-code#content-area
Braintrust home pagehttps://docs.braintrust.dev/
Contact ushttps://braintrust.dev/contact
Dashboardhttps://braintrust.dev/app
Dashboardhttps://braintrust.dev/app
Guideshttps://docs.braintrust.dev/
Integrationshttps://docs.braintrust.dev/integrations
SDKshttps://docs.braintrust.dev/sdks
Referencehttps://docs.braintrust.dev/reference
Cookbookhttps://docs.braintrust.dev/cookbook
Troubleshootinghttps://docs.braintrust.dev/kb
Changeloghttps://docs.braintrust.dev/changelog
Introductionhttps://docs.braintrust.dev/
Braintrust workflowhttps://docs.braintrust.dev/workflow
Plans and limitshttps://docs.braintrust.dev/plans-and-limits
Overviewhttps://docs.braintrust.dev/instrument
User feedbackhttps://docs.braintrust.dev/instrument/user-feedback
Attachmentshttps://docs.braintrust.dev/instrument/attachments
Overviewhttps://docs.braintrust.dev/observe
Alertshttps://docs.braintrust.dev/observe/alerts
Overviewhttps://docs.braintrust.dev/annotate
Labels and correctionshttps://docs.braintrust.dev/annotate/labels
Exportshttps://docs.braintrust.dev/annotate/export
Custom viewshttps://docs.braintrust.dev/annotate/custom-views
Overviewhttps://docs.braintrust.dev/evaluate
Overviewhttps://docs.braintrust.dev/evaluate/write-scorers
Autoevalshttps://docs.braintrust.dev/evaluate/autoevals
Custom codehttps://docs.braintrust.dev/evaluate/custom-code
LLM-as-a-judgehttps://docs.braintrust.dev/evaluate/llm-as-a-judge
Playgroundshttps://docs.braintrust.dev/evaluate/playgrounds
Online scoringhttps://docs.braintrust.dev/evaluate/score-online
Best practiceshttps://docs.braintrust.dev/evaluate/best-practices
Overviewhttps://docs.braintrust.dev/deploy
Functionshttps://docs.braintrust.dev/deploy/functions
Environmentshttps://docs.braintrust.dev/deploy/environments
Monitoringhttps://docs.braintrust.dev/deploy/monitor
Streaminghttps://docs.braintrust.dev/deploy/streaming
Overviewhttps://docs.braintrust.dev/admin
Organizationshttps://docs.braintrust.dev/admin/organizations
Projectshttps://docs.braintrust.dev/admin/projects
AI providershttps://docs.braintrust.dev/admin/ai-providers
Personal settingshttps://docs.braintrust.dev/admin/personal-settings
Service healthhttps://docs.braintrust.dev/admin/service-health
Agent evaluationhttps://docs.braintrust.dev/best-practices/agents
Scorer designhttps://docs.braintrust.dev/best-practices/scorers
PM workflowshttps://docs.braintrust.dev/best-practices/pm-workflows
Score spanshttps://docs.braintrust.dev/evaluate/custom-code#score-spans
Score traceshttps://docs.braintrust.dev/evaluate/custom-code#score-traces
Trace scorer recipeshttps://docs.braintrust.dev/evaluate/custom-code#trace-scorer-recipes
Score groupshttps://docs.braintrust.dev/evaluate/custom-code#score-groups
Set pass thresholdshttps://docs.braintrust.dev/evaluate/custom-code#set-pass-thresholds
Return multiple scoreshttps://docs.braintrust.dev/evaluate/custom-code#return-multiple-scores
Apply classification labelshttps://docs.braintrust.dev/evaluate/custom-code#apply-classification-labels
Build Python bundles for BYOChttps://docs.braintrust.dev/evaluate/custom-code#build-python-bundles-for-byoc
Next stepshttps://docs.braintrust.dev/evaluate/custom-code#next-steps
Scorers overviewhttps://docs.braintrust.dev/evaluate/write-scorers#where-to-define-scorers-and-classifiers
https://docs.braintrust.dev/evaluate/custom-code#score-spans
supported Lambda runtimeshttps://docs.braintrust.dev/evaluate/remote-evals#2-register-your-sandbox
file an issue in the braintrust-sdk repohttps://github.com/braintrustdata/braintrust-sdk/issues
Scorershttps://www.braintrust.dev/app/~/scorers
https://docs.braintrust.dev/evaluate/custom-code#score-traces
Scorershttps://www.braintrust.dev/app/~/scorers
https://docs.braintrust.dev/evaluate/custom-code#trace-scorer-recipes
agentAssertionScorerhttps://docs.braintrust.dev/sdks/typescript/api-reference#agentassertionscorer
https://docs.braintrust.dev/evaluate/custom-code#score-groups
online scoring ruleshttps://docs.braintrust.dev/evaluate/score-online#configuration-parameters
online scoring rulehttps://docs.braintrust.dev/evaluate/score-online#configuration-parameters
span.export()https://docs.braintrust.dev/instrument/advanced-tracing#trace-distributed-systems
trace-level scorerhttps://docs.braintrust.dev/evaluate/custom-code#score-traces
https://docs.braintrust.dev/evaluate/custom-code#set-pass-thresholds
register it with the APIhttps://docs.braintrust.dev/sdks/ruby/troubleshooting
https://docs.braintrust.dev/evaluate/custom-code#return-multiple-scores
https://docs.braintrust.dev/evaluate/custom-code#apply-classification-labels
classifierhttps://docs.braintrust.dev/evaluate/write-scorers#classifiers
LLM-as-a-judge classifierhttps://docs.braintrust.dev/evaluate/llm-as-a-judge#apply-classification-labels
https://docs.braintrust.dev/evaluate/custom-code#build-python-bundles-for-byoc
code execution securityhttps://docs.braintrust.dev/security#code-execution
push the functionhttps://docs.braintrust.dev/reference/cli/functions
https://docs.braintrust.dev/evaluate/custom-code#next-steps
Autoevalshttps://docs.braintrust.dev/evaluate/autoevals
LLM-as-a-judgehttps://docs.braintrust.dev/evaluate/llm-as-a-judge
Run evaluationshttps://docs.braintrust.dev/evaluate/run-evaluations
Score production logshttps://docs.braintrust.dev/evaluate/score-online
AutoevalsPrevioushttps://docs.braintrust.dev/evaluate/autoevals
LLM-as-a-judge evaluatorsNexthttps://docs.braintrust.dev/evaluate/llm-as-a-judge
Braintrust home pagehttps://docs.braintrust.dev/
githubhttps://github.com/braintrustdata
xhttps://x.com/braintrust
discordhttps://discord.gg/6G8s47F44X
youtubehttps://www.youtube.com/@BraintrustData
Pricinghttps://www.braintrust.dev/pricing
Bloghttps://www.braintrust.dev/blog
Careershttps://www.braintrust.dev/careers
Statushttps://status.braintrust.dev/
githubhttps://github.com/braintrustdata
xhttps://x.com/braintrust
discordhttps://discord.gg/6G8s47F44X
youtubehttps://www.youtube.com/@BraintrustData
Powered byThis documentation is built and hosted on Mintlify, a developer documentation platformhttps://www.mintlify.com?utm_campaign=poweredBy&utm_medium=referral&utm_source=braintrust

Viewport: width=device-width, initial-scale=1, viewport-fit=cover


URLs of crawlers that visited me.