| react-profiling | 0 |
| react-import-map | react,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf |
| route-pattern | /:user_id/:repository/pulls(.:format) |
| route-controller | repo_pulls_dashboard |
| route-action | index |
| fetch-nonce | v2:d8ef2f32-f579-2fc3-c932-355757fe4dc8 |
| current-catalog-service-hash | ae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b |
| request-id | E3D0:2F67B6:5180EF:6A7148:6AEBD84A |
| html-safe-nonce | d20db92ccb94146ed77a502dab27ca760001bfe8eefcde6210efd70a0d2bf966 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJFM0QwOjJGNjdCNjo1MTgwRUY6NkE3MTQ4OjZBRUJEODRBIiwidmlzaXRvcl9pZCI6IjE1NzUwNzAxMzUzNjc3NTE3NTQiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ== |
| visitor-hmac | 76a9c4db9e86c902d584289225a1cb72f020b9b28afdcba98db805022bf5b8bc |
| hovercard-subject-tag | repository:878272507 |
| github-keyboard-shortcuts | repository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | ///pull_requests/index |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/JudgmentLabs/judgeval/pulls |
| twitter:image | https://repository-images.githubusercontent.com/878272507/4ea8faae-0307-4ac6-8c79-6228c4f2cfd1 |
| twitter:card | summary_large_image |
| og:image | https://repository-images.githubusercontent.com/878272507/4ea8faae-0307-4ac6-8c79-6228c4f2cfd1 |
| og:image:alt | The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring. - Pull requests · JudgmentLabs/judgeval |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | 97b204e1babd5581d0c4d4f3dc7d4a484f3d9fef013d4bc1be57692ba0aeb6f5 |
| turbo-cache-control | no-cache |
| go-import | github.com/JudgmentLabs/judgeval git https://github.com/JudgmentLabs/judgeval.git |
| octolytics-dimension-user_id | 186249420 |
| octolytics-dimension-user_login | JudgmentLabs |
| octolytics-dimension-repository_id | 878272507 |
| octolytics-dimension-repository_nwo | JudgmentLabs/judgeval |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 878272507 |
| octolytics-dimension-repository_network_root_nwo | JudgmentLabs/judgeval |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | ee820e8271e2dd5c53dba22e928915edb9795b69 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
| react-app-name | pull-requests |
| Skip to content | https://github.com/JudgmentLabs/judgeval/pulls#start-of-content |
| https://github.com/ |
| Sign in | https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FJudgmentLabs%2Fjudgeval%2Fpulls |
| GitHubRepository hosting, code review, and collaboration | https://github.com/platform |
| CopilotAI coding agent for tasks, projects and automated work | https://github.com/features/copilot |
| ActionsCI/CD and automation | https://github.com/features/actions |
| Code QualityQuality analysis, fixes, and enforcement | https://github.com/features/code-quality |
| CodespacesCloud development environments | https://github.com/features/codespaces |
| Code SecurityVulnerability detection and remediation | https://github.com/security/advanced-security/code-security |
| Secret ProtectionSecret scanning and leak prevention | https://github.com/security/advanced-security/secret-protection |
| All Features | https://github.com/features |
| Documentation | https://docs.github.com/en |
| Training | https://learn.github.com/skills |
| Certifications | https://learn.github.com/credentials |
| Build with Copilot | https://github.com/features/ai |
| Customize Copilot | https://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview |
| Integrations | https://github.com/marketplace |
| Trending repos | https://github.com/trending |
| GitHub Sponsors | https://github.com/open-source/sponsors |
| Developer articles | https://github.com/resources/articles |
| ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place. | https://github.blog/changelog/ |
| Enterprises | https://github.com/enterprise |
| Team | https://github.com/team |
| Startups | https://github.com/enterprise/startups |
| Nonprofits | https://github.com/solutions/industry/nonprofits |
| Healthcare | https://github.com/solutions/industry/healthcare |
| Financial services | https://github.com/solutions/industry/financial-services |
| Manufacturing | https://github.com/solutions/industry/manufacturing |
| Government | https://github.com/solutions/industry/government |
| See all industries | https://github.com/solutions/industry |
| Why GitHub | https://github.com/why-github |
| Customer Stories | https://github.com/customer-stories |
| Business insights | https://github.com/solutions/executive-insights |
| Trust Center | https://github.com/trust-center |
| GitHub Advanced SecurityEnterprise-grade code security | https://github.com/security/advanced-security |
| Copilot for businessEnterprise-grade AI features | https://github.com/features/copilot/copilot-business |
| Premium SupportEnterprise-grade 24/7 support | https://github.com/enterprise/premium-support |
| Documentation | https://docs.github.com/en |
| Resource center | https://github.com/resources |
| Blog | https://github.blog/ |
| Events & webinars | https://github.com/resources/events |
| Community Forum | https://github.com/orgs/community/discussions |
| Customer Stories | https://github.com/customer-stories |
| Integrations | https://github.com/marketplace |
| Customer support | https://help.github.com/ |
| Training | https://learn.github.com/skills |
| GitHub Status | https://www.githubstatus.com/ |
| About | https://github.com/about |
| Partners | https://github.com/partners |
| Changelog | https://github.blog/changelog/ |
| GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub. | https://githubuniverse.com/ |
| Pricing | https://github.com/pricing |
| Sign in | https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FJudgmentLabs%2Fjudgeval%2Fpulls |
| Sign up | https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Findex&source=header-repo&source_repo=JudgmentLabs%2Fjudgeval |
| Reload | https://github.com/JudgmentLabs/judgeval/pulls |
| Reload | https://github.com/JudgmentLabs/judgeval/pulls |
| Reload | https://github.com/JudgmentLabs/judgeval/pulls |
| JudgmentLabs | https://github.com/JudgmentLabs |
| judgeval | https://github.com/JudgmentLabs/judgeval |
| Code | https://github.com/JudgmentLabs/judgeval |
| Issues17 (17) | https://github.com/JudgmentLabs/judgeval/issues |
| Pull requests32 (32) | https://github.com/JudgmentLabs/judgeval/pulls |
| Discussions | https://github.com/JudgmentLabs/judgeval/discussions |
| Actions | https://github.com/JudgmentLabs/judgeval/actions |
| Projects | https://github.com/JudgmentLabs/judgeval/projects |
| Security and quality | https://github.com/JudgmentLabs/judgeval/security |
| Insights | https://github.com/JudgmentLabs/judgeval/pulse |
| https://github.com/JudgmentLabs/judgeval |
| Labels 17 (17) | https://github.com/JudgmentLabs/judgeval/labels |
| Milestones 0 (0) | https://github.com/JudgmentLabs/judgeval/milestones |
| New pull request | https://github.com/JudgmentLabs/judgeval/compare |
| Open32 (32) | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen |
| Closed730 (730) | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aclosed |
| docs: state the 10,000-row, 25 MiB SQL result limit | https://github.com/JudgmentLabs/judgeval/pull/835 |
| devin-ai-integration[bot] | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3Adevin-ai-integration%5Bbot%5D |
| JUD-11064: client.test_suites.repin_checks | https://github.com/JudgmentLabs/judgeval/pull/834 |
| JJwilkin | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3AJJwilkin |
| fix(google): count thinking tokens as output and exclude cached tokens from input | https://github.com/JudgmentLabs/judgeval/pull/833 |
| pcbeingused333 | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3Apcbeingused333 |
| Fix background queue shutdown and admission races | https://github.com/JudgmentLabs/judgeval/pull/831 |
| agocharbhatia | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3Aagocharbhatia |
| docs(api): show how to call JudgmentApiClient through client.api | https://github.com/JudgmentLabs/judgeval/pull/830 |
| JJwilkin | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3AJJwilkin |
| fix(serialize): don't drop the whole payload on non-UTF-8 bytes | https://github.com/JudgmentLabs/judgeval/pull/808 |
| rudycelekli | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3Arudycelekli |
| fix(openai): keep the Stream API working on wrapped chat completions | https://github.com/JudgmentLabs/judgeval/pull/798 |
| TanishGudise | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3ATanishGudise |
| fix(trace): parent generator yield spans on the generator span | https://github.com/JudgmentLabs/judgeval/pull/797 |
| TanishGudise | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3ATanishGudise |
| fix(trace): end sync observe spans on KeyboardInterrupt and SystemExit | https://github.com/JudgmentLabs/judgeval/pull/796 |
| TanishGudise | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3ATanishGudise |
| fix(e2e): stop leaking e2e-tests projects | https://github.com/JudgmentLabs/judgeval/pull/793 |
| luna-jl | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3Aluna-jl |
| feat(integration): add Adam Network agent communication example | https://github.com/JudgmentLabs/judgeval/pull/792 |
| snow884 | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3Asnow884 |
| Replace agent-judge SDK surface with external judge create/feedback | https://github.com/JudgmentLabs/judgeval/pull/791 |
| luna-jl | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3Aluna-jl |
| feat(trace): support explicit project ID initialization | https://github.com/JudgmentLabs/judgeval/pull/789 |
| nlemoff | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3Anlemoff |
| chore: remove unused OpenLit dev dependency and vulnerable LangChain packages | https://github.com/JudgmentLabs/judgeval/pull/788 |
| abhishekg999 | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3Aabhishekg999 |
| feat: add EvalPort result adapter | https://github.com/JudgmentLabs/judgeval/pull/786 |
| atirna | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3Aatirna |
| 1 | https://github.com/JudgmentLabs/judgeval/issues/786/linked_closing_reference?reference_location=REPO_PULLS_INDEX |
| docs: add docstring to update_file and guard CLI with __main__ | https://github.com/JudgmentLabs/judgeval/pull/785 |
| nickhac | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3Anickhac |
| feat(offline_tests): add concurrency for offline agent test execution (JUD-9600) | https://github.com/JudgmentLabs/judgeval/pull/784 |
| nlemoff | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3Anlemoff |
| fix(code_quality): Missing docstring on public function initialize in hatch_b | https://github.com/JudgmentLabs/judgeval/pull/779 |
| nickhac | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3Anickhac |
| feat: add OrcaRouter as a named traced provider | https://github.com/JudgmentLabs/judgeval/pull/777 |
| JinhaoSong322 | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3AJinhaoSong322 |
| fix(prompts): stop compile() crashing on literal $ in templates | https://github.com/JudgmentLabs/judgeval/pull/772 |
| devmello | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3Adevmello |
| fix: don't adopt a foreign global OTel span as a Judgment parent | https://github.com/JudgmentLabs/judgeval/pull/769 |
| arthi-arumugam-git | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3Aarthi-arumugam-git |
| feat(google): instrument aio.models.generate_content_stream for async streaming | https://github.com/JudgmentLabs/judgeval/pull/768 |
| Aftabbs | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3AAftabbs |
| fix: validate dataset save_as file_type and fix save/load round-trip | https://github.com/JudgmentLabs/judgeval/pull/763 |
| yashwanth123 | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3Ayashwanth123 |
| feat(google): instrument generate_content_stream for streaming spans | https://github.com/JudgmentLabs/judgeval/pull/760 |
| Aftabbs | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3AAftabbs |
| 1 | https://github.com/JudgmentLabs/judgeval/issues/760/linked_closing_reference?reference_location=REPO_PULLS_INDEX |
| fix: validate Example.create() property keys | https://github.com/JudgmentLabs/judgeval/pull/758 |
| yashwanth123 | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen+author%3Ayashwanth123 |
| 1 | https://github.com/JudgmentLabs/judgeval/issues/758/linked_closing_reference?reference_location=REPO_PULLS_INDEX |
| Previous | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen |
| 1 | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen |
| 2 | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen&page=2 |
| Next | https://github.com/JudgmentLabs/judgeval/pulls?q=is%3Apr+state%3Aopen&page=2 |
|
| https://github.com |
| Terms | https://docs.github.com/site-policy/github-terms/github-terms-of-service |
| Privacy | https://docs.github.com/site-policy/privacy-policies/github-privacy-statement |
| Security | https://github.com/security |
| Status | https://www.githubstatus.com/ |
| Community | https://github.community/ |
| Docs | https://docs.github.com/ |
| Contact | https://support.github.com?tags=dotcom-footer |