René's URL Explorer Experiment


Title: feat(eval): add dataset-level evaluator framework with precision/recall/f-score by ajay-kesavan · Pull Request #1669 · UiPath/uipath-python · GitHub

Open Graph Title: feat(eval): add dataset-level evaluator framework with precision/recall/f-score by ajay-kesavan · Pull Request #1669 · UiPath/uipath-python

X Title: feat(eval): add dataset-level evaluator framework with precision/recall/f-score by ajay-kesavan · Pull Request #1669 · UiPath/uipath-python

Description: A comprehensive Python SDK for interacting with UiPath's Automation Platform - feat(eval): add dataset-level evaluator framework with precision/recall/f-score by ajay-kesavan · Pull Request #1669 · UiPath/uipath-python

Open Graph Description: Summary Adds a dataset-level evaluator framework that consumes the per-datapoint results of an existing classification evaluator and emits one run-level metric (precision / recall / F-beta) with a ...

X Description: Summary Adds a dataset-level evaluator framework that consumes the per-datapoint results of an existing classification evaluator and emits one run-level metric (precision / recall / F-beta) with a ...

Opengraph URL: https://github.com/UiPath/uipath-python/pull/1669

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/_view_fragments/voltron/pull_requests/show/:user_id/:repository/:id/pull_request_layout(.:format)
route-controllervoltron_pull_requests_fragments
route-actionpull_request_layout
fetch-noncev2:b0502688-587f-bbc6-8865-a4add43a7e7b
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idE4B0:395D20:14F0AF:1CAF40:6AFF61D1
html-safe-nonce68cb8712e4db32d32232bbc89ca66a86a82d39629234ba13f678eadadc89d607
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJFNEIwOjM5NUQyMDoxNEYwQUY6MUNBRjQwOjZBRkY2MUQxIiwidmlzaXRvcl9pZCI6Ijc2OTk1ODc2NzU3NjU4MjYwMDEiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmacc48a7de44fb138590d526cedccf603ab1eae42c1fb59683875896d6f3e208788
hovercard-subject-tagpull_request:3719511422
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/pull_requests_fragments/pull_request_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/voltron/pull_requests/show/UiPath/uipath-python/1669/pull_request_layout
twitter:imagehttps://opengraph.githubassets.com/3d94ffcc7d848167c8088bee55623d73813ba937c51f18cc9ab743a3e5ffec72/UiPath/uipath-python/pull/1669
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/3d94ffcc7d848167c8088bee55623d73813ba937c51f18cc9ab743a3e5ffec72/UiPath/uipath-python/pull/1669
og:image:altSummary Adds a dataset-level evaluator framework that consumes the per-datapoint results of an existing classification evaluator and emits one run-level metric (precision / recall / F-beta) with a ...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernameajay-kesavan
hostnamegithub.com
expected-hostnamegithub.com
None41b58589a1c4eda1e3c8904144a412b88ca4455f63ca2ad3629f2e9f3c3a1d12
turbo-cache-controlno-cache
go-importgithub.com/UiPath/uipath-python git https://github.com/UiPath/uipath-python.git
octolytics-dimension-user_id375663
octolytics-dimension-user_loginUiPath
octolytics-dimension-repository_id925171912
octolytics-dimension-repository_nwoUiPath/uipath-python
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id925171912
octolytics-dimension-repository_network_root_nwoUiPath/uipath-python
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release8968d6d6acc65d74e4df332d23932dd3fd0502a4
ui-targetfull
theme-color#1e2327
color-schemelight dark
react-app-namepull-requests

Links:

Skip to contenthttps://github.com/UiPath/uipath-python/pull/1669#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FUiPath%2Fuipath-python%2Fpull%2F1669
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FUiPath%2Fuipath-python%2Fpull%2F1669
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fpull_requests_fragments%2Fpull_request_layout&source=header-repo&source_repo=UiPath%2Fuipath-python
Reloadhttps://github.com/UiPath/uipath-python/pull/1669
Reloadhttps://github.com/UiPath/uipath-python/pull/1669
Reloadhttps://github.com/UiPath/uipath-python/pull/1669
UiPathhttps://github.com/UiPath
uipath-pythonhttps://github.com/UiPath/uipath-python
Codehttps://github.com/UiPath/uipath-python
Issues81 (81)https://github.com/UiPath/uipath-python/issues
Pull requests144 (144)https://github.com/UiPath/uipath-python/pulls
Actionshttps://github.com/UiPath/uipath-python/actions
Projectshttps://github.com/UiPath/uipath-python/projects
Security and qualityhttps://github.com/UiPath/uipath-python/security
Insightshttps://github.com/UiPath/uipath-python/insights
https://github.com/UiPath/uipath-python
ajay-kesavanhttps://github.com/ajay-kesavan
mainhttps://github.com/UiPath/uipath-python/tree/main
feat/eval-dataset-evaluatorshttps://github.com/UiPath/uipath-python/tree/feat/eval-dataset-evaluators
Conversationhttps://github.com/UiPath/uipath-python/pull/1669
Commits8 (8)https://github.com/UiPath/uipath-python/pull/1669/commits
Checkshttps://github.com/UiPath/uipath-python/pull/1669/checks
Files changedhttps://github.com/UiPath/uipath-python/pull/1669/files
feat(eval): add dataset-level evaluator framework with precision/recall/f-scorehttps://github.com/UiPath/uipath-python/pull/1669#top
ajay-kesavanhttps://github.com/ajay-kesavan
mainhttps://github.com/UiPath/uipath-python/tree/main
feat/eval-dataset-evaluatorshttps://github.com/UiPath/uipath-python/tree/feat/eval-dataset-evaluators
https://github.com/ajay-kesavan
ajay-kesavanhttps://github.com/ajay-kesavan
May 20, 2026https://github.com/UiPath/uipath-python/pull/1669#issue-4489906763
Please reload this pagehttps://github.com/UiPath/uipath-python/pull/1669
#1663https://github.com/UiPath/uipath-python/pull/1663
Please reload this pagehttps://github.com/UiPath/uipath-python/pull/1669
https://github.com/ajay-kesavan
https://github.com/claude
feat(eval): add dataset-level evaluator framework with precision/reca…https://github.com/UiPath/uipath-python/pull/1669/commits/5e574f1895feccb314fd929d57e15dd69580c5f0
5e574f1https://github.com/UiPath/uipath-python/pull/1669/commits/5e574f1895feccb314fd929d57e15dd69580c5f0
https://github.com/apps/github-actions
github-actionshttps://github.com/apps/github-actions
test:uipath-langchain https://github.com/UiPath/uipath-python/issues?q=state%3Aopen%20label%3Atest%3Auipath-langchain
test:uipath-integrations https://github.com/UiPath/uipath-python/issues?q=state%3Aopen%20label%3Atest%3Auipath-integrations
May 20, 2026https://github.com/UiPath/uipath-python/pull/1669#event-25777338395
https://github.com/ajay-kesavan
https://github.com/claude
docs(eval): add runnable dataset evaluator demo + bump uv.lock for 2.…https://github.com/UiPath/uipath-python/pull/1669/commits/d6b7ab5566d07a9e34611358a4b7539912982936
d6b7ab5https://github.com/UiPath/uipath-python/pull/1669/commits/d6b7ab5566d07a9e34611358a4b7539912982936
https://github.com/ajay-kesavan
ajay-kesavanhttps://github.com/ajay-kesavan
May 21, 2026 https://github.com/UiPath/uipath-python/pull/1669#ref-pullrequest-4496457977
feat(eval): add ClassifierEvaluator (pure-metadata aggregator) #1674 https://github.com/UiPath/uipath-python/pull/1674
https://github.com/ajay-kesavan
ajay-kesavanhttps://github.com/ajay-kesavan
May 22, 2026https://github.com/UiPath/uipath-python/pull/1669#issuecomment-4514776872
#1674https://github.com/UiPath/uipath-python/pull/1674
Please reload this pagehttps://github.com/UiPath/uipath-python/pull/1669
https://github.com/ajay-kesavan
ajay-kesavanhttps://github.com/ajay-kesavan
May 22, 2026https://github.com/UiPath/uipath-python/pull/1669#event-25834189817
https://github.com/ajay-kesavan
Merge remote-tracking branch 'origin/main' into feat/eval-dataset-eva…https://github.com/UiPath/uipath-python/pull/1669/commits/e9ba8aa8b16f96e30e255b74b76ca294cdb6b04e
e9ba8aahttps://github.com/UiPath/uipath-python/pull/1669/commits/e9ba8aa8b16f96e30e255b74b76ca294cdb6b04e
https://github.com/ajay-kesavan
ajay-kesavanhttps://github.com/ajay-kesavan
Jun 19, 2026https://github.com/UiPath/uipath-python/pull/1669#event-26939374378
ajay-kesavanhttps://github.com/ajay-kesavan
June 18, 2026 21:26https://github.com/UiPath/uipath-python/pull/1669#commits-pushed-fb091e4
https://github.com/ajay-kesavan
https://github.com/claude
refactor(eval): embed aggregator specs in per-datapoint evaluator con…https://github.com/UiPath/uipath-python/pull/1669/commits/fb091e46c686da88958aa002cbfdb34527fe08ab
fb091e4https://github.com/UiPath/uipath-python/pull/1669/commits/fb091e46c686da88958aa002cbfdb34527fe08ab
https://github.com/ajay-kesavan
https://github.com/claude
refactor(eval): apply ponytail-review cleanuphttps://github.com/UiPath/uipath-python/pull/1669/commits/c0436a3da061146b61b117dbe885606b4fd52fef
c0436a3https://github.com/UiPath/uipath-python/pull/1669/commits/c0436a3da061146b61b117dbe885606b4fd52fef
@DataClasshttps://github.com/DataClass
https://github.com/ajay-kesavan
https://github.com/claude
fix(eval): address adversarial-review feedback on dataset evaluatorshttps://github.com/UiPath/uipath-python/pull/1669/commits/ad32c22c64e7ccb5aaf8446454cf8bc9408f6c30
ad32c22https://github.com/UiPath/uipath-python/pull/1669/commits/ad32c22c64e7ccb5aaf8446454cf8bc9408f6c30
https://github.com/apps/chatgpt-codex-connector
chatgpt-codex-connectorhttps://github.com/apps/chatgpt-codex-connector
Jun 19, 2026 https://github.com/UiPath/uipath-python/pull/1669#pullrequestreview-4530417357
View reviewed changes https://github.com/UiPath/uipath-python/pull/1669/files/ad32c22c64e7ccb5aaf8446454cf8bc9408f6c30
chatgpt-codex-connectorhttps://github.com/apps/chatgpt-codex-connector
https://github.com/UiPath/uipath-python/pull/1669#pullrequestreview-4530417357
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Your team has set up Codex to review pull requests in this repohttps://chatgpt.com/codex/cloud/settings/general
@codexhttps://github.com/codex
@codexhttps://github.com/codex
Please reload this pagehttps://github.com/UiPath/uipath-python/pull/1669
packages/uipath/src/uipath/eval/runtime/runtime.pyhttps://github.com/UiPath/uipath-python/pull/1669/files/ad32c22c64e7ccb5aaf8446454cf8bc9408f6c30#diff-4b41488cb098f634547e40dcc6c8a9c3c7e9fc4fe8a1f215b8334e9fd85e6da0
Please reload this pagehttps://github.com/UiPath/uipath-python/pull/1669
ajay-kesavanhttps://github.com/ajay-kesavan
June 18, 2026 23:05https://github.com/UiPath/uipath-python/pull/1669#commits-pushed-4d6afcc
https://github.com/ajay-kesavan
https://github.com/claude
fix(eval): address codex P1 + lint failures on dataset evaluatorshttps://github.com/UiPath/uipath-python/pull/1669/commits/4d6afccafbdb4adb5af0365af69d6613953ddc31
4d6afcchttps://github.com/UiPath/uipath-python/pull/1669/commits/4d6afccafbdb4adb5af0365af69d6613953ddc31
https://github.com/ajay-kesavan
Merge remote-tracking branch 'origin/main' into feat/eval-dataset-eva…https://github.com/UiPath/uipath-python/pull/1669/commits/89b69b7df0f286019c1f358d3387e5e9f053d333
89b69b7https://github.com/UiPath/uipath-python/pull/1669/commits/89b69b7df0f286019c1f358d3387e5e9f053d333
https://github.com/apps/github-actions
github-actionshttps://github.com/apps/github-actions
Jun 24, 2026https://github.com/UiPath/uipath-python/pull/1669#issuecomment-4791527582
uipath-langchain-pythonhttps://github.com/UiPath/uipath-langchain-python
Inspect the failed run →https://github.com/UiPath/uipath-python/actions/runs/28113392809
Please reload this pagehttps://github.com/UiPath/uipath-python/pull/1669
https://github.com/apps/sonarqubecloud
sonarqubecloudhttps://github.com/apps/sonarqubecloud
Jun 24, 2026https://github.com/UiPath/uipath-python/pull/1669#issuecomment-4791542830
https://sonarcloud.io/dashboard?id=UiPath_uipath-python&pullRequest=1669
https://camo.githubusercontent.com/dee0494dfbfba8079e42e9f874fc4565349e336afadd63a079854676b0cd67c5/68747470733a2f2f736f6e6172736f757263652e6769746875622e696f2f736f6e6172636c6f75642d6769746875622d7374617469632d7265736f75726365732f76322f636f6d6d6f6e2f7061737365642d313670782e706e67
0 New issueshttps://sonarcloud.io/project/issues?id=UiPath_uipath-python&pullRequest=1669&issueStatuses=OPEN,CONFIRMED&sinceLeakPeriod=true
https://camo.githubusercontent.com/57c99c752ea927bfb138851f87c6834d88d3cf919db587aef9ad776ef6f3a1ba/68747470733a2f2f736f6e6172736f757263652e6769746875622e696f2f736f6e6172636c6f75642d6769746875622d7374617469632d7265736f75726365732f76322f636f6d6d6f6e2f61636365707465642d313670782e706e67
0 Accepted issueshttps://sonarcloud.io/project/issues?id=UiPath_uipath-python&pullRequest=1669&issueStatuses=ACCEPTED
https://camo.githubusercontent.com/dee0494dfbfba8079e42e9f874fc4565349e336afadd63a079854676b0cd67c5/68747470733a2f2f736f6e6172736f757263652e6769746875622e696f2f736f6e6172636c6f75642d6769746875622d7374617469632d7265736f75726365732f76322f636f6d6d6f6e2f7061737365642d313670782e706e67
0 Security Hotspotshttps://sonarcloud.io/project/security_hotspots?id=UiPath_uipath-python&pullRequest=1669&issueStatuses=OPEN,CONFIRMED&sinceLeakPeriod=true
https://camo.githubusercontent.com/dee0494dfbfba8079e42e9f874fc4565349e336afadd63a079854676b0cd67c5/68747470733a2f2f736f6e6172736f757263652e6769746875622e696f2f736f6e6172636c6f75642d6769746875622d7374617469632d7265736f75726365732f76322f636f6d6d6f6e2f7061737365642d313670782e706e67
98.9% Coverage on New Codehttps://sonarcloud.io/component_measures?id=UiPath_uipath-python&pullRequest=1669&metric=new_coverage&view=list
https://camo.githubusercontent.com/dee0494dfbfba8079e42e9f874fc4565349e336afadd63a079854676b0cd67c5/68747470733a2f2f736f6e6172736f757263652e6769746875622e696f2f736f6e6172636c6f75642d6769746875622d7374617469632d7265736f75726365732f76322f636f6d6d6f6e2f7061737365642d313670782e706e67
0.0% Duplication on New Codehttps://sonarcloud.io/component_measures?id=UiPath_uipath-python&pullRequest=1669&metric=new_duplicated_lines_density&view=list
See analysis details on SonarQube Cloudhttps://sonarcloud.io/dashboard?id=UiPath_uipath-python&pullRequest=1669
Please reload this pagehttps://github.com/UiPath/uipath-python/pull/1669
https://github.com/ajay-kesavan
ajay-kesavanhttps://github.com/ajay-kesavan
Jul 7, 2026https://github.com/UiPath/uipath-python/pull/1669#issuecomment-4908165490
#1663https://github.com/UiPath/uipath-python/pull/1663
Please reload this pagehttps://github.com/UiPath/uipath-python/pull/1669
https://github.com/ajay-kesavan
ajay-kesavanhttps://github.com/ajay-kesavan
Jul 7, 2026https://github.com/UiPath/uipath-python/pull/1669#event-27683068158
https://github.co/hiddenchars
https://github.com/UiPath/uipath-python/pull/{{ revealButtonHref }}
Sign up for freehttps://github.com/join?source=comment-repo
Sign in to commenthttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FUiPath%2Fuipath-python%2Fpull%2F1669
https://github.com/apps/chatgpt-codex-connector
chatgpt-codex-connector[bot] https://github.com/apps/chatgpt-codex-connector
https://github.com/UiPath/uipath-python/pull/1669/files/ad32c22c64e7ccb5aaf8446454cf8bc9408f6c30
Copilot code review https://github.com/apps/copilot-pull-request-reviewer
Copilot https://github.com/apps/copilot-pull-request-reviewer
Please reload this pagehttps://github.com/UiPath/uipath-python/pull/1669
test:uipath-integrations https://github.com/UiPath/uipath-python/issues?q=state%3Aopen%20label%3Atest%3Auipath-integrations
test:uipath-langchain https://github.com/UiPath/uipath-python/issues?q=state%3Aopen%20label%3Atest%3Auipath-langchain
Please reload this pagehttps://github.com/UiPath/uipath-python/pull/1669
https://github.com/ajay-kesavan
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.