| react-profiling | 0 |
| react-import-map | react,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf |
| route-pattern | /:user_id/:repository/commits(/*name) |
| route-controller | commits |
| route-action | show |
| fetch-nonce | v2:4d52322e-ced8-bb38-0686-0ef7f0b79017 |
| current-catalog-service-hash | f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb |
| request-id | A822:1CAA92:850BC9:AD02F3:6AED3671 |
| html-safe-nonce | b6f86dc94b9cad29508b67599016547ed53aca17015e8530033688dc7e88367b |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBODIyOjFDQUE5Mjo4NTBCQzk6QUQwMkYzOjZBRUQzNjcxIiwidmlzaXRvcl9pZCI6IjgyOTg0NjIwMDI2NjUwNDM1NjkiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ== |
| visitor-hmac | 105132f28a9ea2f5fa32db23f833ea92554cc64de4a66cb6ee040d870413dac1 |
| hovercard-subject-tag | repository:793526430 |
| github-keyboard-shortcuts | repository,commit-list,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | ///commits/show |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/bigcode-project/bigcodebench/commits/main/bigcodebench/data |
| twitter:image | https://opengraph.githubassets.com/995843639a5f18968ad7e4762f2f1e41e18f58763f7ae69e5c10c52a5efc7c70/bigcode-project/bigcodebench |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/995843639a5f18968ad7e4762f2f1e41e18f58763f7ae69e5c10c52a5efc7c70/bigcode-project/bigcodebench |
| og:image:alt | [ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI - History for bigcodebench/data - bigcode-project/bigcodebench |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | 26c92a9388ddfad3fa88d132b5d5f0b4747030233dcc4e5efb05f1cbae152184 |
| turbo-cache-control | no-cache |
| go-import | github.com/bigcode-project/bigcodebench git https://github.com/bigcode-project/bigcodebench.git |
| octolytics-dimension-user_id | 110470554 |
| octolytics-dimension-user_login | bigcode-project |
| octolytics-dimension-repository_id | 793526430 |
| octolytics-dimension-repository_nwo | bigcode-project/bigcodebench |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 793526430 |
| octolytics-dimension-repository_network_root_nwo | bigcode-project/bigcodebench |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | c629ad99c254d306375fc8354d04321c2c362236 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
| react-app-name | commits |
| Skip to content | https://github.com/bigcode-project/bigcodebench/commits/main/bigcodebench/data#start-of-content |
| https://github.com/ |
| Sign in | https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fbigcode-project%2Fbigcodebench%2Fcommits%2Fmain%2Fbigcodebench%2Fdata |
| GitHubRepository hosting, code review, and collaboration | https://github.com/platform |
| CopilotAI coding agent for tasks, projects, and automated work | https://github.com/features/copilot |
| ActionsCI/CD and automation | https://github.com/features/actions |
| Code QualityQuality analysis, fixes, and enforcement | https://github.com/features/code-quality |
| CodespacesCloud development environments | https://github.com/features/codespaces |
| Code SecurityVulnerability detection and remediation | https://github.com/security/advanced-security/code-security |
| Secret ProtectionSecret scanning and leak prevention | https://github.com/security/advanced-security/secret-protection |
| All Features | https://github.com/features |
| Documentation | https://docs.github.com/en |
| Training | https://learn.github.com/skills |
| Certifications | https://learn.github.com/credentials |
| Build with Copilot | https://github.com/features/ai |
| Customize Copilot | https://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview |
| Integrations | https://github.com/marketplace |
| Trending repos | https://github.com/trending |
| GitHub Sponsors | https://github.com/open-source/sponsors |
| Developer articles | https://github.com/resources/articles |
| ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place. | https://github.blog/changelog/ |
| Enterprises | https://github.com/enterprise |
| Team | https://github.com/team |
| Startups | https://github.com/enterprise/startups |
| Nonprofits | https://github.com/solutions/industry/nonprofits |
| Healthcare | https://github.com/solutions/industry/healthcare |
| Financial services | https://github.com/solutions/industry/financial-services |
| Manufacturing | https://github.com/solutions/industry/manufacturing |
| Government | https://github.com/solutions/industry/government |
| See all industries | https://github.com/solutions/industry |
| Why GitHub | https://github.com/why-github |
| Customer Stories | https://github.com/customer-stories |
| Business insights | https://github.com/solutions/executive-insights |
| Trust Center | https://github.com/trust-center |
| GitHub Advanced SecurityEnterprise-grade code security | https://github.com/security/advanced-security |
| Copilot for businessEnterprise-grade AI features | https://github.com/features/copilot/copilot-business |
| Premium SupportEnterprise-grade 24/7 support | https://github.com/enterprise/premium-support |
| Documentation | https://docs.github.com/en |
| Resource center | https://github.com/resources |
| Blog | https://github.blog/ |
| Events & webinars | https://github.com/resources/events |
| Community Forum | https://github.com/orgs/community/discussions |
| Customer Stories | https://github.com/customer-stories |
| Integrations | https://github.com/marketplace |
| Customer support | https://help.github.com/ |
| Training | https://learn.github.com/skills |
| GitHub Status | https://www.githubstatus.com/ |
| About | https://github.com/about |
| Partners | https://github.com/partners |
| Changelog | https://github.blog/changelog/ |
| GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub. | https://githubuniverse.com/ |
| Pricing | https://github.com/pricing |
| Sign in | https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fbigcode-project%2Fbigcodebench%2Fcommits%2Fmain%2Fbigcodebench%2Fdata |
| Sign up | https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fcommits%2Fshow&source=header-repo&source_repo=bigcode-project%2Fbigcodebench |
| Reload | https://github.com/bigcode-project/bigcodebench/commits/main/bigcodebench/data |
| Reload | https://github.com/bigcode-project/bigcodebench/commits/main/bigcodebench/data |
| Reload | https://github.com/bigcode-project/bigcodebench/commits/main/bigcodebench/data |
| bigcode-project | https://github.com/bigcode-project |
| bigcodebench | https://github.com/bigcode-project/bigcodebench |
| Code | https://github.com/bigcode-project/bigcodebench |
| Issues27 (27) | https://github.com/bigcode-project/bigcodebench/issues |
| Pull requests3 (3) | https://github.com/bigcode-project/bigcodebench/pulls |
| Actions | https://github.com/bigcode-project/bigcodebench/actions |
| Projects | https://github.com/bigcode-project/bigcodebench/projects |
| Security and quality | https://github.com/bigcode-project/bigcodebench/security |
| Insights | https://github.com/bigcode-project/bigcodebench/pulse |
| https://github.com/bigcode-project/bigcodebench |
| bigcodebench | https://github.com/bigcode-project/bigcodebench/commits |
| bigcodebench | https://github.com/bigcode-project/bigcodebench/commits/main/bigcodebench |
| data | https://github.com/bigcode-project/bigcodebench/commits/main/bigcodebench/data |
| main | https://github.com/bigcode-project/bigcodebench/tree/main |
| feat: use v0.1.4 dataset | https://github.com/bigcode-project/bigcodebench/commit/d8161d93d3a39395a5db50b71bdde25ac846f32f |
| https://github.com/terryyz |
| terryyz | https://github.com/bigcode-project/bigcodebench/commits?author=terryyz |
| d8161d9 | https://github.com/bigcode-project/bigcodebench/commit/d8161d93d3a39395a5db50b71bdde25ac846f32f |
| https://github.com/bigcode-project/bigcodebench/blob/d8161d93d3a39395a5db50b71bdde25ac846f32f/bigcodebench/data |
| https://github.com/bigcode-project/bigcodebench/tree/d8161d93d3a39395a5db50b71bdde25ac846f32f |
| release bigcodebench data 0.1.3 | https://github.com/bigcode-project/bigcodebench/commit/8cdcdfe6f720d3b245fd1acc5d52c781f4afdf3d |
| https://github.com/terryyz |
| terryyz | https://github.com/bigcode-project/bigcodebench/commits?author=terryyz |
| 8cdcdfe | https://github.com/bigcode-project/bigcodebench/commit/8cdcdfe6f720d3b245fd1acc5d52c781f4afdf3d |
| https://github.com/bigcode-project/bigcodebench/blob/8cdcdfe6f720d3b245fd1acc5d52c781f4afdf3d/bigcodebench/data |
| https://github.com/bigcode-project/bigcodebench/tree/8cdcdfe6f720d3b245fd1acc5d52c781f4afdf3d |
| feat: using datasets to load | https://github.com/bigcode-project/bigcodebench/commit/1e243647dfe02b7ce44ad4a3237cfc81fc4d5e69 |
| https://github.com/terryyz |
| terryyz | https://github.com/bigcode-project/bigcodebench/commits?author=terryyz |
| 1e24364 | https://github.com/bigcode-project/bigcodebench/commit/1e243647dfe02b7ce44ad4a3237cfc81fc4d5e69 |
| https://github.com/bigcode-project/bigcodebench/blob/1e243647dfe02b7ce44ad4a3237cfc81fc4d5e69/bigcodebench/data |
| https://github.com/bigcode-project/bigcodebench/tree/1e243647dfe02b7ce44ad4a3237cfc81fc4d5e69 |
| feat: refactor eval | https://github.com/bigcode-project/bigcodebench/commit/f4b5978f5254290021dee96c3cdb52514ed41ffd |
| https://github.com/terryyz |
| terryyz | https://github.com/bigcode-project/bigcodebench/commits?author=terryyz |
| f4b5978 | https://github.com/bigcode-project/bigcodebench/commit/f4b5978f5254290021dee96c3cdb52514ed41ffd |
| https://github.com/bigcode-project/bigcodebench/blob/f4b5978f5254290021dee96c3cdb52514ed41ffd/bigcodebench/data |
| https://github.com/bigcode-project/bigcodebench/tree/f4b5978f5254290021dee96c3cdb52514ed41ffd |
| fix: update bbcb version | https://github.com/bigcode-project/bigcodebench/commit/14205d7f04007a47ce4c0150cc15cc0117f4435a |
| https://github.com/terryyz |
| terryyz | https://github.com/bigcode-project/bigcodebench/commits?author=terryyz |
| 14205d7 | https://github.com/bigcode-project/bigcodebench/commit/14205d7f04007a47ce4c0150cc15cc0117f4435a |
| https://github.com/bigcode-project/bigcodebench/blob/14205d7f04007a47ce4c0150cc15cc0117f4435a/bigcodebench/data |
| https://github.com/bigcode-project/bigcodebench/tree/14205d7f04007a47ce4c0150cc15cc0117f4435a |
| fix: avoid duplicated save | https://github.com/bigcode-project/bigcodebench/commit/fc759a233d123f36587bbdadad6509babf000a75 |
| https://github.com/terryyz |
| terryyz | https://github.com/bigcode-project/bigcodebench/commits?author=terryyz |
| fc759a2 | https://github.com/bigcode-project/bigcodebench/commit/fc759a233d123f36587bbdadad6509babf000a75 |
| https://github.com/bigcode-project/bigcodebench/blob/fc759a233d123f36587bbdadad6509babf000a75/bigcodebench/data |
| https://github.com/bigcode-project/bigcodebench/tree/fc759a233d123f36587bbdadad6509babf000a75 |
| fix: update download name | https://github.com/bigcode-project/bigcodebench/commit/fdee310d15343d352da1d0292ffbb0b7e06b7646 |
| https://github.com/terryyz |
| terryyz | https://github.com/bigcode-project/bigcodebench/commits?author=terryyz |
| fdee310 | https://github.com/bigcode-project/bigcodebench/commit/fdee310d15343d352da1d0292ffbb0b7e06b7646 |
| https://github.com/bigcode-project/bigcodebench/blob/fdee310d15343d352da1d0292ffbb0b7e06b7646/bigcodebench/data |
| https://github.com/bigcode-project/bigcodebench/tree/fdee310d15343d352da1d0292ffbb0b7e06b7646 |
| uncomment | https://github.com/bigcode-project/bigcodebench/commit/259132248d53b44d683aac0b880e539b8b2d8440 |
| https://github.com/terryyz |
| terryyz | https://github.com/bigcode-project/bigcodebench/commits?author=terryyz |
| 2591322 | https://github.com/bigcode-project/bigcodebench/commit/259132248d53b44d683aac0b880e539b8b2d8440 |
| https://github.com/bigcode-project/bigcodebench/blob/259132248d53b44d683aac0b880e539b8b2d8440/bigcodebench/data |
| https://github.com/bigcode-project/bigcodebench/tree/259132248d53b44d683aac0b880e539b8b2d8440 |
| fix: add extra name in save ppath | https://github.com/bigcode-project/bigcodebench/commit/69d2e424b927dacb2ebf57e363cfed1e73f71842 |
| https://github.com/terryyz |
| terryyz | https://github.com/bigcode-project/bigcodebench/commits?author=terryyz |
| 69d2e42 | https://github.com/bigcode-project/bigcodebench/commit/69d2e424b927dacb2ebf57e363cfed1e73f71842 |
| https://github.com/bigcode-project/bigcodebench/blob/69d2e424b927dacb2ebf57e363cfed1e73f71842/bigcodebench/data |
| https://github.com/bigcode-project/bigcodebench/tree/69d2e424b927dacb2ebf57e363cfed1e73f71842 |
| fix: change default subset names | https://github.com/bigcode-project/bigcodebench/commit/ba1b36bd5d21bf410a074193e5af8ea31187c8a1 |
| https://github.com/terryyz |
| terryyz | https://github.com/bigcode-project/bigcodebench/commits?author=terryyz |
| ba1b36b | https://github.com/bigcode-project/bigcodebench/commit/ba1b36bd5d21bf410a074193e5af8ea31187c8a1 |
| https://github.com/bigcode-project/bigcodebench/blob/ba1b36bd5d21bf410a074193e5af8ea31187c8a1/bigcodebench/data |
| https://github.com/bigcode-project/bigcodebench/tree/ba1b36bd5d21bf410a074193e5af8ea31187c8a1 |
| fix: change subset namings | https://github.com/bigcode-project/bigcodebench/commit/f4f62b46108b5b52483e2e93612690d9c8bb0b46 |
| https://github.com/terryyz |
| terryyz | https://github.com/bigcode-project/bigcodebench/commits?author=terryyz |
| f4f62b4 | https://github.com/bigcode-project/bigcodebench/commit/f4f62b46108b5b52483e2e93612690d9c8bb0b46 |
| https://github.com/bigcode-project/bigcodebench/blob/f4f62b46108b5b52483e2e93612690d9c8bb0b46/bigcodebench/data |
| https://github.com/bigcode-project/bigcodebench/tree/f4f62b46108b5b52483e2e93612690d9c8bb0b46 |
| feat: rename subset | https://github.com/bigcode-project/bigcodebench/commit/fcaa7aa48b5b8206bc86e521b358d94ff82a0ccd |
| https://github.com/terryyz |
| terryyz | https://github.com/bigcode-project/bigcodebench/commits?author=terryyz |
| fcaa7aa | https://github.com/bigcode-project/bigcodebench/commit/fcaa7aa48b5b8206bc86e521b358d94ff82a0ccd |
| https://github.com/bigcode-project/bigcodebench/blob/fcaa7aa48b5b8206bc86e521b358d94ff82a0ccd/bigcodebench/data |
| https://github.com/bigcode-project/bigcodebench/tree/fcaa7aa48b5b8206bc86e521b358d94ff82a0ccd |
| feat: load hard data | https://github.com/bigcode-project/bigcodebench/commit/694d73cef1cc14f3c161c19ea6ee0002809c62b2 |
| https://github.com/terryyz |
| terryyz | https://github.com/bigcode-project/bigcodebench/commits?author=terryyz |
| 694d73c | https://github.com/bigcode-project/bigcodebench/commit/694d73cef1cc14f3c161c19ea6ee0002809c62b2 |
| https://github.com/bigcode-project/bigcodebench/blob/694d73cef1cc14f3c161c19ea6ee0002809c62b2/bigcodebench/data |
| https://github.com/bigcode-project/bigcodebench/tree/694d73cef1cc14f3c161c19ea6ee0002809c62b2 |
| fix: avoid empty data | https://github.com/bigcode-project/bigcodebench/commit/ce4831c927b66bb230e0636c1d13a98c836681b8 |
| https://github.com/terryyz |
| terryyz | https://github.com/bigcode-project/bigcodebench/commits?author=terryyz |
| ce4831c | https://github.com/bigcode-project/bigcodebench/commit/ce4831c927b66bb230e0636c1d13a98c836681b8 |
| https://github.com/bigcode-project/bigcodebench/blob/ce4831c927b66bb230e0636c1d13a98c836681b8/bigcodebench/data |
| https://github.com/bigcode-project/bigcodebench/tree/ce4831c927b66bb230e0636c1d13a98c836681b8 |
| refactor: hf download | https://github.com/bigcode-project/bigcodebench/commit/ad18063abb5a65db78a092bb3843b0a11ef612fa |
| https://github.com/terryyz |
| terryyz | https://github.com/bigcode-project/bigcodebench/commits?author=terryyz |
| ad18063 | https://github.com/bigcode-project/bigcodebench/commit/ad18063abb5a65db78a092bb3843b0a11ef612fa |
| https://github.com/bigcode-project/bigcodebench/blob/ad18063abb5a65db78a092bb3843b0a11ef612fa/bigcodebench/data |
| https://github.com/bigcode-project/bigcodebench/tree/ad18063abb5a65db78a092bb3843b0a11ef612fa |
| fix typos | https://github.com/bigcode-project/bigcodebench/commit/1a2919e45eee788fc089d4bd3bfd1d4143d85ae1 |
| https://github.com/terryyz |
| terryyz | https://github.com/bigcode-project/bigcodebench/commits?author=terryyz |
| 1a2919e | https://github.com/bigcode-project/bigcodebench/commit/1a2919e45eee788fc089d4bd3bfd1d4143d85ae1 |
| https://github.com/bigcode-project/bigcodebench/blob/1a2919e45eee788fc089d4bd3bfd1d4143d85ae1/bigcodebench/data |
| https://github.com/bigcode-project/bigcodebench/tree/1a2919e45eee788fc089d4bd3bfd1d4143d85ae1 |
| fix: remove raise | https://github.com/bigcode-project/bigcodebench/commit/37d25da13014794c06af9a25d0ba83a57cd7fb46 |
| https://github.com/terryyz |
| terryyz | https://github.com/bigcode-project/bigcodebench/commits?author=terryyz |
| 37d25da | https://github.com/bigcode-project/bigcodebench/commit/37d25da13014794c06af9a25d0ba83a57cd7fb46 |
| https://github.com/bigcode-project/bigcodebench/blob/37d25da13014794c06af9a25d0ba83a57cd7fb46/bigcodebench/data |
| https://github.com/bigcode-project/bigcodebench/tree/37d25da13014794c06af9a25d0ba83a57cd7fb46 |
| feat: add hf data | https://github.com/bigcode-project/bigcodebench/commit/c06dc5cbaba6b9472c30afe1570218e1871a0f44 |
| https://github.com/terryyz |
| terryyz | https://github.com/bigcode-project/bigcodebench/commits?author=terryyz |
| c06dc5c | https://github.com/bigcode-project/bigcodebench/commit/c06dc5cbaba6b9472c30afe1570218e1871a0f44 |
| https://github.com/bigcode-project/bigcodebench/blob/c06dc5cbaba6b9472c30afe1570218e1871a0f44/bigcodebench/data |
| https://github.com/bigcode-project/bigcodebench/tree/c06dc5cbaba6b9472c30afe1570218e1871a0f44 |
| fix: change data version | https://github.com/bigcode-project/bigcodebench/commit/697dabdb1daf6a4887276797ca0643e3a84db6f5 |
| https://github.com/terryyz |
| terryyz | https://github.com/bigcode-project/bigcodebench/commits?author=terryyz |
| 697dabd | https://github.com/bigcode-project/bigcodebench/commit/697dabdb1daf6a4887276797ca0643e3a84db6f5 |
| https://github.com/bigcode-project/bigcodebench/blob/697dabdb1daf6a4887276797ca0643e3a84db6f5/bigcodebench/data |
| https://github.com/bigcode-project/bigcodebench/tree/697dabdb1daf6a4887276797ca0643e3a84db6f5 |
| init: rename the pack | https://github.com/bigcode-project/bigcodebench/commit/8fd29ee050fd49b45ec0025f4e103fa82e53103e |
| https://github.com/terryyz |
| terryyz | https://github.com/bigcode-project/bigcodebench/commits?author=terryyz |
| 8fd29ee | https://github.com/bigcode-project/bigcodebench/commit/8fd29ee050fd49b45ec0025f4e103fa82e53103e |
| https://github.com/bigcode-project/bigcodebench/blob/8fd29ee050fd49b45ec0025f4e103fa82e53103e/bigcodebench/data |
| https://github.com/bigcode-project/bigcodebench/tree/8fd29ee050fd49b45ec0025f4e103fa82e53103e |
|
| https://github.com |
| Terms | https://docs.github.com/site-policy/github-terms/github-terms-of-service |
| Privacy | https://docs.github.com/site-policy/privacy-policies/github-privacy-statement |
| Security | https://github.com/security |
| Status | https://www.githubstatus.com/ |
| Community | https://github.community/ |
| Docs | https://docs.github.com/ |
| Contact | https://support.github.com?tags=dotcom-footer |