René's URL Explorer Experiment


Title: GitHub - abacaj/code-eval: Run evaluation on LLMs using human-eval benchmark

Open Graph Title: GitHub - abacaj/code-eval: Run evaluation on LLMs using human-eval benchmark

X Title: GitHub - abacaj/code-eval: Run evaluation on LLMs using human-eval benchmark

Description: Run evaluation on LLMs using human-eval benchmark. Contribute to abacaj/code-eval development by creating an account on GitHub.

Open Graph Description: Run evaluation on LLMs using human-eval benchmark. Contribute to abacaj/code-eval development by creating an account on GitHub.

X Description: Run evaluation on LLMs using human-eval benchmark. Contribute to abacaj/code-eval development by creating an account on GitHub.

Opengraph URL: https://github.com/abacaj/code-eval

X: @github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:3036d264-f055-e88b-27b8-760d66718659
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-idB5B2:15F9EF:2BBCD5:3C231B:6982F4C8
html-safe-nonce9007f7d3b7444f421e9e949aefd1f9fe5d32522bb700d49ebe8e6e522d9030a2
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCNUIyOjE1RjlFRjoyQkJDRDU6M0MyMzFCOjY5ODJGNEM4IiwidmlzaXRvcl9pZCI6IjE5ODM5MzcwODkwNDkzOTIzMjgiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmac118cfe455fbbb4c77152064f84d063a0fe223f8f61ced472ea82d4976c828419
hovercard-subject-tagrepository:661130724
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/abacaj/code-eval
twitter:imagehttps://repository-images.githubusercontent.com/661130724/09bc4ddb-1d4f-4339-9c0e-281d19d59cea
twitter:cardsummary_large_image
og:imagehttps://repository-images.githubusercontent.com/661130724/09bc4ddb-1d4f-4339-9c0e-281d19d59cea
og:image:altRun evaluation on LLMs using human-eval benchmark. Contribute to abacaj/code-eval development by creating an account on GitHub.
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Nonec6741528aa4d4ba81c57bbff8f8cc0de0e9115cb2993431dc9dac8d489f7b4ee
turbo-cache-controlno-preview
go-importgithub.com/abacaj/code-eval git https://github.com/abacaj/code-eval.git
octolytics-dimension-user_id7272343
octolytics-dimension-user_loginabacaj
octolytics-dimension-repository_id661130724
octolytics-dimension-repository_nwoabacaj/code-eval
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id661130724
octolytics-dimension-repository_network_root_nwoabacaj/code-eval
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
releasedf2a3cea9cc9adaf422cd462f5351935c407af4d
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://patch-diff.githubusercontent.com/abacaj/code-eval#start-of-content
https://patch-diff.githubusercontent.com/
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Fabacaj%2Fcode-eval
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Fabacaj%2Fcode-eval
Sign up https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=abacaj%2Fcode-eval
Reloadhttps://patch-diff.githubusercontent.com/abacaj/code-eval
Reloadhttps://patch-diff.githubusercontent.com/abacaj/code-eval
Reloadhttps://patch-diff.githubusercontent.com/abacaj/code-eval
abacaj https://patch-diff.githubusercontent.com/abacaj
code-evalhttps://patch-diff.githubusercontent.com/abacaj/code-eval
Notifications https://patch-diff.githubusercontent.com/login?return_to=%2Fabacaj%2Fcode-eval
Fork 37 https://patch-diff.githubusercontent.com/login?return_to=%2Fabacaj%2Fcode-eval
Star 426 https://patch-diff.githubusercontent.com/login?return_to=%2Fabacaj%2Fcode-eval
MIT license https://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/LICENSE
426 stars https://patch-diff.githubusercontent.com/abacaj/code-eval/stargazers
37 forks https://patch-diff.githubusercontent.com/abacaj/code-eval/forks
Branches https://patch-diff.githubusercontent.com/abacaj/code-eval/branches
Tags https://patch-diff.githubusercontent.com/abacaj/code-eval/tags
Activity https://patch-diff.githubusercontent.com/abacaj/code-eval/activity
Star https://patch-diff.githubusercontent.com/login?return_to=%2Fabacaj%2Fcode-eval
Notifications https://patch-diff.githubusercontent.com/login?return_to=%2Fabacaj%2Fcode-eval
Code https://patch-diff.githubusercontent.com/abacaj/code-eval
Issues 5 https://patch-diff.githubusercontent.com/abacaj/code-eval/issues
Pull requests 0 https://patch-diff.githubusercontent.com/abacaj/code-eval/pulls
Discussions https://patch-diff.githubusercontent.com/abacaj/code-eval/discussions
Actions https://patch-diff.githubusercontent.com/abacaj/code-eval/actions
Projects 0 https://patch-diff.githubusercontent.com/abacaj/code-eval/projects
Security 0 https://patch-diff.githubusercontent.com/abacaj/code-eval/security
Insights https://patch-diff.githubusercontent.com/abacaj/code-eval/pulse
Code https://patch-diff.githubusercontent.com/abacaj/code-eval
Issues https://patch-diff.githubusercontent.com/abacaj/code-eval/issues
Pull requests https://patch-diff.githubusercontent.com/abacaj/code-eval/pulls
Discussions https://patch-diff.githubusercontent.com/abacaj/code-eval/discussions
Actions https://patch-diff.githubusercontent.com/abacaj/code-eval/actions
Projects https://patch-diff.githubusercontent.com/abacaj/code-eval/projects
Security https://patch-diff.githubusercontent.com/abacaj/code-eval/security
Insights https://patch-diff.githubusercontent.com/abacaj/code-eval/pulse
Brancheshttps://patch-diff.githubusercontent.com/abacaj/code-eval/branches
Tagshttps://patch-diff.githubusercontent.com/abacaj/code-eval/tags
https://patch-diff.githubusercontent.com/abacaj/code-eval/branches
https://patch-diff.githubusercontent.com/abacaj/code-eval/tags
76 Commitshttps://patch-diff.githubusercontent.com/abacaj/code-eval/commits/main/
https://patch-diff.githubusercontent.com/abacaj/code-eval/commits/main/
corehttps://patch-diff.githubusercontent.com/abacaj/code-eval/tree/main/core
corehttps://patch-diff.githubusercontent.com/abacaj/code-eval/tree/main/core
human-evalhttps://patch-diff.githubusercontent.com/abacaj/code-eval/tree/main/human-eval
human-evalhttps://patch-diff.githubusercontent.com/abacaj/code-eval/tree/main/human-eval
.gitignorehttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/.gitignore
.gitignorehttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/.gitignore
LICENSEhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/LICENSE
LICENSEhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/LICENSE
README.mdhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/README.md
README.mdhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/README.md
eval_codet5.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_codet5.py
eval_codet5.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_codet5.py
eval_llama.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_llama.py
eval_llama.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_llama.py
eval_mpt.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_mpt.py
eval_mpt.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_mpt.py
eval_mpt_large.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_mpt_large.py
eval_mpt_large.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_mpt_large.py
eval_opencode.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_opencode.py
eval_opencode.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_opencode.py
eval_openllama.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_openllama.py
eval_openllama.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_openllama.py
eval_replit.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_replit.py
eval_replit.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_replit.py
eval_replit_glaive.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_replit_glaive.py
eval_replit_glaive.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_replit_glaive.py
eval_replit_instruct.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_replit_instruct.py
eval_replit_instruct.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_replit_instruct.py
eval_starcoder.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_starcoder.py
eval_starcoder.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_starcoder.py
eval_wizard.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_wizard.py
eval_wizard.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_wizard.py
eval_xgen.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_xgen.py
eval_xgen.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/eval_xgen.py
process_eval.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/process_eval.py
process_eval.pyhttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/process_eval.py
requirements.txthttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/requirements.txt
requirements.txthttps://patch-diff.githubusercontent.com/abacaj/code-eval/blob/main/requirements.txt
READMEhttps://patch-diff.githubusercontent.com/abacaj/code-eval
MIT licensehttps://patch-diff.githubusercontent.com/abacaj/code-eval
https://patch-diff.githubusercontent.com/abacaj/code-eval#code-eval
https://patch-diff.githubusercontent.com/abacaj/code-eval#what
process_eval.pyhttps://github.com/nlpxucan/WizardLM/blob/main/WizardCoder/src/process_humaneval.py
https://patch-diff.githubusercontent.com/abacaj/code-eval#results
sahil2801/replit-code-instruct-glaivehttps://huggingface.co/sahil2801/replit-code-instruct-glaive
https://private-user-images.githubusercontent.com/7272343/250624643-6fd7527d-0dc4-4b48-8a57-ad0373074bc5.PNG?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NzAxOTAzMjQsIm5iZiI6MTc3MDE5MDAyNCwicGF0aCI6Ii83MjcyMzQzLzI1MDYyNDY0My02ZmQ3NTI3ZC0wZGM0LTRiNDgtOGE1Ny1hZDAzNzMwNzRiYzUuUE5HP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI2MDIwNCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNjAyMDRUMDcyNzA0WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9MWVkMGFlN2I3ZDBjNTExMTJlODRiMGU5YTZhOWUzM2RmZTgyZDA4MDc3ZTEwZjczNWUwMzliYmUxYTYyNGI5MCZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.8AcgigbKhvTYRbRzeOLNbFlskVPxNIVF-aJ1_bvEv0M
WizardCoder-15B-V1.0https://huggingface.co/WizardLM/WizardCoder-15B-V1.0
https://private-user-images.githubusercontent.com/7272343/250331874-0b941ff8-b474-4236-bbc0-89d925bbd34e.PNG?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NzAxOTAzMjQsIm5iZiI6MTc3MDE5MDAyNCwicGF0aCI6Ii83MjcyMzQzLzI1MDMzMTg3NC0wYjk0MWZmOC1iNDc0LTQyMzYtYmJjMC04OWQ5MjViYmQzNGUuUE5HP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI2MDIwNCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNjAyMDRUMDcyNzA0WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9ZTI1Y2VmZTJmY2EzMGQxNWY3Yjg3ODViYzBjNjhlNGQ0NzYzMGMwZjI3MjY2OTMwM2ZmODlhNDZhYThmYzllMSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.n7rJBAz2NFJEDhz0F7mElpCfYXlV8oRlLN8dBADhbH8
bigcode/starcoderhttps://huggingface.co/bigcode/starcoder
https://private-user-images.githubusercontent.com/7272343/250585229-eb5df978-f56b-4557-a433-8b8fa863a059.PNG?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NzAxOTAzMjQsIm5iZiI6MTc3MDE5MDAyNCwicGF0aCI6Ii83MjcyMzQzLzI1MDU4NTIyOS1lYjVkZjk3OC1mNTZiLTQ1NTctYTQzMy04YjhmYTg2M2EwNTkuUE5HP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI2MDIwNCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNjAyMDRUMDcyNzA0WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9NzliMDk3YzNjNTJlYzJjYTkyOGU5NzE1ODQyOGZlMmQ2OWI5MWJhYTM1OTBhMWMzNzcwMzU1YTBlNzY2ZGM0NSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.LOYLf2VmyC6enW0b8KAa9vuxM7n1ReFc52sIpCMcF0o
openchat/opencoderplushttps://huggingface.co/openchat/opencoderplus
https://private-user-images.githubusercontent.com/7272343/250442879-1fa9f5ef-941b-4ea8-981e-c3f258c03fee.PNG?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NzAxOTAzMjQsIm5iZiI6MTc3MDE5MDAyNCwicGF0aCI6Ii83MjcyMzQzLzI1MDQ0Mjg3OS0xZmE5ZjVlZi05NDFiLTRlYTgtOTgxZS1jM2YyNThjMDNmZWUuUE5HP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI2MDIwNCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNjAyMDRUMDcyNzA0WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9Nzg1NDIxZjI0YTBjZTEwMTliYjAyNzU0NzExNzU0NzNjNzMzOWM0YTMxYzY3NjViZGVjODdiOWQ1NWZiNzZiMiZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.jY8eY-6EbFlQ7ALTCdLzFPVh1AHPLvWaEGmAAWtn9_Q
teknium/Replit-v1-CodeInstruct-3Bhttps://huggingface.co/teknium/Replit-v1-CodeInstruct-3B
https://private-user-images.githubusercontent.com/7272343/250414712-4fca98d8-2c22-43ce-9639-e998ecb4fedc.PNG?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NzAxOTAzMjQsIm5iZiI6MTc3MDE5MDAyNCwicGF0aCI6Ii83MjcyMzQzLzI1MDQxNDcxMi00ZmNhOThkOC0yYzIyLTQzY2UtOTYzOS1lOTk4ZWNiNGZlZGMuUE5HP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI2MDIwNCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNjAyMDRUMDcyNzA0WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9MDFhYzdjMzUzMmExMzRiMjkzNDdlZWVmYWU2NmExMTljNmZkYmZjZDdkOTgxNzk3NzAxYTJjMDQ1OWRkYzBiNyZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.5KW-Q9dpQLSU4cm3d8vSGZtfbvwI_6anM4oK3g7-45w
teknium/Replit-v2-CodeInstruct-3Bhttps://huggingface.co/teknium/Replit-v2-CodeInstruct-3B
https://private-user-images.githubusercontent.com/7272343/250415812-655aaa1d-0715-4fcd-b9ba-a22b5fddb215.PNG?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NzAxOTAzMjQsIm5iZiI6MTc3MDE5MDAyNCwicGF0aCI6Ii83MjcyMzQzLzI1MDQxNTgxMi02NTVhYWExZC0wNzE1LTRmY2QtYjliYS1hMjJiNWZkZGIyMTUuUE5HP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI2MDIwNCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNjAyMDRUMDcyNzA0WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9OTRhZmY1ZjNiZmMwYjM0ZGJmZTFiMzNjMDIzYmUyMjQzYzU4ZWIxZGZjOWJkMzVkOGY0Nzg5MTQ1YTVlZTY3YiZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.e-G570k71uWa6JjC-O7eUqBT4XwVWcxWi9odK7emM6I
replit-code-v1-3bhttps://huggingface.co/replit/replit-code-v1-3b
https://private-user-images.githubusercontent.com/7272343/251044492-6b387aa8-db60-4f04-b458-35b010b1145c.PNG?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NzAxOTAzMjQsIm5iZiI6MTc3MDE5MDAyNCwicGF0aCI6Ii83MjcyMzQzLzI1MTA0NDQ5Mi02YjM4N2FhOC1kYjYwLTRmMDQtYjQ1OC0zNWIwMTBiMTE0NWMuUE5HP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI2MDIwNCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNjAyMDRUMDcyNzA0WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9MGI2MGRkMmUzYTQwYjlmMmUwNTQ4OGMzYmFkOGJhNTlkNjliMjUwMzc3ZDEyNmQ5OWFmOWRmMzk0MTAzZmQxOCZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.tVmA9y1lbDAiwHUdJYybNlBEW-LNX-c9Ol6vGqV3tUg
mpt-7bhttps://huggingface.co/mosaicml/mpt-7b
https://private-user-images.githubusercontent.com/7272343/251044461-16965905-a368-4254-aeab-5e44126eba84.PNG?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NzAxOTAzMjQsIm5iZiI6MTc3MDE5MDAyNCwicGF0aCI6Ii83MjcyMzQzLzI1MTA0NDQ2MS0xNjk2NTkwNS1hMzY4LTQyNTQtYWVhYi01ZTQ0MTI2ZWJhODQuUE5HP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI2MDIwNCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNjAyMDRUMDcyNzA0WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9NDk4OTg3OTQ4YjlmZmI5MzdlZjgyNTc1ZjJjZGZiMzRiZjNmNTFlYjA4OWM2MjczYTlkNDc1YjkxMjA5YzNjZCZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.5YByTZVwghgftFOtcYpTI0Lyu5GYI-nWIxx_FjKNBkg
xgen-7b-8k-basehttps://huggingface.co/Salesforce/xgen-7b-8k-base
https://private-user-images.githubusercontent.com/7272343/251044512-995c84a9-ee69-43bf-8502-a74eba1d927a.PNG?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NzAxOTAzMjQsIm5iZiI6MTc3MDE5MDAyNCwicGF0aCI6Ii83MjcyMzQzLzI1MTA0NDUxMi05OTVjODRhOS1lZTY5LTQzYmYtODUwMi1hNzRlYmExZDkyN2EuUE5HP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI2MDIwNCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNjAyMDRUMDcyNzA0WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9NzRmZGJkNGQ3ZGZlMTgxMDg0ZmI1Y2E2NjFhNzdkOWJlMDBjZWM0OWE2N2Y2ODQxODNlNjE1MWRiMDZhOTZkNyZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ._1vRLkPgv3bpt2cH9mwvlNWQCV0PV7F7gIuJF9Avgyo
openllama-7b-v2https://huggingface.co/openlm-research/open_llama_7b
https://private-user-images.githubusercontent.com/7272343/252436423-e38f08a0-ae74-4c51-b3a7-638781477e1b.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NzAxOTAzMjQsIm5iZiI6MTc3MDE5MDAyNCwicGF0aCI6Ii83MjcyMzQzLzI1MjQzNjQyMy1lMzhmMDhhMC1hZTc0LTRjNTEtYjNhNy02Mzg3ODE0NzdlMWIucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI2MDIwNCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNjAyMDRUMDcyNzA0WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9Mzc4MDc3M2YyMjAxNDA2YTc5YjJiNGIyNDM5ZDM3ZDU0YTU1NjFmOWViYjFlZjg2MTNkZDA1Nzk5NTIzZWQ4NiZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.tua7tJXJPcDxMJtnFAwNEFq78i46udHNlkF5mi70jv8
llama-2-7bhttps://huggingface.co/meta-llama/Llama-2-7b-hf
https://private-user-images.githubusercontent.com/7272343/254734570-cc86cc7c-beac-4993-9ca3-d91a48a790e4.PNG?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NzAxOTAzMjQsIm5iZiI6MTc3MDE5MDAyNCwicGF0aCI6Ii83MjcyMzQzLzI1NDczNDU3MC1jYzg2Y2M3Yy1iZWFjLTQ5OTMtOWNhMy1kOTFhNDhhNzkwZTQuUE5HP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI2MDIwNCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNjAyMDRUMDcyNzA0WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9YWRjZjg2ZDVlNDllNWRmMTQ5ZWU3ZmE2NTk0ZDNjZGIwOTk5ZWVkOGZhZDE0Njg5ZmU1YmNhOTUyZTJhYzgxYyZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.1incnnegtFqmYlg8NlVU5iDO09IHyt1tp_Pk7gT2ROM
llama-7bhttps://huggingface.co/huggyllama/llama-7b
https://private-user-images.githubusercontent.com/7272343/252506793-605a3c4e-0b2b-4c10-a185-f2a4d34ec10d.PNG?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NzAxOTAzMjQsIm5iZiI6MTc3MDE5MDAyNCwicGF0aCI6Ii83MjcyMzQzLzI1MjUwNjc5My02MDVhM2M0ZS0wYjJiLTRjMTAtYTE4NS1mMmE0ZDM0ZWMxMGQuUE5HP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI2MDIwNCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNjAyMDRUMDcyNzA0WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9MzEyNjk4YzI2NWQxMmIwYzhmZWNiOGRjYmMxMTZhMDgxOWRmYjQxYjJlMWJhZThlN2ZjOGY0ZThhMzE5NDAxYSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.LTm_dHKxF13faaDmlJhjAobO7gPzKsVNVn3N8DIONNA
mpt-30bhttps://huggingface.co/mosaicml/mpt-30b
https://patch-diff.githubusercontent.com/abacaj/code-eval#faq
https://patch-diff.githubusercontent.com/abacaj/code-eval#setup
humaneval https://patch-diff.githubusercontent.com/topics/humaneval
wizardcoder https://patch-diff.githubusercontent.com/topics/wizardcoder
Readme https://patch-diff.githubusercontent.com/abacaj/code-eval#readme-ov-file
MIT license https://patch-diff.githubusercontent.com/abacaj/code-eval#MIT-1-ov-file
Please reload this pagehttps://patch-diff.githubusercontent.com/abacaj/code-eval
Activityhttps://patch-diff.githubusercontent.com/abacaj/code-eval/activity
426 starshttps://patch-diff.githubusercontent.com/abacaj/code-eval/stargazers
9 watchinghttps://patch-diff.githubusercontent.com/abacaj/code-eval/watchers
37 forkshttps://patch-diff.githubusercontent.com/abacaj/code-eval/forks
Report repository https://patch-diff.githubusercontent.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fabacaj%2Fcode-eval&report=abacaj+%28user%29
Releaseshttps://patch-diff.githubusercontent.com/abacaj/code-eval/releases
Packages 0https://patch-diff.githubusercontent.com/users/abacaj/packages?repo_name=code-eval
Please reload this pagehttps://patch-diff.githubusercontent.com/abacaj/code-eval
Python 100.0% https://patch-diff.githubusercontent.com/abacaj/code-eval/search?l=python
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.