Title: Inference with Starcoder model finetuned by lora · Issue #18 · bigcode-project/starcoder.cpp · GitHub
Open Graph Title: Inference with Starcoder model finetuned by lora · Issue #18 · bigcode-project/starcoder.cpp
X Title: Inference with Starcoder model finetuned by lora · Issue #18 · bigcode-project/starcoder.cpp
Description: Hi, Can you give some advice about how to inference finetuned Starcoder model with this code? Since lora finetune changed some of layers of the model, some of the code in starcoder.cpp should be changed, how can I use this code to infere...
Open Graph Description: Hi, Can you give some advice about how to inference finetuned Starcoder model with this code? Since lora finetune changed some of layers of the model, some of the code in starcoder.cpp should be ch...
X Description: Hi, Can you give some advice about how to inference finetuned Starcoder model with this code? Since lora finetune changed some of layers of the model, some of the code in starcoder.cpp should be ch...
Opengraph URL: https://github.com/bigcode-project/starcoder.cpp/issues/18
X: @github
Domain: patch-diff.githubusercontent.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Inference with Starcoder model finetuned by lora","articleBody":"Hi, Can you give some advice about how to inference finetuned Starcoder model with this code? Since lora finetune changed some of layers of the model, some of the code in starcoder.cpp should be changed, how can I use this code to inference with my finetuned Starcoder model?","author":{"url":"https://github.com/edwardelric1202","@type":"Person","name":"edwardelric1202"},"datePublished":"2023-06-06T09:15:12.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":1},"url":"https://github.com/18/starcoder.cpp/issues/18"}| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:b31e4e7d-e7c6-af83-8c4c-673576e2a5eb |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | 9846:2F3C5F:2B26B39:3A28FFB:6970547C |
| html-safe-nonce | 64c42f2e4ecbfc605908d5485ad029bb44e68667ba723de02be30de71780517f |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI5ODQ2OjJGM0M1RjoyQjI2QjM5OjNBMjhGRkI6Njk3MDU0N0MiLCJ2aXNpdG9yX2lkIjoiNzkyOTY1MTMwNTUwNjY5MDE3MiIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | 3fbcaf8f5861d63e86993d77ff266492783c37f567f909b7489f39348c393f64 |
| hovercard-subject-tag | issue:1743438347 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/bigcode-project/starcoder.cpp/18/issue_layout |
| twitter:image | https://opengraph.githubassets.com/03a7c679b0894d56a0f6424e4ea860ddcdbef1a5a37c6b97334e5c990ae3acd8/bigcode-project/starcoder.cpp/issues/18 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/03a7c679b0894d56a0f6424e4ea860ddcdbef1a5a37c6b97334e5c990ae3acd8/bigcode-project/starcoder.cpp/issues/18 |
| og:image:alt | Hi, Can you give some advice about how to inference finetuned Starcoder model with this code? Since lora finetune changed some of layers of the model, some of the code in starcoder.cpp should be ch... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | edwardelric1202 |
| hostname | github.com |
| expected-hostname | github.com |
| None | 9920a62ba22d06470388e2904804fb7e5ec51c9e35f81784e9191394c74b2bd2 |
| turbo-cache-control | no-preview |
| go-import | github.com/bigcode-project/starcoder.cpp git https://github.com/bigcode-project/starcoder.cpp.git |
| octolytics-dimension-user_id | 110470554 |
| octolytics-dimension-user_login | bigcode-project |
| octolytics-dimension-repository_id | 640843237 |
| octolytics-dimension-repository_nwo | bigcode-project/starcoder.cpp |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 640843237 |
| octolytics-dimension-repository_network_root_nwo | bigcode-project/starcoder.cpp |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | f643964067a552f02067066d6a910b2f90a5721f |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width