Title: Add support for tensor buffer overrides by google-labs-jules[bot] · Pull Request #1 · 708-145/llama-cpp-python · GitHub
Open Graph Title: Add support for tensor buffer overrides by google-labs-jules[bot] · Pull Request #1 · 708-145/llama-cpp-python
X Title: Add support for tensor buffer overrides by google-labs-jules[bot] · Pull Request #1 · 708-145/llama-cpp-python
Description: Implemented support for -ot (override tensor) functionality via tensor_buft_overrides named parameter in Llama class. This allows specifying which buffer type (CPU, CUDA, Metal) to use for specific...
Open Graph Description: Implemented support for -ot (override tensor) functionality via tensor_buft_overrides named parameter in Llama class. This allows specifying which buffer type (CPU, CUDA, Metal) to use for specific...
X Description: Implemented support for -ot (override tensor) functionality via tensor_buft_overrides named parameter in Llama class. This allows specifying which buffer type (CPU, CUDA, Metal) to use for specific...
Opengraph URL: https://github.com/708-145/llama-cpp-python/pull/1
X: @github
Domain: patch-diff.githubusercontent.com
| route-pattern | /_view_fragments/voltron/pull_requests/show/:user_id/:repository/:id/pull_request_layout(.:format) |
| route-controller | voltron_pull_requests_fragments |
| route-action | pull_request_layout |
| fetch-nonce | v2:d0ba8b5a-9921-0868-c420-52bc82b9ec0c |
| current-catalog-service-hash | ae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b |
| request-id | 845A:1625C5:AB3F168:DDDFAF6:69765E75 |
| html-safe-nonce | a262e5fea6ecfe6f2138a596926d7f86720406e809acdc1546199f19c4744bf7 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4NDVBOjE2MjVDNTpBQjNGMTY4OkREREZBRjY6Njk3NjVFNzUiLCJ2aXNpdG9yX2lkIjoiNTg3Mzk5NTk0Mzc4NjIwODg4NSIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | 7367612c3b670db35b7dc0dcd05dd25472303269e9f6e40a367d477e9a4bd2fa |
| hovercard-subject-tag | pull_request:3055939310 |
| github-keyboard-shortcuts | repository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/voltron/pull_requests/show/708-145/llama-cpp-python/1/pull_request_layout |
| twitter:image | https://opengraph.githubassets.com/7f1b25790bdec36ee3d5681ce675e739b9c16b8843cf707e216a848bd3db54a5/708-145/llama-cpp-python/pull/1 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/7f1b25790bdec36ee3d5681ce675e739b9c16b8843cf707e216a848bd3db54a5/708-145/llama-cpp-python/pull/1 |
| og:image:alt | Implemented support for -ot (override tensor) functionality via tensor_buft_overrides named parameter in Llama class. This allows specifying which buffer type (CPU, CUDA, Metal) to use for specific... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | google-labs-jules[bot] |
| hostname | github.com |
| expected-hostname | github.com |
| None | 032152924a283b83384255d9489e7b93b54ba01da8d380b05ecd3953b3212411 |
| turbo-cache-control | no-preview |
| go-import | github.com/708-145/llama-cpp-python git https://github.com/708-145/llama-cpp-python.git |
| octolytics-dimension-user_id | 40387547 |
| octolytics-dimension-user_login | 708-145 |
| octolytics-dimension-repository_id | 1084593556 |
| octolytics-dimension-repository_nwo | 708-145/llama-cpp-python |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | true |
| octolytics-dimension-repository_parent_id | 617868717 |
| octolytics-dimension-repository_parent_nwo | abetlen/llama-cpp-python |
| octolytics-dimension-repository_network_root_id | 617868717 |
| octolytics-dimension-repository_network_root_nwo | abetlen/llama-cpp-python |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 5b577f6be6482e336e3c30e8daefa30144947b17 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width