Title: GitHub - Peterc3-dev/kv-compressor: Algorithmic study of sub-fp16 KV cache compression on shared-memory mobile SoCs. Documented negative result: scalar sign+magnitude (incl. outlier extraction + 2-bit) insufficient vs KIVI. Cos sim shown unreliable for KV-quant PPL. · GitHub
Open Graph Title: GitHub - Peterc3-dev/kv-compressor: Algorithmic study of sub-fp16 KV cache compression on shared-memory mobile SoCs. Documented negative result: scalar sign+magnitude (incl. outlier extraction + 2-bit) insufficient vs KIVI. Cos sim shown unreliable for KV-quant PPL.
X Title: GitHub - Peterc3-dev/kv-compressor: Algorithmic study of sub-fp16 KV cache compression on shared-memory mobile SoCs. Documented negative result: scalar sign+magnitude (incl. outlier extraction + 2-bit) insufficient vs KIVI. Cos sim shown unreliable for KV-quant PPL.
Description: Algorithmic study of sub-fp16 KV cache compression on shared-memory mobile SoCs. Documented negative result: scalar sign+magnitude (incl. outlier extraction + 2-bit) insufficient vs KIVI. Cos sim shown unreliable for KV-quant PPL. - Peterc3-dev/kv-compressor
Open Graph Description: Algorithmic study of sub-fp16 KV cache compression on shared-memory mobile SoCs. Documented negative result: scalar sign+magnitude (incl. outlier extraction + 2-bit) insufficient vs KIVI. Cos sim s...
X Description: Algorithmic study of sub-fp16 KV cache compression on shared-memory mobile SoCs. Documented negative result: scalar sign+magnitude (incl. outlier extraction + 2-bit) insufficient vs KIVI. Cos sim s...
Opengraph URL: https://github.com/Peterc3-dev/kv-compressor
X: @github
Domain: github.com
| route-pattern | /:user_id/:repository |
| route-controller | files |
| route-action | disambiguate |
| fetch-nonce | v2:7dde384e-ae95-0311-d06d-941dbbfbee7b |
| current-catalog-service-hash | f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb |
| request-id | A226:8DE5B:129C2B:187905:6A4C244D |
| html-safe-nonce | f9e9b317d5f11c7549338615be8c3b1f7de58e95f1a3b3c3be9cbfe662cc4f7a |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBMjI2OjhERTVCOjEyOUMyQjoxODc5MDU6NkE0QzI0NEQiLCJ2aXNpdG9yX2lkIjoiNzkwMDY1OTg2Mzk1NjIzNTM0MSIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | b5549468eb996acc0b596688cac080211d4c276f3ef761748176524978b1bf10 |
| hovercard-subject-tag | repository:1222750483 |
| github-keyboard-shortcuts | repository,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/Peterc3-dev/kv-compressor |
| twitter:image | https://opengraph.githubassets.com/4cbbf65d70881764ea118418482eab95cd250fc2d8302e2028b4a12bac4ffbe9/Peterc3-dev/kv-compressor |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/4cbbf65d70881764ea118418482eab95cd250fc2d8302e2028b4a12bac4ffbe9/Peterc3-dev/kv-compressor |
| og:image:alt | Algorithmic study of sub-fp16 KV cache compression on shared-memory mobile SoCs. Documented negative result: scalar sign+magnitude (incl. outlier extraction + 2-bit) insufficient vs KIVI. Cos sim s... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | 1b6b16d04026f131a36d57e3b01d0f4d26a51800edf48bf5ed0256e0ac905511 |
| turbo-cache-control | no-cache |
| go-import | github.com/Peterc3-dev/kv-compressor git https://github.com/Peterc3-dev/kv-compressor.git |
| octolytics-dimension-user_id | 255009866 |
| octolytics-dimension-user_login | Peterc3-dev |
| octolytics-dimension-repository_id | 1222750483 |
| octolytics-dimension-repository_nwo | Peterc3-dev/kv-compressor |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 1222750483 |
| octolytics-dimension-repository_network_root_nwo | Peterc3-dev/kv-compressor |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 9ee13484b32cf23e15fde191da4c9aa47d41201c |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width