Title: Pull requests · airnsk/proxycache · GitHub
Open Graph Title: Pull requests · airnsk/proxycache
X Title: Pull requests · airnsk/proxycache
Description: Smart OpenAI‑compatible proxy for llama.cpp: manages slots, saves/restores KV cache to disk, routes requests by prefix similarity, and protects hot slots from being overwritten. Accelerates long prompts (30–60k tokens) via instant reuse or fast on‑demand restore; supports SSE streaming and non‑stream JSON over /v1/chat/completions. - Pull requests · airnsk/proxycache
Open Graph Description: Smart OpenAI‑compatible proxy for llama.cpp: manages slots, saves/restores KV cache to disk, routes requests by prefix similarity, and protects hot slots from being overwritten. Accelerates long pr...
X Description: Smart OpenAI‑compatible proxy for llama.cpp: manages slots, saves/restores KV cache to disk, routes requests by prefix similarity, and protects hot slots from being overwritten. Accelerates long pr...
Opengraph URL: https://github.com/airnsk/proxycache
X: @github
Domain: github.com
| route-pattern | /:user_id/:repository/pulls(.:format) |
| route-controller | pull_requests |
| route-action | index |
| fetch-nonce | v2:05f6f91f-50cf-d80f-7c71-63404d5625ba |
| current-catalog-service-hash | ae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b |
| request-id | 9306:10077:128D934:190E8A7:6A5952C1 |
| html-safe-nonce | 9f0fab45bd048caea11faa2f47a749ef00215a59351d27ba463b39c876c4224f |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI5MzA2OjEwMDc3OjEyOEQ5MzQ6MTkwRThBNzo2QTU5NTJDMSIsInZpc2l0b3JfaWQiOiI4MDA5ODk5NjM4NDE2NTYwODMzIiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0= |
| visitor-hmac | 6d0145a00f06acd27ec3632ea403e839d4de5db5e7c64f229f2b71d23d946890 |
| hovercard-subject-tag | repository:1093027462 |
| github-keyboard-shortcuts | repository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location-query-strip | true |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/airnsk/proxycache/pulls |
| twitter:image | https://opengraph.githubassets.com/ca41dbfcd181ec10fb90d9eb2e240252654eaa9c4cf2de4a5948204a473ed4f4/airnsk/proxycache |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/ca41dbfcd181ec10fb90d9eb2e240252654eaa9c4cf2de4a5948204a473ed4f4/airnsk/proxycache |
| og:image:alt | Smart OpenAI‑compatible proxy for llama.cpp: manages slots, saves/restores KV cache to disk, routes requests by prefix similarity, and protects hot slots from being overwritten. Accelerates long pr... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | a540949572872b935b393b36db38922db390ae71c859537d741b8f3eb7e545b5 |
| turbo-cache-control | no-preview |
| go-import | github.com/airnsk/proxycache git https://github.com/airnsk/proxycache.git |
| octolytics-dimension-user_id | 7033595 |
| octolytics-dimension-user_login | airnsk |
| octolytics-dimension-repository_id | 1093027462 |
| octolytics-dimension-repository_nwo | airnsk/proxycache |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 1093027462 |
| octolytics-dimension-repository_network_root_nwo | airnsk/proxycache |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 5f35ad1fb16417d6e6774c537b62a2fe92222907 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width