René's URL Explorer Experiment


Title: History for llama_cpp/server - dexhunter/llama-cpp-python · GitHub

Open Graph Title: History for llama_cpp/server - dexhunter/llama-cpp-python

X Title: History for llama_cpp/server - dexhunter/llama-cpp-python

Description: Python bindings for llama.cpp. Contribute to dexhunter/llama-cpp-python development by creating an account on GitHub.

Open Graph Description: Python bindings for llama.cpp. Contribute to dexhunter/llama-cpp-python development by creating an account on GitHub.

X Description: Python bindings for llama.cpp. Contribute to dexhunter/llama-cpp-python development by creating an account on GitHub.

Opengraph URL: https://github.com/dexhunter/llama-cpp-python

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/:user_id/:repository/commits(/*name)
route-controllercommits
route-actionshow
fetch-noncev2:c9bec567-3358-b300-a53c-e5677b610a8b
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-id9012:CB66E:27C635:337954:6AFFC436
html-safe-nonceeacd8038cb8126a1ad593faa51379edd2ac66b5d64e97151b6d8e11bbfcf374f
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI5MDEyOkNCNjZFOjI3QzYzNTozMzc5NTQ6NkFGRkM0MzYiLCJ2aXNpdG9yX2lkIjoiMjg0ODgwOTU0Njc1Mzc1NDE2NiIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac6d533914fb240466b7330aa93f737a96be6272397b73e07558cf7acdc9ffe7cc
hovercard-subject-tagrepository:1448663306
github-keyboard-shortcutsrepository,commit-list,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///commits/show
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/dexhunter/llama-cpp-python/commits/patch-1/llama_cpp/server
twitter:imagehttps://opengraph.githubassets.com/e956dd025a00b4d89d0ee02257c40b70d14420ad67a06dc2c3da7cb3e5f8a8c3/dexhunter/llama-cpp-python
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/e956dd025a00b4d89d0ee02257c40b70d14420ad67a06dc2c3da7cb3e5f8a8c3/dexhunter/llama-cpp-python
og:image:altPython bindings for llama.cpp. Contribute to dexhunter/llama-cpp-python development by creating an account on GitHub.
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None1e805b832df235bb21305db712c3b6432920019dfc12cb25b9cb8d3b0c9403cf
turbo-cache-controlno-cache
go-importgithub.com/dexhunter/llama-cpp-python git https://github.com/dexhunter/llama-cpp-python.git
octolytics-dimension-user_id6930518
octolytics-dimension-user_logindexhunter
octolytics-dimension-repository_id1448663306
octolytics-dimension-repository_nwodexhunter/llama-cpp-python
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forktrue
octolytics-dimension-repository_parent_id617868717
octolytics-dimension-repository_parent_nwoabetlen/llama-cpp-python
octolytics-dimension-repository_network_root_id617868717
octolytics-dimension-repository_network_root_nwoabetlen/llama-cpp-python
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release8fa4a54e6871c7908eda1c246ad5972982c0b59d
ui-targetfull
theme-color#1e2327
color-schemelight dark
react-app-namecommits

Links:

Skip to contenthttps://github.com/dexhunter/llama-cpp-python/commits/patch-1/llama_cpp/server#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fdexhunter%2Fllama-cpp-python%2Fcommits%2Fpatch-1%2Fllama_cpp%2Fserver
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fdexhunter%2Fllama-cpp-python%2Fcommits%2Fpatch-1%2Fllama_cpp%2Fserver
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fcommits%2Fshow&source=header-repo&source_repo=dexhunter%2Fllama-cpp-python
Reloadhttps://github.com/dexhunter/llama-cpp-python/commits/patch-1/llama_cpp/server
Reloadhttps://github.com/dexhunter/llama-cpp-python/commits/patch-1/llama_cpp/server
Reloadhttps://github.com/dexhunter/llama-cpp-python/commits/patch-1/llama_cpp/server
dexhunterhttps://github.com/dexhunter
llama-cpp-pythonhttps://github.com/dexhunter/llama-cpp-python
Codehttps://github.com/dexhunter/llama-cpp-python
Pull requestshttps://github.com/dexhunter/llama-cpp-python/pulls
Actionshttps://github.com/dexhunter/llama-cpp-python/actions
Projectshttps://github.com/dexhunter/llama-cpp-python/projects
Security and qualityhttps://github.com/dexhunter/llama-cpp-python/security
Insightshttps://github.com/dexhunter/llama-cpp-python/pulse
https://github.com/dexhunter/llama-cpp-python
llama-cpp-pythonhttps://github.com/dexhunter/llama-cpp-python/commits
llama_cpphttps://github.com/dexhunter/llama-cpp-python/commits/patch-1/llama_cpp
serverhttps://github.com/dexhunter/llama-cpp-python/commits/patch-1/llama_cpp/server
patch-1https://github.com/dexhunter/llama-cpp-python/tree/patch-1
fix(server): Use split_mode from model settings (#1594)https://github.com/dexhunter/llama-cpp-python/commit/66d5cddbc31976636cf560e5b0b86e4333e85f2b
grider-withouraihttps://github.com/dexhunter/llama-cpp-python/commits?author=grider-withourai
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
66d5cddhttps://github.com/dexhunter/llama-cpp-python/commit/66d5cddbc31976636cf560e5b0b86e4333e85f2b
https://github.com/dexhunter/llama-cpp-python/blob/66d5cddbc31976636cf560e5b0b86e4333e85f2b/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/66d5cddbc31976636cf560e5b0b86e4333e85f2b
fix(misc): Formathttps://github.com/dexhunter/llama-cpp-python/commit/c1ae81554f52f81b6027e36ae0a056dca9819c3c
https://github.com/abetlen
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
c1ae815https://github.com/dexhunter/llama-cpp-python/commit/c1ae81554f52f81b6027e36ae0a056dca9819c3c
https://github.com/dexhunter/llama-cpp-python/blob/c1ae81554f52f81b6027e36ae0a056dca9819c3c/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/c1ae81554f52f81b6027e36ae0a056dca9819c3c
fix(misc): Fix type errorshttps://github.com/dexhunter/llama-cpp-python/commit/387d01d94581dbcb1288304094bb1acee5ca24ae
https://github.com/abetlen
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
387d01dhttps://github.com/dexhunter/llama-cpp-python/commit/387d01d94581dbcb1288304094bb1acee5ca24ae
https://github.com/dexhunter/llama-cpp-python/blob/387d01d94581dbcb1288304094bb1acee5ca24ae/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/387d01d94581dbcb1288304094bb1acee5ca24ae
fix(server): Fix bug in FastAPI streaming response where dependency was released before request completes causing SEGFAULThttps://github.com/dexhunter/llama-cpp-python/commit/296304b60bb83689659883c9cc24f4c074dd88ff
https://github.com/abetlen
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
296304bhttps://github.com/dexhunter/llama-cpp-python/commit/296304b60bb83689659883c9cc24f4c074dd88ff
https://github.com/dexhunter/llama-cpp-python/blob/296304b60bb83689659883c9cc24f4c074dd88ff/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/296304b60bb83689659883c9cc24f4c074dd88ff
fix(server): Update `embeddings=False` by default. Embeddings should be enabled by default for embedding models.https://github.com/dexhunter/llama-cpp-python/commit/bf5e0bb4b151f4ca2f5a21af68eb832a96a79d75
https://github.com/abetlen
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
bf5e0bbhttps://github.com/dexhunter/llama-cpp-python/commit/bf5e0bb4b151f4ca2f5a21af68eb832a96a79d75
https://github.com/dexhunter/llama-cpp-python/blob/bf5e0bb4b151f4ca2f5a21af68eb832a96a79d75/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/bf5e0bb4b151f4ca2f5a21af68eb832a96a79d75
feat: Add `.close()` method to `Llama` class to explicitly free model from memory (#1513)https://github.com/dexhunter/llama-cpp-python/commit/320a5d7ea5ebcc5a8dc114d9bdf7c584537b04b0
jkawamotohttps://github.com/dexhunter/llama-cpp-python/commits?author=jkawamoto
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
320a5d7https://github.com/dexhunter/llama-cpp-python/commit/320a5d7ea5ebcc5a8dc114d9bdf7c584537b04b0
https://github.com/dexhunter/llama-cpp-python/blob/320a5d7ea5ebcc5a8dc114d9bdf7c584537b04b0/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/320a5d7ea5ebcc5a8dc114d9bdf7c584537b04b0
feat: adding `rpc_servers` parameter to `Llama` class (#1477)https://github.com/dexhunter/llama-cpp-python/commit/d634efcdd91a0f79ae0fac13cfdf46eb47d0602d
chraachttps://github.com/dexhunter/llama-cpp-python/commits?author=chraac
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
d634efchttps://github.com/dexhunter/llama-cpp-python/commit/d634efcdd91a0f79ae0fac13cfdf46eb47d0602d
https://github.com/dexhunter/llama-cpp-python/blob/d634efcdd91a0f79ae0fac13cfdf46eb47d0602d/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/d634efcdd91a0f79ae0fac13cfdf46eb47d0602d
fix: fix string value kv_overrides. Closes #1487https://github.com/dexhunter/llama-cpp-python/commit/df45a4b3fe46e72664bda87301b318210c6d4782
https://github.com/abetlen
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
df45a4bhttps://github.com/dexhunter/llama-cpp-python/commit/df45a4b3fe46e72664bda87301b318210c6d4782
https://github.com/dexhunter/llama-cpp-python/blob/df45a4b3fe46e72664bda87301b318210c6d4782/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/df45a4b3fe46e72664bda87301b318210c6d4782
feat: add MinTokensLogitProcessor and min_tokens argument to server (#1333)https://github.com/dexhunter/llama-cpp-python/commit/5212fb08ae69a721b2ced4e5e8b96ce642219e16
https://github.com/twaka
twakahttps://github.com/dexhunter/llama-cpp-python/commits?author=twaka
5212fb0https://github.com/dexhunter/llama-cpp-python/commit/5212fb08ae69a721b2ced4e5e8b96ce642219e16
https://github.com/dexhunter/llama-cpp-python/blob/5212fb08ae69a721b2ced4e5e8b96ce642219e16/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/5212fb08ae69a721b2ced4e5e8b96ce642219e16
feat(server): Add support for setting root_path. Closes #1420https://github.com/dexhunter/llama-cpp-python/commit/0318702cdc860999ee70f277425edbbfe0e60419
https://github.com/abetlen
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
0318702https://github.com/dexhunter/llama-cpp-python/commit/0318702cdc860999ee70f277425edbbfe0e60419
https://github.com/dexhunter/llama-cpp-python/blob/0318702cdc860999ee70f277425edbbfe0e60419/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/0318702cdc860999ee70f277425edbbfe0e60419
Merge branch 'main' of github.com:abetlen/llama_cpp_python into mainhttps://github.com/dexhunter/llama-cpp-python/commit/f9b7221c8ff42c6220a2b60a3fc37eab6010a048
https://github.com/abetlen
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
f9b7221https://github.com/dexhunter/llama-cpp-python/commit/f9b7221c8ff42c6220a2b60a3fc37eab6010a048
https://github.com/dexhunter/llama-cpp-python/blob/f9b7221c8ff42c6220a2b60a3fc37eab6010a048/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/f9b7221c8ff42c6220a2b60a3fc37eab6010a048
feat(server): Remove temperature bounds checks for server. Closes #1384https://github.com/dexhunter/llama-cpp-python/commit/0a454bebe67d12a446981eb16028c168ca5faa81
https://github.com/abetlen
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
0a454behttps://github.com/dexhunter/llama-cpp-python/commit/0a454bebe67d12a446981eb16028c168ca5faa81
https://github.com/dexhunter/llama-cpp-python/blob/0a454bebe67d12a446981eb16028c168ca5faa81/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/0a454bebe67d12a446981eb16028c168ca5faa81
fix(server): Propagate `flash_attn` to model load. (#1424)https://github.com/dexhunter/llama-cpp-python/commit/2138561fab5e60672c63b6c446b62a8bc26e17c4
https://github.com/dthuerck
dthuerckhttps://github.com/dexhunter/llama-cpp-python/commits?author=dthuerck
2138561https://github.com/dexhunter/llama-cpp-python/commit/2138561fab5e60672c63b6c446b62a8bc26e17c4
https://github.com/dexhunter/llama-cpp-python/blob/2138561fab5e60672c63b6c446b62a8bc26e17c4/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/2138561fab5e60672c63b6c446b62a8bc26e17c4
feat: Add llama-3-vision-alpha chat formathttps://github.com/dexhunter/llama-cpp-python/commit/31b1d95a6c19f5b615a3286069f181a415f872e8
https://github.com/abetlen
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
31b1d95https://github.com/dexhunter/llama-cpp-python/commit/31b1d95a6c19f5b615a3286069f181a415f872e8
https://github.com/dexhunter/llama-cpp-python/blob/31b1d95a6c19f5b615a3286069f181a415f872e8/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/31b1d95a6c19f5b615a3286069f181a415f872e8
feat: Add option to enable `flash_attn` to Lllama params and ModelSettingshttps://github.com/dexhunter/llama-cpp-python/commit/22d77eefd2edaf0148f53374d0cac74d0e25d06e
https://github.com/abetlen
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
22d77eehttps://github.com/dexhunter/llama-cpp-python/commit/22d77eefd2edaf0148f53374d0cac74d0e25d06e
https://github.com/dexhunter/llama-cpp-python/blob/22d77eefd2edaf0148f53374d0cac74d0e25d06e/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/22d77eefd2edaf0148f53374d0cac74d0e25d06e
feat: Generic Chat Formats, Tool Calling, and Huggingface Pull Support for Multimodal Models (Obsidian, LLaVA1.6, Moondream) (#1147)https://github.com/dexhunter/llama-cpp-python/commit/fe2da0953895000e20655d2c991308f702508494
https://github.com/abetlen
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
fe2da09https://github.com/dexhunter/llama-cpp-python/commit/fe2da0953895000e20655d2c991308f702508494
https://github.com/dexhunter/llama-cpp-python/blob/fe2da0953895000e20655d2c991308f702508494/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/fe2da0953895000e20655d2c991308f702508494
fix: pydantic deprecation warninghttps://github.com/dexhunter/llama-cpp-python/commit/fcfea66857c73c9b95326835debb80dbc0b76f17
https://github.com/abetlen
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
fcfea66https://github.com/dexhunter/llama-cpp-python/commit/fcfea66857c73c9b95326835debb80dbc0b76f17
https://github.com/dexhunter/llama-cpp-python/blob/fcfea66857c73c9b95326835debb80dbc0b76f17/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/fcfea66857c73c9b95326835debb80dbc0b76f17
feat(server): Provide ability to dynamically allocate all threads if desired using `-1` (#1364)https://github.com/dexhunter/llama-cpp-python/commit/53ebcc8bb5beb912bda4baa44ae27a1e3a7eabd0
https://github.com/sean-bailey
sean-baileyhttps://github.com/dexhunter/llama-cpp-python/commits?author=sean-bailey
53ebcc8https://github.com/dexhunter/llama-cpp-python/commit/53ebcc8bb5beb912bda4baa44ae27a1e3a7eabd0
https://github.com/dexhunter/llama-cpp-python/blob/53ebcc8bb5beb912bda4baa44ae27a1e3a7eabd0/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/53ebcc8bb5beb912bda4baa44ae27a1e3a7eabd0
feat: add `disable_ping_events` flag (#1257)https://github.com/dexhunter/llama-cpp-python/commit/b73c73c0c67f559fd9c7d620ad3d4e24d5c4bc4c
https://github.com/khimaros
khimaroshttps://github.com/dexhunter/llama-cpp-python/commits?author=khimaros
b73c73chttps://github.com/dexhunter/llama-cpp-python/commit/b73c73c0c67f559fd9c7d620ad3d4e24d5c4bc4c
https://github.com/dexhunter/llama-cpp-python/blob/b73c73c0c67f559fd9c7d620ad3d4e24d5c4bc4c/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/b73c73c0c67f559fd9c7d620ad3d4e24d5c4bc4c
feat: Use all available CPUs for batch processing (#1345)https://github.com/dexhunter/llama-cpp-python/commit/c96b2daebf7b5dbe3cfd9194b249ab579a28d633
ddh0https://github.com/dexhunter/llama-cpp-python/commits?author=ddh0
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
c96b2dahttps://github.com/dexhunter/llama-cpp-python/commit/c96b2daebf7b5dbe3cfd9194b249ab579a28d633
https://github.com/dexhunter/llama-cpp-python/blob/c96b2daebf7b5dbe3cfd9194b249ab579a28d633/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/c96b2daebf7b5dbe3cfd9194b249ab579a28d633
feat: Add support for yaml based configshttps://github.com/dexhunter/llama-cpp-python/commit/060bfa64d529ade2af9b1f4e207a3937bbc4138f
https://github.com/abetlen
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
060bfa6https://github.com/dexhunter/llama-cpp-python/commit/060bfa64d529ade2af9b1f4e207a3937bbc4138f
https://github.com/dexhunter/llama-cpp-python/blob/060bfa64d529ade2af9b1f4e207a3937bbc4138f/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/060bfa64d529ade2af9b1f4e207a3937bbc4138f
feat: add support for KV cache quantization options (#1307)https://github.com/dexhunter/llama-cpp-python/commit/f165048a69b2ad5b70d4fd2ec4adebfb411b5b47
Limour-devhttps://github.com/dexhunter/llama-cpp-python/commits?author=Limour-dev
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
f165048https://github.com/dexhunter/llama-cpp-python/commit/f165048a69b2ad5b70d4fd2ec4adebfb411b5b47
https://github.com/dexhunter/llama-cpp-python/blob/f165048a69b2ad5b70d4fd2ec4adebfb411b5b47/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/f165048a69b2ad5b70d4fd2ec4adebfb411b5b47
feat: Add logprobs support to chat completions (#1311)https://github.com/dexhunter/llama-cpp-python/commit/aa9f1ae011fbc22893750209af500fee3167f21c
windspirit95https://github.com/dexhunter/llama-cpp-python/commits?author=windspirit95
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
aa9f1aehttps://github.com/dexhunter/llama-cpp-python/commit/aa9f1ae011fbc22893750209af500fee3167f21c
https://github.com/dexhunter/llama-cpp-python/blob/aa9f1ae011fbc22893750209af500fee3167f21c/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/aa9f1ae011fbc22893750209af500fee3167f21c
fix(server): minor type fixeshttps://github.com/dexhunter/llama-cpp-python/commit/d11ccc30361a947177e46d31c632988661f5af02
https://github.com/abetlen
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
d11ccc3https://github.com/dexhunter/llama-cpp-python/commit/d11ccc30361a947177e46d31c632988661f5af02
https://github.com/dexhunter/llama-cpp-python/blob/d11ccc30361a947177e46d31c632988661f5af02/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/d11ccc30361a947177e46d31c632988661f5af02
docs: Add chat examples to openapi uihttps://github.com/dexhunter/llama-cpp-python/commit/f7decc956207f181710a43e2795f478ad2a5fc5e
https://github.com/abetlen
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
f7decc9https://github.com/dexhunter/llama-cpp-python/commit/f7decc956207f181710a43e2795f478ad2a5fc5e
https://github.com/dexhunter/llama-cpp-python/blob/f7decc956207f181710a43e2795f478ad2a5fc5e/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/f7decc956207f181710a43e2795f478ad2a5fc5e
feat: Add endpoints for tokenize, detokenize and count tokens (#1136)https://github.com/dexhunter/llama-cpp-python/commit/c139f8b5d50f6f416a24c0ba65983a3fb84bf2f3
felipelohttps://github.com/dexhunter/llama-cpp-python/commits?author=felipelo
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
c139f8bhttps://github.com/dexhunter/llama-cpp-python/commit/c139f8b5d50f6f416a24c0ba65983a3fb84bf2f3
https://github.com/dexhunter/llama-cpp-python/blob/c139f8b5d50f6f416a24c0ba65983a3fb84bf2f3/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/c139f8b5d50f6f416a24c0ba65983a3fb84bf2f3
misc: Formathttps://github.com/dexhunter/llama-cpp-python/commit/727d60c28a76312c3cbed412f290af8cad2f92ec
https://github.com/abetlen
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
727d60chttps://github.com/dexhunter/llama-cpp-python/commit/727d60c28a76312c3cbed412f290af8cad2f92ec
https://github.com/dexhunter/llama-cpp-python/blob/727d60c28a76312c3cbed412f290af8cad2f92ec/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/727d60c28a76312c3cbed412f290af8cad2f92ec
feat: Update llama.cpphttps://github.com/dexhunter/llama-cpp-python/commit/0d37ce52b1ec9da5a6c61159b0c8de78ed84efcb
https://github.com/abetlen
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
0d37ce5https://github.com/dexhunter/llama-cpp-python/commit/0d37ce52b1ec9da5a6c61159b0c8de78ed84efcb
https://github.com/dexhunter/llama-cpp-python/blob/0d37ce52b1ec9da5a6c61159b0c8de78ed84efcb/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/0d37ce52b1ec9da5a6c61159b0c8de78ed84efcb
feat(server): Add support for pulling models from Huggingface Hub (#1222)https://github.com/dexhunter/llama-cpp-python/commit/4d574bd765912534304b196b838a380a88e602a3
https://github.com/abetlen
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
4d574bdhttps://github.com/dexhunter/llama-cpp-python/commit/4d574bd765912534304b196b838a380a88e602a3
https://github.com/dexhunter/llama-cpp-python/blob/4d574bd765912534304b196b838a380a88e602a3/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/4d574bd765912534304b196b838a380a88e602a3
fix: remove prematurely commited changehttps://github.com/dexhunter/llama-cpp-python/commit/dcf38f61411fbf51860978d5b02c4cb9d573dcf0
https://github.com/abetlen
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
dcf38f6https://github.com/dexhunter/llama-cpp-python/commit/dcf38f61411fbf51860978d5b02c4cb9d573dcf0
https://github.com/dexhunter/llama-cpp-python/blob/dcf38f61411fbf51860978d5b02c4cb9d573dcf0/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/dcf38f61411fbf51860978d5b02c4cb9d573dcf0
feat: Update llama.cpphttps://github.com/dexhunter/llama-cpp-python/commit/2292af5796fb0ce2092289246eabe246abd09c0f
https://github.com/abetlen
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
2292af5https://github.com/dexhunter/llama-cpp-python/commit/2292af5796fb0ce2092289246eabe246abd09c0f
https://github.com/dexhunter/llama-cpp-python/blob/2292af5796fb0ce2092289246eabe246abd09c0f/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/2292af5796fb0ce2092289246eabe246abd09c0f
feat: Update llama.cpphttps://github.com/dexhunter/llama-cpp-python/commit/fdce078cb915cecba7df58eeb494ee8493c87672
https://github.com/abetlen
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
fdce078https://github.com/dexhunter/llama-cpp-python/commit/fdce078cb915cecba7df58eeb494ee8493c87672
https://github.com/dexhunter/llama-cpp-python/blob/fdce078cb915cecba7df58eeb494ee8493c87672/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/fdce078cb915cecba7df58eeb494ee8493c87672
fix: Use '\n' seperator for EventSourceResponse (#1188)https://github.com/dexhunter/llama-cpp-python/commit/ea1f88dd293c0c961f98297f8d9aba7e8cf48ce3
khimaroshttps://github.com/dexhunter/llama-cpp-python/commits?author=khimaros
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
ea1f88dhttps://github.com/dexhunter/llama-cpp-python/commit/ea1f88dd293c0c961f98297f8d9aba7e8cf48ce3
https://github.com/dexhunter/llama-cpp-python/blob/ea1f88dd293c0c961f98297f8d9aba7e8cf48ce3/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/ea1f88dd293c0c961f98297f8d9aba7e8cf48ce3
fix: broken importhttps://github.com/dexhunter/llama-cpp-python/commit/85d3374b4d5892e51e27b9973f9ce3623e076e2a
https://github.com/abetlen
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
85d3374https://github.com/dexhunter/llama-cpp-python/commit/85d3374b4d5892e51e27b9973f9ce3623e076e2a
https://github.com/dexhunter/llama-cpp-python/blob/85d3374b4d5892e51e27b9973f9ce3623e076e2a/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/85d3374b4d5892e51e27b9973f9ce3623e076e2a
feat: Integrate functionary v1.4 and v2 models + add custom tokenizer support to Llama class (#1078)https://github.com/dexhunter/llama-cpp-python/commit/901827013b732d74f1f67033062d13a6204a62bd
jeffrey-fonghttps://github.com/dexhunter/llama-cpp-python/commits?author=jeffrey-fong
abetlenhttps://github.com/dexhunter/llama-cpp-python/commits?author=abetlen
9018270https://github.com/dexhunter/llama-cpp-python/commit/901827013b732d74f1f67033062d13a6204a62bd
https://github.com/dexhunter/llama-cpp-python/blob/901827013b732d74f1f67033062d13a6204a62bd/llama_cpp/server
https://github.com/dexhunter/llama-cpp-python/tree/901827013b732d74f1f67033062d13a6204a62bd
Nexthttps://github.com/dexhunter/llama-cpp-python/commits/patch-1/llama_cpp/server?after=6d53877fe81e350768cc41433817e91a1d532261+34
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.