René's URL Explorer Experiment


Title: GitHub - DeepAuto-AI/vllm: Up to 4x faster decoding than vLLM using HiP Attention: https://github.com/DeepAuto-AI/hip-attention · GitHub

Open Graph Title: GitHub - DeepAuto-AI/vllm: Up to 4x faster decoding than vLLM using HiP Attention: https://github.com/DeepAuto-AI/hip-attention

X Title: GitHub - DeepAuto-AI/vllm: Up to 4x faster decoding than vLLM using HiP Attention: https://github.com/DeepAuto-AI/hip-attention

Description: Up to 4x faster decoding than vLLM using HiP Attention: https://github.com/DeepAuto-AI/hip-attention - DeepAuto-AI/vllm

Open Graph Description: Up to 4x faster decoding than vLLM using HiP Attention: https://github.com/DeepAuto-AI/hip-attention - DeepAuto-AI/vllm

X Description: Up to 4x faster decoding than vLLM using HiP Attention: https://github.com/DeepAuto-AI/hip-attention - DeepAuto-AI/vllm

Opengraph URL: https://github.com/DeepAuto-AI/vllm

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:9f69ab2c-92d6-1450-1b33-3f747ae73c7b
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-idADD8:2D40DE:46E364D:59F8033:6B02844E
html-safe-nonce45b444fdcb2da3812554282a1743d5175871e12066506a0a0ed22cae9756bb06
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBREQ4OjJENDBERTo0NkUzNjREOjU5RjgwMzM6NkIwMjg0NEUiLCJ2aXNpdG9yX2lkIjoiMjEzNjU1OTQ2NDkwMjQ2MDQ5NCIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac0281a8f15fe03dce321eaf66e0866029baddf32a4fec1e2ce410239ab8ed0a8d
hovercard-subject-tagrepository:833038670
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/DeepAuto-AI/vllm
twitter:imagehttps://opengraph.githubassets.com/1445829b872d687038a117ab9d640c4fd2f49100bc1b3257337d7c65bee3a8d7/DeepAuto-AI/vllm
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/1445829b872d687038a117ab9d640c4fd2f49100bc1b3257337d7c65bee3a8d7/DeepAuto-AI/vllm
og:image:altUp to 4x faster decoding than vLLM using HiP Attention: https://github.com/DeepAuto-AI/hip-attention - DeepAuto-AI/vllm
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None87e774ee7c6b3bee0490394e4d3e57ec9dbc956f74b87ea685dc8996c1676456
turbo-cache-controlno-cache
go-importgithub.com/DeepAuto-AI/vllm git https://github.com/DeepAuto-AI/vllm.git
octolytics-dimension-user_id116326151
octolytics-dimension-user_loginDeepAuto-AI
octolytics-dimension-repository_id833038670
octolytics-dimension-repository_nwoDeepAuto-AI/vllm
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forktrue
octolytics-dimension-repository_parent_id599547518
octolytics-dimension-repository_parent_nwovllm-project/vllm
octolytics-dimension-repository_network_root_id599547518
octolytics-dimension-repository_network_root_nwovllm-project/vllm
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release423dbb54c5e7bfecc838eb387c1435eb3d0e760d
ui-targetcanary-2
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/DeepAuto-AI/vllm#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FDeepAuto-AI%2Fvllm
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FDeepAuto-AI%2Fvllm
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=DeepAuto-AI%2Fvllm
Reloadhttps://github.com/DeepAuto-AI/vllm
Reloadhttps://github.com/DeepAuto-AI/vllm
Reloadhttps://github.com/DeepAuto-AI/vllm
DeepAuto-AIhttps://github.com/DeepAuto-AI
vllmhttps://github.com/DeepAuto-AI/vllm
Codehttps://github.com/DeepAuto-AI/vllm
Pull requestshttps://github.com/DeepAuto-AI/vllm/pulls
Actionshttps://github.com/DeepAuto-AI/vllm/actions
Projectshttps://github.com/DeepAuto-AI/vllm/projects
Security and qualityhttps://github.com/DeepAuto-AI/vllm/security
Insightshttps://github.com/DeepAuto-AI/vllm/insights
https://github.com/DeepAuto-AI/vllm
vllmhttps://github.com/DeepAuto-AI/vllm
vllm-project/vllmhttps://github.com/vllm-project/vllm
Notificationshttps://github.com/login?return_to=%2FDeepAuto-AI%2Fvllm
Fork0 (0)https://github.com/login?return_to=%2FDeepAuto-AI%2Fvllm
Star2 (2)https://github.com/login?return_to=%2FDeepAuto-AI%2Fvllm
https://github.com/DeepAuto-AI/hip-attentionhttps://github.com/DeepAuto-AI/hip-attention
github.com/DeepAuto-AI/hip-attentionhttps://github.com/DeepAuto-AI/hip-attention
Readmehttps://github.com/DeepAuto-AI/vllm#readme-ov-file
Licensehttps://github.com/DeepAuto-AI/vllm#License-1-ov-file
Contributinghttps://github.com/DeepAuto-AI/vllm#contributing-ov-file
Activityhttps://github.com/DeepAuto-AI/vllm/activity
Custom propertieshttps://github.com/DeepAuto-AI/vllm/custom-properties
0 forkshttps://github.com/DeepAuto-AI/vllm/forks
Report repositoryhttps://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2FDeepAuto-AI%2Fvllm&report=DeepAuto-AI+%28user%29
Brancheshttps://github.com/DeepAuto-AI/vllm/branches
Tagshttps://github.com/DeepAuto-AI/vllm/tags
https://github.com/DeepAuto-AI/vllm/branches
https://github.com/DeepAuto-AI/vllm/tags
2,270 Commitshttps://github.com/DeepAuto-AI/vllm/commits/main/
https://github.com/DeepAuto-AI/vllm/commits/main/
.buildkitehttps://github.com/DeepAuto-AI/vllm/tree/main/.buildkite
.buildkitehttps://github.com/DeepAuto-AI/vllm/tree/main/.buildkite
.githubhttps://github.com/DeepAuto-AI/vllm/tree/main/.github
.githubhttps://github.com/DeepAuto-AI/vllm/tree/main/.github
benchmarkshttps://github.com/DeepAuto-AI/vllm/tree/main/benchmarks
benchmarkshttps://github.com/DeepAuto-AI/vllm/tree/main/benchmarks
cmakehttps://github.com/DeepAuto-AI/vllm/tree/main/cmake
cmakehttps://github.com/DeepAuto-AI/vllm/tree/main/cmake
csrchttps://github.com/DeepAuto-AI/vllm/tree/main/csrc
csrchttps://github.com/DeepAuto-AI/vllm/tree/main/csrc
docshttps://github.com/DeepAuto-AI/vllm/tree/main/docs
docshttps://github.com/DeepAuto-AI/vllm/tree/main/docs
exampleshttps://github.com/DeepAuto-AI/vllm/tree/main/examples
exampleshttps://github.com/DeepAuto-AI/vllm/tree/main/examples
testshttps://github.com/DeepAuto-AI/vllm/tree/main/tests
testshttps://github.com/DeepAuto-AI/vllm/tree/main/tests
vllmhttps://github.com/DeepAuto-AI/vllm/tree/main/vllm
vllmhttps://github.com/DeepAuto-AI/vllm/tree/main/vllm
.clang-formathttps://github.com/DeepAuto-AI/vllm/blob/main/.clang-format
.clang-formathttps://github.com/DeepAuto-AI/vllm/blob/main/.clang-format
.dockerignorehttps://github.com/DeepAuto-AI/vllm/blob/main/.dockerignore
.dockerignorehttps://github.com/DeepAuto-AI/vllm/blob/main/.dockerignore
.gitignorehttps://github.com/DeepAuto-AI/vllm/blob/main/.gitignore
.gitignorehttps://github.com/DeepAuto-AI/vllm/blob/main/.gitignore
.readthedocs.yamlhttps://github.com/DeepAuto-AI/vllm/blob/main/.readthedocs.yaml
.readthedocs.yamlhttps://github.com/DeepAuto-AI/vllm/blob/main/.readthedocs.yaml
.yapfignorehttps://github.com/DeepAuto-AI/vllm/blob/main/.yapfignore
.yapfignorehttps://github.com/DeepAuto-AI/vllm/blob/main/.yapfignore
CMakeLists.txthttps://github.com/DeepAuto-AI/vllm/blob/main/CMakeLists.txt
CMakeLists.txthttps://github.com/DeepAuto-AI/vllm/blob/main/CMakeLists.txt
CONTRIBUTING.mdhttps://github.com/DeepAuto-AI/vllm/blob/main/CONTRIBUTING.md
CONTRIBUTING.mdhttps://github.com/DeepAuto-AI/vllm/blob/main/CONTRIBUTING.md
Dockerfilehttps://github.com/DeepAuto-AI/vllm/blob/main/Dockerfile
Dockerfilehttps://github.com/DeepAuto-AI/vllm/blob/main/Dockerfile
Dockerfile.cpuhttps://github.com/DeepAuto-AI/vllm/blob/main/Dockerfile.cpu
Dockerfile.cpuhttps://github.com/DeepAuto-AI/vllm/blob/main/Dockerfile.cpu
Dockerfile.neuronhttps://github.com/DeepAuto-AI/vllm/blob/main/Dockerfile.neuron
Dockerfile.neuronhttps://github.com/DeepAuto-AI/vllm/blob/main/Dockerfile.neuron
Dockerfile.openvinohttps://github.com/DeepAuto-AI/vllm/blob/main/Dockerfile.openvino
Dockerfile.openvinohttps://github.com/DeepAuto-AI/vllm/blob/main/Dockerfile.openvino
Dockerfile.ppc64lehttps://github.com/DeepAuto-AI/vllm/blob/main/Dockerfile.ppc64le
Dockerfile.ppc64lehttps://github.com/DeepAuto-AI/vllm/blob/main/Dockerfile.ppc64le
Dockerfile.rocmhttps://github.com/DeepAuto-AI/vllm/blob/main/Dockerfile.rocm
Dockerfile.rocmhttps://github.com/DeepAuto-AI/vllm/blob/main/Dockerfile.rocm
Dockerfile.tpuhttps://github.com/DeepAuto-AI/vllm/blob/main/Dockerfile.tpu
Dockerfile.tpuhttps://github.com/DeepAuto-AI/vllm/blob/main/Dockerfile.tpu
Dockerfile.xpuhttps://github.com/DeepAuto-AI/vllm/blob/main/Dockerfile.xpu
Dockerfile.xpuhttps://github.com/DeepAuto-AI/vllm/blob/main/Dockerfile.xpu
LICENSEhttps://github.com/DeepAuto-AI/vllm/blob/main/LICENSE
LICENSEhttps://github.com/DeepAuto-AI/vllm/blob/main/LICENSE
MANIFEST.inhttps://github.com/DeepAuto-AI/vllm/blob/main/MANIFEST.in
MANIFEST.inhttps://github.com/DeepAuto-AI/vllm/blob/main/MANIFEST.in
README.mdhttps://github.com/DeepAuto-AI/vllm/blob/main/README.md
README.mdhttps://github.com/DeepAuto-AI/vllm/blob/main/README.md
collect_env.pyhttps://github.com/DeepAuto-AI/vllm/blob/main/collect_env.py
collect_env.pyhttps://github.com/DeepAuto-AI/vllm/blob/main/collect_env.py
format.shhttps://github.com/DeepAuto-AI/vllm/blob/main/format.sh
format.shhttps://github.com/DeepAuto-AI/vllm/blob/main/format.sh
pyproject.tomlhttps://github.com/DeepAuto-AI/vllm/blob/main/pyproject.toml
pyproject.tomlhttps://github.com/DeepAuto-AI/vllm/blob/main/pyproject.toml
requirements-adag.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-adag.txt
requirements-adag.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-adag.txt
requirements-build.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-build.txt
requirements-build.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-build.txt
requirements-common.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-common.txt
requirements-common.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-common.txt
requirements-cpu.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-cpu.txt
requirements-cpu.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-cpu.txt
requirements-cuda.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-cuda.txt
requirements-cuda.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-cuda.txt
requirements-dev.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-dev.txt
requirements-dev.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-dev.txt
requirements-lint.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-lint.txt
requirements-lint.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-lint.txt
requirements-mamba.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-mamba.txt
requirements-mamba.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-mamba.txt
requirements-neuron.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-neuron.txt
requirements-neuron.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-neuron.txt
requirements-openvino.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-openvino.txt
requirements-openvino.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-openvino.txt
requirements-rocm.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-rocm.txt
requirements-rocm.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-rocm.txt
requirements-test.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-test.txt
requirements-test.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-test.txt
requirements-tpu.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-tpu.txt
requirements-tpu.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-tpu.txt
requirements-xpu.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-xpu.txt
requirements-xpu.txthttps://github.com/DeepAuto-AI/vllm/blob/main/requirements-xpu.txt
setup.pyhttps://github.com/DeepAuto-AI/vllm/blob/main/setup.py
setup.pyhttps://github.com/DeepAuto-AI/vllm/blob/main/setup.py
READMEhttps://github.com/DeepAuto-AI/vllm
Contributinghttps://github.com/DeepAuto-AI/vllm
Licensehttps://github.com/DeepAuto-AI/vllm
https://github.com/DeepAuto-AI/vllm#easy-fast-and-cheap-llm-serving-for-everyone
Documentationhttps://docs.vllm.ai
Bloghttps://vllm.ai
Paperhttps://arxiv.org/abs/2309.06180
Discordhttps://discord.gg/jz7wjKhh6g
the fifth vLLM meetuphttps://lu.ma/lp0gyjqr
herehttps://docs.google.com/presentation/d/1RgUD8aCfcHocghoP3zmXzck9vX3RCI9yfUAB2Bbcl4Y/edit?usp=sharing
herehttps://blog.vllm.ai/2024/07/23/llama31.html
the fourth vLLM meetuphttps://lu.ma/agivllm
herehttps://docs.google.com/presentation/d/1iJ8o7V2bQEi0BFEljLTwc5G1S10_Rhv3beed5oB0NJ4/edit?usp=sharing
the third vLLM meetuphttps://robloxandvllmmeetup2024.splashthat.com/
herehttps://docs.google.com/presentation/d/1A--47JAK4BJ39t954HyTkvtfwn0fkqtsL8NGFuslReM/edit?usp=sharing
the second vLLM meetuphttps://lu.ma/ygxbpzhl
herehttps://docs.google.com/presentation/d/12mI2sKABnUw5RBWXDYY-HtHth4iMSNcEoQ10jDQbxgA/edit?usp=sharing
the first vLLM meetuphttps://lu.ma/first-vllm-meetup
herehttps://docs.google.com/presentation/d/1QL-XPFXiFpDBh86DbEegFXBXFXjix4v032GhShbKf3s/edit?usp=sharing
Andreessen Horowitzhttps://a16z.com/2023/08/30/supporting-the-open-source-ai-community/
LMSYS Vicuna and Chatbot Arenahttps://chat.lmsys.org
blog posthttps://vllm.ai
https://github.com/DeepAuto-AI/vllm#about
GPTQhttps://arxiv.org/abs/2210.17323
AWQhttps://arxiv.org/abs/2306.00978
SqueezeLLMhttps://arxiv.org/abs/2306.07629
performance benchmarkhttps://buildkite.com/vllm/performance-benchmark/builds/4068
TensorRT-LLMhttps://github.com/NVIDIA/TensorRT-LLM
text-generation-inferencehttps://github.com/huggingface/text-generation-inference
lmdeployhttps://github.com/InternLM/lmdeploy
herehttps://docs.vllm.ai/en/latest/models/supported_models.html
https://github.com/DeepAuto-AI/vllm#getting-started
from sourcehttps://vllm.readthedocs.io/en/latest/getting_started/installation.html#build-from-source
documentationhttps://vllm.readthedocs.io/en/latest/
Installationhttps://vllm.readthedocs.io/en/latest/getting_started/installation.html
Quickstarthttps://vllm.readthedocs.io/en/latest/getting_started/quickstart.html
Supported Modelshttps://vllm.readthedocs.io/en/latest/models/supported_models.html
https://github.com/DeepAuto-AI/vllm#contributing
CONTRIBUTING.mdhttps://github.com/DeepAuto-AI/vllm/blob/main/CONTRIBUTING.md
https://github.com/DeepAuto-AI/vllm#sponsors
OpenCollectivehttps://opencollective.com/vllm
https://github.com/DeepAuto-AI/vllm#citation
paperhttps://arxiv.org/abs/2309.06180
https://github.com/DeepAuto-AI/hip-attentionhttps://github.com/DeepAuto-AI/hip-attention
github.com/DeepAuto-AI/hip-attentionhttps://github.com/DeepAuto-AI/hip-attention
Readmehttps://github.com/DeepAuto-AI/vllm#readme-ov-file
Licensehttps://github.com/DeepAuto-AI/vllm#License-1-ov-file
Contributinghttps://github.com/DeepAuto-AI/vllm#contributing-ov-file
Activityhttps://github.com/DeepAuto-AI/vllm/activity
Custom propertieshttps://github.com/DeepAuto-AI/vllm/custom-properties
0 forkshttps://github.com/DeepAuto-AI/vllm/forks
Report repositoryhttps://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2FDeepAuto-AI%2Fvllm&report=DeepAuto-AI+%28user%29
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.