René's URL Explorer Experiment


Title: GitHub - AI-Hypercomputer/JetStream: JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

Open Graph Title: GitHub - AI-Hypercomputer/JetStream: JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

X Title: GitHub - AI-Hypercomputer/JetStream: JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

Description: JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome). - AI-Hypercomputer/JetStream

Open Graph Description: JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome). - AI-Hypercomputer/JetStream

X Description: JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome). - AI-Hypercomputer/JetStream

Opengraph URL: https://github.com/AI-Hypercomputer/JetStream

X: @github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:e8008b5b-8b47-92e2-e307-3acdb87c35b6
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-idEDCC:2C24EC:11F323D:18C5266:6977717E
html-safe-nonce1a333d044f0b669541e61ebe412727498b18ff251b3f135e8ebfdfb72c78644c
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJFRENDOjJDMjRFQzoxMUYzMjNEOjE4QzUyNjY6Njk3NzcxN0UiLCJ2aXNpdG9yX2lkIjoiMjYyNTQxNzQwMTMzMTA1MjkyNiIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmacac6f60eef0b500b701712415c341e116242afcfd0dd2a6ce2421ee431bfd0e2a
hovercard-subject-tagrepository:765455287
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/AI-Hypercomputer/JetStream
twitter:imagehttps://opengraph.githubassets.com/12fed115479593982565d62ed6ee1055c2f3a3274fdc0f5c8f30a34327475178/AI-Hypercomputer/JetStream
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/12fed115479593982565d62ed6ee1055c2f3a3274fdc0f5c8f30a34327475178/AI-Hypercomputer/JetStream
og:image:altJetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome). - AI-Hypercomputer/JetStream
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None9fea6af76c6e24ca5c5728a18d4220d768790d04abe1ba6aafa18526daff96e7
turbo-cache-controlno-preview
go-importgithub.com/AI-Hypercomputer/JetStream git https://github.com/AI-Hypercomputer/JetStream.git
octolytics-dimension-user_id181000646
octolytics-dimension-user_loginAI-Hypercomputer
octolytics-dimension-repository_id765455287
octolytics-dimension-repository_nwoAI-Hypercomputer/JetStream
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id765455287
octolytics-dimension-repository_network_root_nwoAI-Hypercomputer/JetStream
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release6c4a3fa336c0d96309887d0be819777cadd37121
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream#start-of-content
https://patch-diff.githubusercontent.com/
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2FAI-Hypercomputer%2FJetStream
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2FAI-Hypercomputer%2FJetStream
Sign up https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=AI-Hypercomputer%2FJetStream
Reloadhttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream
Reloadhttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream
Reloadhttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream
AI-Hypercomputer https://patch-diff.githubusercontent.com/AI-Hypercomputer
JetStreamhttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream
Notifications https://patch-diff.githubusercontent.com/login?return_to=%2FAI-Hypercomputer%2FJetStream
Fork 58 https://patch-diff.githubusercontent.com/login?return_to=%2FAI-Hypercomputer%2FJetStream
Star 403 https://patch-diff.githubusercontent.com/login?return_to=%2FAI-Hypercomputer%2FJetStream
Apache-2.0 license https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/LICENSE
403 stars https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/stargazers
58 forks https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/forks
Branches https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/branches
Tags https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/tags
Activity https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/activity
Star https://patch-diff.githubusercontent.com/login?return_to=%2FAI-Hypercomputer%2FJetStream
Notifications https://patch-diff.githubusercontent.com/login?return_to=%2FAI-Hypercomputer%2FJetStream
Code https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream
Issues 14 https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/issues
Pull requests 12 https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/pulls
Actions https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/actions
Projects 0 https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/projects
Security 0 https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/security
Insights https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/pulse
Code https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream
Issues https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/issues
Pull requests https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/pulls
Actions https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/actions
Projects https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/projects
Security https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/security
Insights https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/pulse
Brancheshttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/branches
Tagshttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/tags
https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/branches
https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/tags
258 Commitshttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/commits/main/
https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/commits/main/
.githubhttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/tree/main/.github
.githubhttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/tree/main/.github
benchmarkshttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/tree/main/benchmarks
benchmarkshttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/tree/main/benchmarks
docshttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/tree/main/docs
docshttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/tree/main/docs
experimentalhttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/tree/main/experimental
experimentalhttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/tree/main/experimental
jetstreamhttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/tree/main/jetstream
jetstreamhttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/tree/main/jetstream
.coveragerchttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/.coveragerc
.coveragerchttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/.coveragerc
.gitattributeshttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/.gitattributes
.gitattributeshttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/.gitattributes
.gitignorehttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/.gitignore
.gitignorehttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/.gitignore
AUTHORShttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/AUTHORS
AUTHORShttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/AUTHORS
CONTRIBUTING.mdhttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/CONTRIBUTING.md
CONTRIBUTING.mdhttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/CONTRIBUTING.md
LICENSEhttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/LICENSE
LICENSEhttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/LICENSE
MANIFEST.inhttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/MANIFEST.in
MANIFEST.inhttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/MANIFEST.in
Makefilehttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/Makefile
Makefilehttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/Makefile
README.mdhttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/README.md
README.mdhttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/README.md
license_preamble.txthttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/license_preamble.txt
license_preamble.txthttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/license_preamble.txt
pylintrchttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/pylintrc
pylintrchttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/pylintrc
requirements.txthttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/requirements.txt
requirements.txthttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/requirements.txt
setup.pyhttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/setup.py
setup.pyhttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/setup.py
READMEhttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream
Contributinghttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream
Apache-2.0 licensehttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream
https://github.com/google/JetStream/actions/workflows/unit_tests.yaml?query=branch:main
https://badge.fury.io/py/google-jetstream
https://pypi.org/project/google-jetstream/
https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/CONTRIBUTING.md
tpu-inferencehttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/tpu.vllm.ai
tpu.vllm.aihttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/blob/main/tpu.vllm.ai
https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream#jetstream-is-a-throughput-and-memory-optimized-engine-for-llm-inference-on-xla-devices
https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream#about
https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream#jetstream-engine-implementation
https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream#jax
https://github.com/google/maxtexthttps://github.com/google/maxtext
https://github.com/google/JetStream/blob/main/docs/online-inference-with-maxtext-engine.mdhttps://github.com/google/JetStream/blob/main/docs/online-inference-with-maxtext-engine.md
https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream#pytorch
https://github.com/google/jetstream-pytorchhttps://github.com/google/jetstream-pytorch
https://github.com/google/jetstream-pytorch/blob/main/README.mdhttps://github.com/google/jetstream-pytorch/blob/main/README.md
https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream#documentation
Online Inference with MaxText on v5e Cloud TPU VMhttps://cloud.google.com/tpu/docs/tutorials/LLM/jetstream
READMEhttps://github.com/google/JetStream/blob/main/docs/online-inference-with-maxtext-engine.md
Online Inference with Pytorch on v5e Cloud TPU VMhttps://cloud.google.com/tpu/docs/tutorials/LLM/jetstream-pytorch
READMEhttps://github.com/google/jetstream-pytorch/tree/main?tab=readme-ov-file#jetstream-pytorch
Serve Gemma using TPUs on GKE with JetStreamhttps://cloud.google.com/kubernetes-engine/docs/tutorials/serve-gemma-tpu-jetstream
Benchmark JetStream Serverhttps://github.com/google/JetStream/blob/main/benchmarks/README.md
Observability in JetStream Serverhttps://github.com/google/JetStream/blob/main/docs/observability-prometheus-metrics-in-jetstream-server.md
Profiling in JetStream Serverhttps://github.com/google/JetStream/blob/main/docs/profiling-with-jax-profiler-and-tensorboard.md
JetStream Standalone Local Setuphttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream#jetstream-standalone-local-setup
https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream#jetstream-standalone-local-setup
https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream#getting-started
https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream#setup
https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream#run-local-server--testing
https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream#test-core-modules
gpu https://patch-diff.githubusercontent.com/topics/gpu
inference https://patch-diff.githubusercontent.com/topics/inference
pytorch https://patch-diff.githubusercontent.com/topics/pytorch
transformer https://patch-diff.githubusercontent.com/topics/transformer
llama https://patch-diff.githubusercontent.com/topics/llama
gpt https://patch-diff.githubusercontent.com/topics/gpt
gemma https://patch-diff.githubusercontent.com/topics/gemma
model-serving https://patch-diff.githubusercontent.com/topics/model-serving
tpu https://patch-diff.githubusercontent.com/topics/tpu
jax https://patch-diff.githubusercontent.com/topics/jax
mlops https://patch-diff.githubusercontent.com/topics/mlops
large-language-models https://patch-diff.githubusercontent.com/topics/large-language-models
llm https://patch-diff.githubusercontent.com/topics/llm
llmops https://patch-diff.githubusercontent.com/topics/llmops
llm-inference https://patch-diff.githubusercontent.com/topics/llm-inference
llama2 https://patch-diff.githubusercontent.com/topics/llama2
Readme https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream#readme-ov-file
Apache-2.0 license https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream#Apache-2.0-1-ov-file
Contributing https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream#contributing-ov-file
Please reload this pagehttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream
Activityhttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/activity
Custom propertieshttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/custom-properties
403 starshttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/stargazers
21 watchinghttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/watchers
58 forkshttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/forks
Report repository https://patch-diff.githubusercontent.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2FAI-Hypercomputer%2FJetStream&report=AI-Hypercomputer+%28user%29
Releases 4https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/releases
v0.3 Latest Dec 18, 2024 https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/releases/tag/v0.3
+ 3 releaseshttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/releases
Packages 0https://patch-diff.githubusercontent.com/orgs/AI-Hypercomputer/packages?repo_name=JetStream
Please reload this pagehttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream
Contributors 38https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/graphs/contributors
Please reload this pagehttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream
+ 24 contributorshttps://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/graphs/contributors
Python 93.6% https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/search?l=python
Shell 5.7% https://patch-diff.githubusercontent.com/AI-Hypercomputer/JetStream/search?l=shell
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.