René's URL Explorer Experiment


Title: GitHub - AI-Hypercomputer/JetStream: JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

Open Graph Title: GitHub - AI-Hypercomputer/JetStream: JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

X Title: GitHub - AI-Hypercomputer/JetStream: JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

Description: JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome). - AI-Hypercomputer/JetStream

Open Graph Description: JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome). - AI-Hypercomputer/JetStream

X Description: JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome). - AI-Hypercomputer/JetStream

Opengraph URL: https://github.com/AI-Hypercomputer/JetStream

X: @github

direct link

Domain: github.com

route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:0e415df5-b902-1679-5ce9-a3c37c2da3eb
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-idD9F4:309065:305BEA5:3FD4FC3:696483D4
html-safe-nonce4d3325e09d783e0d6376bbe68ffb04c0e544ae6ed0eed4e193440c4c88dd3b1b
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJEOUY0OjMwOTA2NTozMDVCRUE1OjNGRDRGQzM6Njk2NDgzRDQiLCJ2aXNpdG9yX2lkIjoiODMxOTE2OTkyMTE2ODk5OTM3OSIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac8e58250c71aeb3186d8204e57d16fbb4231ee3e692af3a728edc8f01fee7d733
hovercard-subject-tagrepository:765455287
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/AI-Hypercomputer/JetStream
twitter:imagehttps://opengraph.githubassets.com/4effcee73ae26dde277d5442104bcaa9a28d5d9a32319f9de91cc862528ad50b/AI-Hypercomputer/JetStream
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/4effcee73ae26dde277d5442104bcaa9a28d5d9a32319f9de91cc862528ad50b/AI-Hypercomputer/JetStream
og:image:altJetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome). - AI-Hypercomputer/JetStream
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Nonebaa7d9900fdf7b27d604f36887af878d569cfbdcf97126832a5f4f0caf0c6ba5
turbo-cache-controlno-preview
go-importgithub.com/AI-Hypercomputer/JetStream git https://github.com/AI-Hypercomputer/JetStream.git
octolytics-dimension-user_id181000646
octolytics-dimension-user_loginAI-Hypercomputer
octolytics-dimension-repository_id765455287
octolytics-dimension-repository_nwoAI-Hypercomputer/JetStream
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id765455287
octolytics-dimension-repository_network_root_nwoAI-Hypercomputer/JetStream
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release842eff1d11f899d02b6b3b98fa3ea4860e64b34e
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/google/JetStream#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FAI-Hypercomputer%2FJetStream
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FAI-Hypercomputer%2FJetStream
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=AI-Hypercomputer%2FJetStream
Reloadhttps://github.com/google/JetStream
Reloadhttps://github.com/google/JetStream
Reloadhttps://github.com/google/JetStream
AI-Hypercomputer https://github.com/AI-Hypercomputer
JetStreamhttps://github.com/AI-Hypercomputer/JetStream
Notifications https://github.com/login?return_to=%2FAI-Hypercomputer%2FJetStream
Fork 58 https://github.com/login?return_to=%2FAI-Hypercomputer%2FJetStream
Star 399 https://github.com/login?return_to=%2FAI-Hypercomputer%2FJetStream
Apache-2.0 license https://github.com/AI-Hypercomputer/JetStream/blob/main/LICENSE
399 stars https://github.com/AI-Hypercomputer/JetStream/stargazers
58 forks https://github.com/AI-Hypercomputer/JetStream/forks
Branches https://github.com/AI-Hypercomputer/JetStream/branches
Tags https://github.com/AI-Hypercomputer/JetStream/tags
Activity https://github.com/AI-Hypercomputer/JetStream/activity
Star https://github.com/login?return_to=%2FAI-Hypercomputer%2FJetStream
Notifications https://github.com/login?return_to=%2FAI-Hypercomputer%2FJetStream
Code https://github.com/AI-Hypercomputer/JetStream
Issues 14 https://github.com/AI-Hypercomputer/JetStream/issues
Pull requests 12 https://github.com/AI-Hypercomputer/JetStream/pulls
Actions https://github.com/AI-Hypercomputer/JetStream/actions
Projects 0 https://github.com/AI-Hypercomputer/JetStream/projects
Security Uh oh! There was an error while loading. Please reload this page. https://github.com/AI-Hypercomputer/JetStream/security
Please reload this pagehttps://github.com/google/JetStream
Insights https://github.com/AI-Hypercomputer/JetStream/pulse
Code https://github.com/AI-Hypercomputer/JetStream
Issues https://github.com/AI-Hypercomputer/JetStream/issues
Pull requests https://github.com/AI-Hypercomputer/JetStream/pulls
Actions https://github.com/AI-Hypercomputer/JetStream/actions
Projects https://github.com/AI-Hypercomputer/JetStream/projects
Security https://github.com/AI-Hypercomputer/JetStream/security
Insights https://github.com/AI-Hypercomputer/JetStream/pulse
Brancheshttps://github.com/AI-Hypercomputer/JetStream/branches
Tagshttps://github.com/AI-Hypercomputer/JetStream/tags
https://github.com/AI-Hypercomputer/JetStream/branches
https://github.com/AI-Hypercomputer/JetStream/tags
258 Commitshttps://github.com/AI-Hypercomputer/JetStream/commits/main/
https://github.com/AI-Hypercomputer/JetStream/commits/main/
.githubhttps://github.com/AI-Hypercomputer/JetStream/tree/main/.github
.githubhttps://github.com/AI-Hypercomputer/JetStream/tree/main/.github
benchmarkshttps://github.com/AI-Hypercomputer/JetStream/tree/main/benchmarks
benchmarkshttps://github.com/AI-Hypercomputer/JetStream/tree/main/benchmarks
docshttps://github.com/AI-Hypercomputer/JetStream/tree/main/docs
docshttps://github.com/AI-Hypercomputer/JetStream/tree/main/docs
experimentalhttps://github.com/AI-Hypercomputer/JetStream/tree/main/experimental
experimentalhttps://github.com/AI-Hypercomputer/JetStream/tree/main/experimental
jetstreamhttps://github.com/AI-Hypercomputer/JetStream/tree/main/jetstream
jetstreamhttps://github.com/AI-Hypercomputer/JetStream/tree/main/jetstream
.coveragerchttps://github.com/AI-Hypercomputer/JetStream/blob/main/.coveragerc
.coveragerchttps://github.com/AI-Hypercomputer/JetStream/blob/main/.coveragerc
.gitattributeshttps://github.com/AI-Hypercomputer/JetStream/blob/main/.gitattributes
.gitattributeshttps://github.com/AI-Hypercomputer/JetStream/blob/main/.gitattributes
.gitignorehttps://github.com/AI-Hypercomputer/JetStream/blob/main/.gitignore
.gitignorehttps://github.com/AI-Hypercomputer/JetStream/blob/main/.gitignore
AUTHORShttps://github.com/AI-Hypercomputer/JetStream/blob/main/AUTHORS
AUTHORShttps://github.com/AI-Hypercomputer/JetStream/blob/main/AUTHORS
CONTRIBUTING.mdhttps://github.com/AI-Hypercomputer/JetStream/blob/main/CONTRIBUTING.md
CONTRIBUTING.mdhttps://github.com/AI-Hypercomputer/JetStream/blob/main/CONTRIBUTING.md
LICENSEhttps://github.com/AI-Hypercomputer/JetStream/blob/main/LICENSE
LICENSEhttps://github.com/AI-Hypercomputer/JetStream/blob/main/LICENSE
MANIFEST.inhttps://github.com/AI-Hypercomputer/JetStream/blob/main/MANIFEST.in
MANIFEST.inhttps://github.com/AI-Hypercomputer/JetStream/blob/main/MANIFEST.in
Makefilehttps://github.com/AI-Hypercomputer/JetStream/blob/main/Makefile
Makefilehttps://github.com/AI-Hypercomputer/JetStream/blob/main/Makefile
README.mdhttps://github.com/AI-Hypercomputer/JetStream/blob/main/README.md
README.mdhttps://github.com/AI-Hypercomputer/JetStream/blob/main/README.md
license_preamble.txthttps://github.com/AI-Hypercomputer/JetStream/blob/main/license_preamble.txt
license_preamble.txthttps://github.com/AI-Hypercomputer/JetStream/blob/main/license_preamble.txt
pylintrchttps://github.com/AI-Hypercomputer/JetStream/blob/main/pylintrc
pylintrchttps://github.com/AI-Hypercomputer/JetStream/blob/main/pylintrc
requirements.txthttps://github.com/AI-Hypercomputer/JetStream/blob/main/requirements.txt
requirements.txthttps://github.com/AI-Hypercomputer/JetStream/blob/main/requirements.txt
setup.pyhttps://github.com/AI-Hypercomputer/JetStream/blob/main/setup.py
setup.pyhttps://github.com/AI-Hypercomputer/JetStream/blob/main/setup.py
READMEhttps://github.com/google/JetStream
Contributinghttps://github.com/google/JetStream
Apache-2.0 licensehttps://github.com/google/JetStream
https://github.com/google/JetStream/actions/workflows/unit_tests.yaml?query=branch:main
https://badge.fury.io/py/google-jetstream
https://pypi.org/project/google-jetstream/
https://github.com/AI-Hypercomputer/JetStream/blob/main/CONTRIBUTING.md
tpu-inferencehttps://github.com/AI-Hypercomputer/JetStream/blob/main/tpu.vllm.ai
tpu.vllm.aihttps://github.com/AI-Hypercomputer/JetStream/blob/main/tpu.vllm.ai
https://github.com/google/JetStream#jetstream-is-a-throughput-and-memory-optimized-engine-for-llm-inference-on-xla-devices
https://github.com/google/JetStream#about
https://github.com/google/JetStream#jetstream-engine-implementation
https://github.com/google/JetStream#jax
https://github.com/google/maxtexthttps://github.com/google/maxtext
https://github.com/google/JetStream/blob/main/docs/online-inference-with-maxtext-engine.mdhttps://github.com/google/JetStream/blob/main/docs/online-inference-with-maxtext-engine.md
https://github.com/google/JetStream#pytorch
https://github.com/google/jetstream-pytorchhttps://github.com/google/jetstream-pytorch
https://github.com/google/jetstream-pytorch/blob/main/README.mdhttps://github.com/google/jetstream-pytorch/blob/main/README.md
https://github.com/google/JetStream#documentation
Online Inference with MaxText on v5e Cloud TPU VMhttps://cloud.google.com/tpu/docs/tutorials/LLM/jetstream
READMEhttps://github.com/google/JetStream/blob/main/docs/online-inference-with-maxtext-engine.md
Online Inference with Pytorch on v5e Cloud TPU VMhttps://cloud.google.com/tpu/docs/tutorials/LLM/jetstream-pytorch
READMEhttps://github.com/google/jetstream-pytorch/tree/main?tab=readme-ov-file#jetstream-pytorch
Serve Gemma using TPUs on GKE with JetStreamhttps://cloud.google.com/kubernetes-engine/docs/tutorials/serve-gemma-tpu-jetstream
Benchmark JetStream Serverhttps://github.com/google/JetStream/blob/main/benchmarks/README.md
Observability in JetStream Serverhttps://github.com/google/JetStream/blob/main/docs/observability-prometheus-metrics-in-jetstream-server.md
Profiling in JetStream Serverhttps://github.com/google/JetStream/blob/main/docs/profiling-with-jax-profiler-and-tensorboard.md
JetStream Standalone Local Setuphttps://github.com/google/JetStream#jetstream-standalone-local-setup
https://github.com/google/JetStream#jetstream-standalone-local-setup
https://github.com/google/JetStream#getting-started
https://github.com/google/JetStream#setup
https://github.com/google/JetStream#run-local-server--testing
https://github.com/google/JetStream#test-core-modules
gpu https://github.com/topics/gpu
inference https://github.com/topics/inference
pytorch https://github.com/topics/pytorch
transformer https://github.com/topics/transformer
llama https://github.com/topics/llama
gpt https://github.com/topics/gpt
gemma https://github.com/topics/gemma
model-serving https://github.com/topics/model-serving
tpu https://github.com/topics/tpu
jax https://github.com/topics/jax
mlops https://github.com/topics/mlops
large-language-models https://github.com/topics/large-language-models
llm https://github.com/topics/llm
llmops https://github.com/topics/llmops
llm-inference https://github.com/topics/llm-inference
llama2 https://github.com/topics/llama2
Readme https://github.com/google/JetStream#readme-ov-file
Apache-2.0 license https://github.com/google/JetStream#Apache-2.0-1-ov-file
Contributing https://github.com/google/JetStream#contributing-ov-file
Please reload this pagehttps://github.com/google/JetStream
Activityhttps://github.com/AI-Hypercomputer/JetStream/activity
Custom propertieshttps://github.com/AI-Hypercomputer/JetStream/custom-properties
399 starshttps://github.com/AI-Hypercomputer/JetStream/stargazers
20 watchinghttps://github.com/AI-Hypercomputer/JetStream/watchers
58 forkshttps://github.com/AI-Hypercomputer/JetStream/forks
Report repository https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2FAI-Hypercomputer%2FJetStream&report=AI-Hypercomputer+%28user%29
Releases 4https://github.com/AI-Hypercomputer/JetStream/releases
v0.3 Latest Dec 18, 2024 https://github.com/AI-Hypercomputer/JetStream/releases/tag/v0.3
+ 3 releaseshttps://github.com/AI-Hypercomputer/JetStream/releases
Packages 0https://github.com/orgs/AI-Hypercomputer/packages?repo_name=JetStream
Please reload this pagehttps://github.com/google/JetStream
Contributors 38https://github.com/AI-Hypercomputer/JetStream/graphs/contributors
Please reload this pagehttps://github.com/google/JetStream
+ 24 contributorshttps://github.com/AI-Hypercomputer/JetStream/graphs/contributors
Python 93.6% https://github.com/AI-Hypercomputer/JetStream/search?l=python
Shell 5.7% https://github.com/AI-Hypercomputer/JetStream/search?l=shell
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.