Title: GitHub - DeepDriving/TensorRT-LLM: TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines. · GitHub
Open Graph Title: GitHub - DeepDriving/TensorRT-LLM: TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
X Title: GitHub - DeepDriving/TensorRT-LLM: TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
Description: TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines. - DeepDriving/TensorRT-LLM
Open Graph Description: TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie...
X Description: TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie...
Opengraph URL: https://github.com/DeepDriving/TensorRT-LLM
X: @github
Domain: github.com
| route-pattern | /:user_id/:repository |
| route-controller | files |
| route-action | disambiguate |
| fetch-nonce | v2:979fb9b6-3984-78c2-fcbe-8f7b9fcbc28f |
| current-catalog-service-hash | f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb |
| request-id | 8B8E:20ED06:C88951:10B281B:6A52A42B |
| html-safe-nonce | 93b8a45f18dd566a7e6eb1cc1270cb0210c5105f9d02dbbc9b88665b4b19d799 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4QjhFOjIwRUQwNjpDODg5NTE6MTBCMjgxQjo2QTUyQTQyQiIsInZpc2l0b3JfaWQiOiIzODk3ODkyOTk3MTI4NDMwNjM1IiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0= |
| visitor-hmac | eab8a471200b47ad864b727d4d3903284f1d5ae617687a5b54cd59e24e35c103 |
| hovercard-subject-tag | repository:717706485 |
| github-keyboard-shortcuts | repository,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/DeepDriving/TensorRT-LLM |
| twitter:image | https://opengraph.githubassets.com/014aa006003cfedd2a74ca4b35369b2d14ccf766bfa9e4e9b8592193acdf4bc4/DeepDriving/TensorRT-LLM |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/014aa006003cfedd2a74ca4b35369b2d14ccf766bfa9e4e9b8592193acdf4bc4/DeepDriving/TensorRT-LLM |
| og:image:alt | TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | b9a586c06a05a7a86fc7e3f4dbd03e42f6869085879aa184aa6369456dbd50fb |
| turbo-cache-control | no-cache |
| go-import | github.com/DeepDriving/TensorRT-LLM git https://github.com/DeepDriving/TensorRT-LLM.git |
| octolytics-dimension-user_id | 2389926 |
| octolytics-dimension-user_login | DeepDriving |
| octolytics-dimension-repository_id | 717706485 |
| octolytics-dimension-repository_nwo | DeepDriving/TensorRT-LLM |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | true |
| octolytics-dimension-repository_parent_id | 679366051 |
| octolytics-dimension-repository_parent_nwo | NVIDIA/TensorRT-LLM |
| octolytics-dimension-repository_network_root_id | 679366051 |
| octolytics-dimension-repository_network_root_nwo | NVIDIA/TensorRT-LLM |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 07a982c1d40157c619b364352b704c3ce66bb332 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width
