Title: GitHub - DeepDriving/TensorRT-LLM: TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
Open Graph Title: GitHub - DeepDriving/TensorRT-LLM: TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
X Title: GitHub - DeepDriving/TensorRT-LLM: TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
Description: TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines. - DeepDriving/TensorRT-LLM
Open Graph Description: TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie...
X Description: TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie...
Opengraph URL: https://github.com/DeepDriving/TensorRT-LLM
X: @github
Domain: patch-diff.githubusercontent.com
| route-pattern | /:user_id/:repository |
| route-controller | files |
| route-action | disambiguate |
| fetch-nonce | v2:7496fc1a-1a79-ca43-9f50-e52bb7ff1b95 |
| current-catalog-service-hash | f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb |
| request-id | 80FC:2586AA:123E7EF:177C778:69755757 |
| html-safe-nonce | 41bedeed97e225b21f574cff6b72f35c6b6e1a1235b5913fa8eed118b9c02561 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4MEZDOjI1ODZBQToxMjNFN0VGOjE3N0M3Nzg6Njk3NTU3NTciLCJ2aXNpdG9yX2lkIjoiMzE3NjI5NDcwNzU1NjEzMDMiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ== |
| visitor-hmac | 5cb9993a18d420f0bf0f0c2bc9d683dae68a000613f897d4e663663610493434 |
| hovercard-subject-tag | repository:717706485 |
| github-keyboard-shortcuts | repository,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/DeepDriving/TensorRT-LLM |
| twitter:image | https://opengraph.githubassets.com/014aa006003cfedd2a74ca4b35369b2d14ccf766bfa9e4e9b8592193acdf4bc4/DeepDriving/TensorRT-LLM |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/014aa006003cfedd2a74ca4b35369b2d14ccf766bfa9e4e9b8592193acdf4bc4/DeepDriving/TensorRT-LLM |
| og:image:alt | TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | 4a4bf5f4e28041a9d2e5c107d7d20b78b4294ba261cab243b28167c16a623a1f |
| turbo-cache-control | no-preview |
| go-import | github.com/DeepDriving/TensorRT-LLM git https://github.com/DeepDriving/TensorRT-LLM.git |
| octolytics-dimension-user_id | 2389926 |
| octolytics-dimension-user_login | DeepDriving |
| octolytics-dimension-repository_id | 717706485 |
| octolytics-dimension-repository_nwo | DeepDriving/TensorRT-LLM |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | true |
| octolytics-dimension-repository_parent_id | 679366051 |
| octolytics-dimension-repository_parent_nwo | NVIDIA/TensorRT-LLM |
| octolytics-dimension-repository_network_root_id | 679366051 |
| octolytics-dimension-repository_network_root_nwo | NVIDIA/TensorRT-LLM |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 488b30e96dfd057fbbe44c6665ccbc030b729dde |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width
