Title: chore(deps): bump torch from 2.0.1 to 2.5.1 by dependabot[bot] · Pull Request #1924 · docarray/docarray · GitHub
Open Graph Title: chore(deps): bump torch from 2.0.1 to 2.5.1 by dependabot[bot] · Pull Request #1924 · docarray/docarray
X Title: chore(deps): bump torch from 2.0.1 to 2.5.1 by dependabot[bot] · Pull Request #1924 · docarray/docarray
Description: Bumps torch from 2.0.1 to 2.5.1.
Release notes
Sourced from torch's releases.
PyTorch 2.5.1: bug fix release
This release is meant to fix the following regressions:
Wheels from PyPI are unusable out of the box on PRM-based Linux distributions: pytorch/pytorch#138324
PyPI arm64 distribution logs cpuinfo error on import: pytorch/pytorch#138333
Crash When Using torch.compile with Math scaled_dot_product_attention in AMP Mode: pytorch/pytorch#133974
[MPS] Internal crash due to the invalid buffer size computation if sliced API is used: pytorch/pytorch#137800
Several issues related to CuDNN Attention: pytorch/pytorch#138522
Besides the regression fixes, the release includes several documentation updates.
See release tracker pytorch/pytorch#132400 for additional information.
PyTorch 2.5.0 Release, SDPA CuDNN backend, Flex Attention
PyTorch 2.5 Release Notes
Highlights
Backwards Incompatible Change
Deprecations
New Features
Improvements
Bug fixes
Performance
Documentation
Developers
Security
Highlights
We are excited to announce the release of PyTorch® 2.5! This release features a new CuDNN backend for SDPA, enabling speedups by default for users of SDPA on H100s or newer GPUs. As well, regional compilation of torch.compile offers a way to reduce the cold start up time for torch.compile by allowing users to compile a repeated nn.Module (e.g. a transformer layer in LLM) without recompilations. Finally, TorchInductor CPP backend offers solid performance speedup with numerous enhancements like FP16 support, CPP wrapper, AOT-Inductor mode, and max-autotune mode.
This release is composed of 4095 commits from 504 contributors since PyTorch 2.4. We want to sincerely thank our dedicated community for your contributions. As always, we encourage you to try these out and report any issues as we improve 2.5. More information about how to get started with the PyTorch 2-series can be found at our Getting Started page.
As well, please check out our new ecosystem projects releases with TorchRec and TorchFix.
Beta
Prototype
CuDNN backend for SDPA
FlexAttention
torch.compile regional compilation without recompilations
Compiled Autograd
TorchDynamo added support for exception handling & MutableMapping types
Flight Recorder
TorchInductor CPU backend optimization
Max-autotune Support on CPU with GEMM Template
TorchInductor on Windows
FP16 support on CPU path for both eager mode and TorchInductor CPP backend
Autoload Device Extension
Enhanced Intel GPU support
*To see a full list of public feature submissions click here.
BETA FEATURES
[Beta] CuDNN backend for SDPA
The cuDNN "Fused Flash Attention" backend was landed for torch.nn.functional.scaled_dot_product_attention. On NVIDIA H100 GPUs this can provide up to 75% speed-up over FlashAttentionV2. This speedup is enabled by default for all users of SDPA on H100 or newer GPUs.
[Beta] torch.compile regional compilation without recompilations
Regional compilation without recompilations, via torch._dynamo.config.inline_inbuilt_nn_modules which default to True in 2.5+. This option allows users to compile a repeated nn.Module (e.g. a transformer layer in LLM) without recompilations. Compared to compiling the full model, this option can result in smaller compilation latencies with 1%-5% performance degradation compared to full model compilation.
... (truncated)
Commits
a8d6afb Disabling amp context when invoking compiler (#138659)
f31b8bb [MPS] Fix sliced cast (#138535)
848e7ac [SDPA-CUDNN] Make CuDNN Attention Opt in (#138587)
885c823 Update doc copyrights to 2024 (#138650)
8c3ed97 Update cpuinfo submodule (#138600)
70cf2bb Add link to torch.compile the missing manual in troubleshooting (#137369)
cde6b38 Don't try to load cufile (#138539)
4076a73 [Cherry-Pick] Use cuda 12.4 pytorch_extra_install_requirements as default (#1...
a97c151 update getting started xpu (#138090)
32f585d [Release only] use triton 3.1.x from pypi (#137895)
Additional commits viewable in compare view
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.
Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
@dependabot rebase will rebase this PR
@dependabot recreate will recreate this PR, overwriting any edits that have been made to it
@dependabot merge will merge this PR after your CI passes on it
@dependabot squash and merge will squash and merge this PR after your CI passes on it
@dependabot cancel merge will cancel a previously requested merge and block automerging
@dependabot reopen will reopen this PR if it is closed
@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
@dependabot show
Open Graph Description: Bumps torch from 2.0.1 to 2.5.1. Release notes Sourced from torch's releases. PyTorch 2.5.1: bug fix release This release is meant to fix the following regressions: Wheels from PyPI are unus...
X Description: Bumps torch from 2.0.1 to 2.5.1. Release notes Sourced from torch's releases. PyTorch 2.5.1: bug fix release This release is meant to fix the following regressions: Wheels from PyPI are ...
Opengraph URL: https://github.com/docarray/docarray/pull/1924
X: @github
Domain: github.com
| route-pattern | /:user_id/:repository/pull/:id/files(.:format) |
| route-controller | pull_requests |
| route-action | files |
| fetch-nonce | v2:be8d9d0b-3c08-54ea-3acc-76669fdb4a42 |
| current-catalog-service-hash | ae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b |
| request-id | 90D6:1C08BC:2EB2019:4005E84:6964E614 |
| html-safe-nonce | f4e2775ea91d2d5ca9ec8868d0062db4b65173102f0086cab9fb17f088d3f627 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI5MEQ2OjFDMDhCQzoyRUIyMDE5OjQwMDVFODQ6Njk2NEU2MTQiLCJ2aXNpdG9yX2lkIjoiMzIzMTgxNjE1ODc0NTUxOTYzNiIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | 9213cf2300b820f6c4c28eae13124899f4cdacf57c67c47ae0f94dffc05ded53 |
| hovercard-subject-tag | pull_request:2468680816 |
| github-keyboard-shortcuts | repository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/docarray/docarray/pull/1924/files |
| twitter:image | https://avatars.githubusercontent.com/in/29110?s=400&v=4 |
| twitter:card | summary_large_image |
| og:image | https://avatars.githubusercontent.com/in/29110?s=400&v=4 |
| og:image:alt | Bumps torch from 2.0.1 to 2.5.1. Release notes Sourced from torch's releases. PyTorch 2.5.1: bug fix release This release is meant to fix the following regressions: Wheels from PyPI are unus... |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | 3c30097417ecb9dfdab6b2e8bc7dc38d73e183d6ad48f94cb69e4a5daa2dbb87 |
| turbo-cache-control | no-preview |
| diff-view | unified |
| go-import | github.com/docarray/docarray git https://github.com/docarray/docarray.git |
| octolytics-dimension-user_id | 117445116 |
| octolytics-dimension-user_login | docarray |
| octolytics-dimension-repository_id | 438303578 |
| octolytics-dimension-repository_nwo | docarray/docarray |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 438303578 |
| octolytics-dimension-repository_network_root_nwo | docarray/docarray |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | true |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 69fc54a84c74307369dba42af5401200531d116e |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width