Published event
DeveloperTools
Funding
1 source(s)
PyTorch 2.2: FlashAttention-v2, AOTInductor
Summary
PyTorch 2.2: FlashAttention-v2, AOTInductor pytorch / pytorch Public Notifications You must be signed in to change notification settings Fork 30.5k Star 103k PyTorch 2.2: FlashAttention-v2, AOTInductor jcaip released this 30 Jan 17:58 · 44339 commits to main since this release v2.2.0 8ac9b20 This commit was created on GitHub.com and signed with GitHub’s verified signature . GPG key ID: 4AEE18F83AFDEB23 Expired Verified Learn about vigilant mode .
Why it matters
This Funding is relevant to the technology intelligence record because it involves GitHub, Amazon Web Services, Google, Meta. The source article should remain the factual reference for follow-up coverage.
Key facts
- pytorch / pytorch Public Notifications You must be signed in to change notification settings Fork 30.5k Star 103k PyTorch 2.2: FlashAttention-v2, AOTInductor jcaip released this 30 Jan 17:58 · 44339 commits to main since this release v2.2.0 8ac9b20 This commit was created on GitHub.com and signed with GitHub’s verified signature .
- GPG key ID: 4AEE18F83AFDEB23 Expired Verified Learn about vigilant mode .
- PyTorch 2.2 Release Notes Highlights Backwards Incompatible Changes Deprecations New Features Improvements Bug fixes Performance Documentation Highlights We are excited to announce the release of PyTorch® 2.2!
- PyTorch 2.2 offers ~2x performance improvements to scaled_dot_product_attention via FlashAttention-v2 integration, as well as AOTInductor, a new ahead-of-time compilation and deployment tool built for non-python server-side deployments.
- This release also includes improved torch.compile support for Optimizers, a number of new inductor optimizations, and a new logging mechanism called TORCH_LOGS.
- Please note that we are deprecating macOS x86 support , and PyTorch 2.2.x will be the last version that supports macOS x64.
Entities in this story
Related events