PyTorch @PyTorch Twitter profile

Pinned Tweet

PyTorch

19 days

PyTorch Conference registration is now OPEN! Join us in San Francisco to immerse yourself in top-tier content, connect globally with developers, and stay at the forefront of the evolving tech landscape of AI. Secure your spot:

3

32

113

Last Seen Profiles

@_AMPERSANDONE_

@hisymbolofpaix

@buroyalsmhockey

@PEER_HQ

@pom_numa

@McCannTrans

@Styvaether

@CirnoFumofumo

@KissesDelavin

@canvasoul_

@AlisonKetz

@OvoOsha

@Bene1925

@alisssmata

@RHINOSHIELD_FR

@CRISPRTX

@AssemblyOfSoul

@MylesOneil

@JClementbank

@cintsxv

@lunatic_vzu

@Digital_usaGi

@_cosmerepo

@bkharashi

@NyanNyanners

@HARIBOJP

@Marshall_LR

@bedkhil

@claumahi

@adoreMadomme

@bangaritan

@_Aldawlah

@HowieMooney

@KingSno_

@UTSAStudents

@LandsharkFB

PyTorch

@PyTorch

2 years

Today marks 5 years since the public release of PyTorch! We didn't expect to come this far, but here we're🙂- 2K Contributors, 90K Projects, 3.9M lines of "import torch" on GitHub. More importantly, we're still receiving lots of love and having a great ride. Here's to the future!

62

462

3K

PyTorch

@PyTorch

2 years

We’re excited to announce support for GPU-accelerated PyTorch training on Mac! Now you can take advantage of Apple silicon GPUs to perform ML workflows like prototyping and fine-tuning. Learn more:

79

711

3K

PyTorch

@PyTorch

4 years

To help developers get started with PyTorch, we’re making the 'Deep Learning with PyTorch' book, written by Luca Antiga and Eli Stevens, available for free to the community:

36

924

3K

PyTorch

@PyTorch

4 years

The full version of the Deep Learning with PyTorch book from Luca Antiga, Eli Stevens, and Thomas Viehmann is now available! New chapters include in-depth real-world examples and production deployment. Grab a free digital copy on:

26

726

2K

PyTorch

@PyTorch

1 year

We’re excited to announce the release of PyTorch 2.0! This version includes: ⚙️ 100% backward compatible 📦 Out of the box performance 📶 Significant speed improvements Learn more 👇

26

619

2K

PyTorch

@PyTorch

7 months

Inside the Matrix: Use 3D to visualize matrix multiplication expressions, attention heads with real weights, and more. ⚡ Read our latest post on visualizing matrix multiplication, attention and beyond:

13

417

2K

PyTorch

@PyTorch

1 year

We just introduced PyTorch 2.0 at the #PyTorchConference , introducing torch.compile! Available in the nightlies today, stable release Early March 2023. Read the full post: 🧵below! 1/5

23

524

2K

PyTorch

@PyTorch

3 years

Want to make your inference code in PyTorch run faster? Here’s a quick thread on doing exactly that. 1. Replace () with the ✨torch.inference_mode()✨ context manager.

8

364

2K

PyTorch

@PyTorch

5 months

10x performance on LLaMa 7B, all in native PyTorch. No C++ needed. Check out our second blog post in a series on Accelerating Generative AI using Native PyTorch. 🔥

Accelerating Generative AI with PyTorch II: GPT, Fast

This post is the second part of a multi-series blog focused on how to accelerate generative AI models with pure, native PyTorch. We are excited to share a breadth of newly released PyTorch performa...

pytorch.org

14

266

2K

PyTorch

@PyTorch

5 years

PyTorch is now installed by default on Google Colaboratory. Go ahead and `import torch`, `import torchvision`, `import torchtext`

26

452

2K

PyTorch

@PyTorch

3 years

We're excited to release the torch.fft module in PyTorch 1.8. This module implements the same functions as NumPy’s np.fft module, but with support for accelerators, like GPUs, and autograd. Learn more 👉

17

276

2K

PyTorch

@PyTorch

5 years

Microsoft VSCode integrates deeply with PyTorch out of the box. As @aerinykim highlights: 1. It shows values inside tensors. (Left panel) 2. By simply mousing over, you can see the variable's shape, weight, bias, dtype, device, etc.

24

429

2K

PyTorch

@PyTorch

12 days

Announcing the alpha release of torchtune! torchtune is a PyTorch-native library for fine-tuning LLMs. It combines hackable memory-efficient fine-tuning recipes with integrations into your favorite tools. Get started fine-tuning today! Details:

torchtune: Easily fine-tune LLMs using PyTorch

We’re pleased to announce the alpha release of torchtune, a PyTorch-native library for easily fine-tuning large language models.

pytorch.org

19

304

2K

PyTorch

@PyTorch

3 years

Introducing torch.profiler! New PyTorch Profiler collects both GPU and framework related info, correlates them, performs automatic detection of bottlenecks in the model, generates recommendations on how to resolve these bottlenecks, and visualize. Read 👉

5

332

1K

PyTorch

@PyTorch

3 years

PyTorch 1.8 is here! Highlights include updates for compiler, code optimization, frontend APIs for scientific computing, large scale training for pipeline and model parallelism, and Mobile tutorials. Blog👇

PyTorch 1.8 Release, including Compiler and Distributed Training updates, and New Mobile Tutorials

We are excited to announce the availability of PyTorch 1.8. This release is composed of more than 3,000 commits since 1.7. It includes major updates and new features for compilation, code optimizat...

pytorch.org

1

278

1K

PyTorch

@PyTorch

5 years

Learn PyTorch on GPUs for free via Google Colaboratory each PyTorch tutorial now has a link to open it on Colab, where you can interactively execute and play with code. #thanksgoogle

4

283

1K

PyTorch

@PyTorch

3 years

Introducing VISSL () - a library for reproducible, SOTA self-supervised learning for computer vision! Over 10 methods implemented, 60 pre-trained models, 15 benchmarks, and counting.

10

257

1K

PyTorch

@PyTorch

5 months

Understanding GPU Memory 1: Visualizing All Allocations over Time 👀 In part 1 of this series, we show how to use Memory Snapshot, the Memory Profiler, and the Reference Cycle Detector to debug out of memory errors and improve memory usage. Read more:

1

192

1K

PyTorch

@PyTorch

3 months

PyTorch 2.2 is here 🎉 Featuring: - SDPA support of FlashAttention-2 - New ahead-of-time extension of TorchInductor - device_mesh, a new abstraction for initializing and representing ProcessGroups - A standardized, configurable logging mechanism called TORCH_LOGS

12

196

1K

PyTorch

@PyTorch

3 years

PyTorch 1.9 is here! Highlights include improvements for: - torch.linalg, torch.special, and Complex Autograd - Mobile Interpreter - TorchElastic - The PyTorch RPC framework - APIs for model inference deployment - PyTorch Profiler See full details👇

PyTorch 1.9 Release, including torch.linalg and Mobile Interpreter

We are excited to announce the release of PyTorch 1.9. The release is composed of more than 3,400 commits since 1.8, made by 398 contributors. The release notes are available here. Highlights...

pytorch.org

6

262

1K

PyTorch

@PyTorch

5 years

A walkthrough of the PyTorch Internals by core developer @ezyang . It's a great resource if you want to contribute to PyTorch.

8

317

1K

PyTorch

@PyTorch

7 years

GPU Tensors, Dynamic Neural Networks and deep Python integration. Hello world!

14

530

946

PyTorch

@PyTorch

5 years

[v1.1.0] Official TensorBoard Support, Attributes, Dicts, Lists and User-defined types in JIT / TorchScript, Improved Distributed Read more about the changes at As always, get the install commands on

Release Official TensorBoard Support, Attributes, Dicts, Lists and User-defined types in JIT /...

Note: CUDA 8.0 is no longer supported Highlights TensorBoard (currently experimental) First-class and native support for visualization and model debugging with TensorBoard, a web application suite ...

github.com

2

319

928

PyTorch

@PyTorch

5 years

[v1.0] : JIT Compiler, Faster Distributed, C++ Frontend, CUDA10 Read more about the changes at As always, get the install commands on

Release JIT Compiler, Faster Distributed, C++ Frontend · pytorch/pytorch

Table of Contents Highlights JIT Brand New Distributed Package C++ Frontend [API Unstable] Torch Hub Breaking Changes Additional New Features N-dimensional empty tensors New Operators New Dist...

github.com

13

328

923

PyTorch

@PyTorch

5 years

Happy 3rd Birthday TensorFlow! Looking forward to competing with and complementing you over the years. #HappyBirthdayTF

TensorFlow

@TensorFlow

5 years

Happy 3rd birthday TensorFlow! We've come a long way since the first release in 2015 & TensorFlow wouldn't be the framework it is today without you. As we work on #TensorFlow20 , look at all the features we've added over the years to make TensorFlow easier to use. #HappyBirthdayTF

26

549

2K

12

119

889

PyTorch

@PyTorch

5 years

torchvision 0.3.0: segmentation, detection models, new datasets, C++/CUDA operators Blog with link to tutorial, release notes: Install commands have changed, use the selector on

9

273

877

PyTorch

@PyTorch

4 years

Stochastic Weight Averaging (SWA) is a simple procedure that improves generalization in deep learning over Stochastic Gradient Descent (SGD). PyTorch 1.6 now includes SWA natively. Learn more from @Pavel_Izmailov , @andrewgwils and Vincent:

PyTorch 1.6 now includes Stochastic Weight Averaging

Do you use stochastic gradient descent (SGD) or Adam? Regardless of the procedure you use to train your neural network, you can likely achieve significantly better generalization at virtually no...

pytorch.org

5

207

864

PyTorch

@PyTorch

4 years

The full hands-on tutorials, "Building Recommender Systems with PyTorch", are now available. We show how to build deep learning recommendation system and resolve the associated interpretability, integrity, and privacy challenges. See:

Building Recommender Systems with PyTorch | Tutorial

www.youtube.com

3

198

844

PyTorch

@PyTorch

4 years

Disney uses PyTorch for animated character recognition and to speed up its video processing pipeline. @DTCITechnology engineers also contributed new features to the Torchvision domain library.

0

187

803

PyTorch

@PyTorch

4 years

PyTorch Lightning 1.0.0 is now available. This is the final stable API to train and deploy models at scale, without the boilerplate. Read more about this release below:

5

164

814

PyTorch

@PyTorch

1 year

If you installed PyTorch-nightly on Linux between Dec. 25 and Dec. 30, uninstall it and torchtriton immediately and use the latest nightly binaries. Read the security advisory here:

16

516

801

PyTorch

@PyTorch

4 years

v1.6: native mixed-precision support from NVIDIA (~2x perf improvement), distributed perf improvements, new profiling tool for memory consumption, Microsoft commits to developing and maintaining Windows PyTorch. Release Notes: Blog:

PyTorch 1.6 released w/ Native AMP Support, Microsoft joins as maintainers for Windows

Today, we’re announcing the availability of PyTorch 1.6, along with updated domain libraries. We are also excited to announce the team at Microsoft is now maintaining Windows builds and binaries and...

pytorch.org

5

241

798

PyTorch

@PyTorch

4 years

Today, we made usability and content improvements to PyTorch Tutorials including additional categories, a new recipe format for quickly referencing common topics, sorting using tags, and an updated homepage. Learn more:

11

192

781

PyTorch

@PyTorch

4 years

The team @WadhwaniAI has built a multi-task network that detects pest infestations in cotton crops. This technology is being put directly in the hands of more than 18,000 farmers across India using #PyTorch Mobile, TorchServe, and Weights & Biases.

11

174

779

PyTorch

@PyTorch

4 years

Welcome OpenAI to the PyTorch community!

OpenAI

@OpenAI

4 years

We're standardizing OpenAI's deep learning framework on PyTorch to increase our research productivity at scale on GPUs (and have just released a PyTorch version of Spinning Up in Deep RL):

35

536

2K

3

150

786

PyTorch

@PyTorch

6 years

Dear PyTorch users, We're sharing the roadmap for PyTorch 1.0: production ready PyTorch. Coming later this summer.

9

289

772

PyTorch

@PyTorch

5 years

DGL (Deep Graph Library) - Clean and efficient library to build graph neural networks including GCN, TreeLSTM and graph generative models. Includes auto-batching and other tricks for speed.

4

280

768

PyTorch

@PyTorch

4 months

Do you want to adapt an LLM on your own data and domain? 🤔 Learn how to finetune a 7B parameter model on a typical consumer GPU (NVIDIA T4 16GB) with LoRA and tools from the PyTorch and Hugging Face ecosystem in our latest post. Details 👉

7

182

768

PyTorch

@PyTorch

4 years

v1.7: CUDA 11 supported with binaries on , updated profiling/performance for RPC, TorchScript and Stack traces in the autograd profiler, support for NumPy compatible FFT via torch.fft. Release Notes: Blog: 👇

PyTorch 1.7 released w/ CUDA 11, New APIs for FFTs, Windows support for Distributed training and...

Today, we’re announcing the availability of PyTorch 1.7, along with updated domain libraries. The PyTorch 1.7 release includes a number of new APIs including support for NumPy-Compatible FFT operat...

pytorch.org

10

186

753

PyTorch

@PyTorch

6 years

Tensorboard-PyTorch plugin now includes graph visualization of your model. Live demo here: Github page:

0

279

750

PyTorch

@PyTorch

3 years

PyTorch 1.10 is here! Highlights include updates for: - CUDA Graphs APIs updates - Several frontend APIs moved to Stable - Automatic fusion in JIT Compiler support for CPU/GPUs - Android NNAPI now in beta Blog: Release:

Release PyTorch 1.10 Release, including CUDA Graphs APIs, Frontend and compiler improvements ·...

1.10.0 Release Notes Highlights Backwards Incompatible Change New Features Improvements Performance Documentation Highlights We are excited to announce the release of PyTorch 1.10. This release i...

github.com

12

163

651

PyTorch

@PyTorch

4 years

v1.5: autograd API for Hessians/Jacobians, C++ frontend stable and 100% parity with Python, Better performance on GPU and CPU with Tensor Format ‘channels last’, distributed.rpc stable, Custom C++ class binding Release notes: Blog:

PyTorch 1.5 released, new and updated APIs including C++ frontend API parity with Python

Today, we’re announcing the availability of PyTorch 1.5, along with new and updated libraries. This release includes several major new API additions and improvements. PyTorch now includes a signifi...

pytorch.org

4

223

733

PyTorch

@PyTorch

4 months

Part 2️⃣: Understanding GPU Memory 🤔 In our latest post, we will use the Memory Snapshot to visualize a GPU memory leak caused by reference cycles, and then locate and remove them in our code using the Reference Cycle Detector. Read more:

5

141

730

PyTorch

@PyTorch

6 years

We are a year old :) A post looking back at our journey, the lovely community, the engineering and love.

13

209

738

PyTorch

@PyTorch

6 years

Pyro, a probabilistic programming language on top of @PyTorch from Uber AI Labs

Uber AI Labs Open Sources Pyro, a Deep Probabilistic Programming Language | Uber Blog

Pyro is an open source probabilistic programming language that unites modern deep learning with Bayesian modeling for a tool-first approach to AI.

www.uber.com

4

340

725

PyTorch

@PyTorch

6 months

Announcing Flash-Decoding 🚀 Flash-Decoding makes LLM decoding much faster, and in particular allows to scale to very long sequence lengths (64k+) without slowdown! Read more on our blog:

2

132

720

PyTorch

@PyTorch

2 years

Today we’d like to highlight features from functorch, a beta PyTorch library that provides JAX-inspired function transformations like vmap. () If you’re not sure what sort of cool new things vmap allows you to do, read on to learn more! (1/n)

6

133

714

PyTorch

@PyTorch

4 years

Bolts is a new Deep Learning research and production toolbox from PyTorch Lightning. Iterate faster with pre-trained models, components, callbacks, and data sets, all modular, tested, and optimized for GPUs/TPUs. Simply subclass, override, and train.

1

203

693

PyTorch

@PyTorch

3 years

✨ Low Numerical Precision in PyTorch ✨ Most DL models are single-precision floats by default. Lower numerical precision - while reasonably maintaining accuracy - reduces: a) model size b) memory required c) power consumed Thread about lower precision DL in PyTorch -> 1/11

2

130

689

PyTorch

@PyTorch

4 months

3x faster text-to-image diffusion models, all in pure PyTorch. No C++ needed. Check out our third blog post in the series on Accelerating Generative AI using Native PyTorch. 🔥

8

121

698

PyTorch

@PyTorch

2 years

Two creators of passion projects that transformed the landscape of how we code today — Linus Torvalds and @soumithchintala meet for the first time, sharing a smile and a love for the open source community. #PyTorchFoundation

18

68

686

PyTorch

@PyTorch

6 years

MaskRCNN-Benchmark: - A fast, modular reference of {Mask,Faster}RCNN - by @fvsmassa (PyTorch), optimized by Nvidia - reusable components, pre-trained models - optimized inference, live demo Hope to see mmdetection and other great projects reuse the code!

8

236

681

PyTorch

@PyTorch

3 years

Together with @msdev , we’ve created a PyTorch “Learn the Basics” tutorial. Familiarize yourself with PyTorch concepts and modules. Learn how to load data, build deep neural networks, train and save your models in this quick-start guide. Get started now:

6

164

669

PyTorch

@PyTorch

4 years

@rstudio introduces Torch for R, an R package that allows researchers to use PyTorch functionality natively from R. No Python installation is required since torch is built directly on top of libtorch. Learn more:

6

201

670

PyTorch

@PyTorch

3 months

RoMa: an easy-to-to-use, stable and efficient library to deal with rotations and spatial transformations in PyTorch. Read all about this PyTorch Ecosystem Tool in our latest Medium post ⚡

18

118

647

PyTorch

@PyTorch

4 years

The Global PyTorch Summer Hackathon is back! This year, teams can compete in 3 categories: 1. Developer Tools 2. Web/Mobile applications 3. Responsible AI Development Tools Read more at: #PyTorchSummerHack

7

204

650

PyTorch

@PyTorch

2 years

Today, Mark Zuckerberg announced the launch of the #PyTorchFoundation under the @LinuxFoundation & a board of @Meta @AMD @awscloud @googlecloud @Azure & @NVIDIAAI . With these leaders, learn how we're giving the AI community tools to accelerate innovation.

13

159

649

PyTorch

@PyTorch

5 years

PyTorch BigGraph: a distributed system for learning large graph embeddings - up to billions of entities and trillions of edges - Sharding and Negative Sampling - WikiData embeddings (78 mil entities, 4131 relations) - Blog: - Code:

2

201

647

PyTorch

@PyTorch

5 years

Stochastic Weight Averaging: a simple procedure that improves generalization over SGD at no additional cost. Can be used as a drop-in replacement for any other optimizer in PyTorch. Read more: guest blogpost by @Pavel_Izmailov and @andrewgwils

3

188

614

PyTorch

@PyTorch

7 months

Announcing PyTorch 2.1 Stable Release ⚡✨ PyTorch 2.1 offers automatic dynamic shape and NumPy compilation support in torch.compile, as well as torch.distributed.checkpoint for saving/loading distributed training jobs on multiple ranks. Learn more 👇

6

139

613

PyTorch

@PyTorch

4 years

NeMo, @NVIDIA ’s open-source toolkit based on #PyTorch , allows you to quickly build, train, and fine-tune conversational AI models. See how speech recognition, natural language processing and speech synthesis can be improved in this tutorial:

0

180

602

PyTorch

@PyTorch

6 months

Announcing ExecuTorch 🚀 ExecuTorch offers a compact runtime with a lightweight operator registry to cover the PyTorch ecosystem of models, and a streamlined path to execute PyTorch programs on edge devices. Details:

11

132

605

PyTorch

@PyTorch

4 years

Hydra provides an ability to compose and override configuration from the command line and config files, helping PyTorch developers to more easily manage complex ML projects.

7

141

582

PyTorch

@PyTorch

7 years

PyTorch v0.2 is out: Higher order gradients, Distributed PyTorch, Broadcasting, Advanced Indexing, New Layers, more!

Release Higher order gradients, Distributed PyTorch, Broadcasting, Advanced Indexing, New Layers...

Here comes the next major release of PyTorch, just in time for ICML. Install it today from our website http://pytorch.org Package documentation for this release is available at http://pytorch.org/...

github.com

2

289

589

PyTorch

@PyTorch

3 years

We're excited to announce our first PyTorch Developer Day starting 8 AM on November 12, 2020 PST. Learn more: #PTD2

3

127

584

PyTorch

@PyTorch

6 years

PyTorch now available on @pypi $ pip install torch thanks to all the devs who worked on Warehouse -- the new PyPI infrastructure

5

161

573

PyTorch

@PyTorch

5 years

[v1.3.0] Named Tensors, iOS / Android support, Quantization, Type Promotion and more. Also available: TPU device, Detectron2, Captum for model interpretability, CrypTen for PPML research etc. Read more here: [Link to the PyTorch 1.3 blog]

PyTorch 1.3 adds mobile, privacy, quantization, and named tensors

PyTorch continues to gain momentum because of its focus on meeting the needs of researchers, its streamlined workflow for production use, and most of all because of the enthusiastic support it has...

pytorch.org

2

190

572

PyTorch

@PyTorch

6 years

[v0.4.1] Spectral Norm, Adaptive Softmax, faster CPU ops, anomaly detection (NaNs, etc.), Lots of bug fixes, Python 3.7 and CUDA 9.2 support and more. Full release notes at As always, update via commands at or via PyPI

Release Spectral Norm, Adaptive Softmax, faster CPU ops, anomaly detection (NaNs, etc.), Lots of...

Table of Contents Breaking Changes New Features Neural Networks Adaptive Softmax, Spectral Norm, etc. Operators torch.bincount, torch.as_tensor, ... torch.distributions Half Cauchy, Gamma ...

github.com

5

178

570

PyTorch

@PyTorch

4 years

TorchServe v0.1.1 is available with new features and support for HuggingFace BERT, Waveglow, Model Zoo, SnakeViz Profiler, AWS CloudFormation Template, and Automated Integration regression test suite. Read the release notes for details:

Release TorchServe v0.1.1 Release Notes (Experimental) · pytorch/serve

This is the release of TorchServe v0.1.1 Highlights: HuggingFace BERT Example - Support for HuggingFace Models demonstrated with examples under examples/ directory. Waveglow Example - Support for ...

github.com

2

139

569

PyTorch

@PyTorch

3 months

Happy to share an early version of float8_experimental, a library to accelerate training with float8 + torch.compile written in native PyTorch 🔥

GitHub - pytorch-labs/float8_experimental: This repository contains the experimental PyTorch native...

This repository contains the experimental PyTorch native float8 training UX - pytorch-labs/float8_experimental

github.com

6

104

521

PyTorch

@PyTorch

4 years

Torchmeta is a collection of extensions and data loaders for few-shot learning and meta-learning. It won first place at the Global PyTorch Summer Hackathon last year. Learn more in the blog post from Tristan Deleu, the project author:

1

151

567

PyTorch

@PyTorch

5 years

PyTorch Hub: reducing the friction in reproducing and building-upon research - Pull models with 1 line of code, and a few more to use - Curated models. Open with Google Colab and @paperswithcode - Publish your models by sending a PR Blog: #ICML2019

1

226

566

PyTorch

@PyTorch

2 years

Announcing PyTorch 1.11, TorchData, and functorch! Highlights: - TorchData, a new library for common modular data loading primitives - functorch adds composable function transforms - DDP static graph optimizations in stable Learn more👇

PyTorch 1.11, TorchData, and functorch are now available

We are excited to announce the release of PyTorch 1.11 (release notes). This release is composed of over 3,300 commits since 1.10, made by 434 contributors. Along with 1.11, we are releasing beta...

pytorch.org

3

102

555

PyTorch

@PyTorch

5 years

Universal Music Translation Network: translating music across musical instruments and styles using unsupervised training

1

171

566

PyTorch

@PyTorch

4 years

Catalyst is a PyTorch framework designed for reproducibility, faster experimentation and code/ideas reusing. This blog walks through MINST classifier tutorial and compare PyTorch and Catalyst code side-by-side:

4

115

552

PyTorch

@PyTorch

6 years

v0.4: Trade-off memory for compute, Windows support, 24 distributions with cdf, variance etc., dtypes, zero-dimensional Tensors, Tensor-Variable merge, , faster distributed, perf and bug fixes, CuDNN 7.1. Read more at: Install via

Release Trade-off memory for compute, Windows support, 24 distributions with cdf, variance etc.,...

PyTorch 0.4.0 release notes Table of Contents Major Core Changes Tensor / Variable merged Zero-dimensional Tensors dtypes migration guide New Features Tensors Full support for advanced indexi...

github.com

10

218

547

PyTorch

@PyTorch

3 months

The PyTorch team is excited to share that our paper on PyTorch 2 has been accepted for presentation at ASPLOS 2024! The paper delves into the implementation of torch.compile and highlights the key technologies driving it, read it here 👇📝

PyTorch 2 paper and tutorial @ ASPLOS 2024

The PyTorch team is excited to share that our paper on PyTorch 2 has been accepted for presentation at the ACM International Conference on Architectural Support for Programming Languages and Operat...

pytorch.org

6

85

549

PyTorch

@PyTorch

5 years

PyTorch BERT models are now 4x faster, thanks to @nvidia

Thomas Wolf

@Thom_Wolf

5 years

Always amazed by what people do when you open-source your code! Here is pytorch-bert v0.4.0 in which - NVIDIA used their winning MLPerf competition techniques to make the model 4 times faster, - @rodgzilla added a multiple-choice model & how to fine-tune it on SWAG + many others!

4

72

266

1

123

543

PyTorch

@PyTorch

2 years

Introducing @PyTorchLive , an easy to use library of tools for creating on-device ML demos on Android and iOS. With Live, you can build a working mobile app ML demo in minutes. Learn more at and post your demo with #PyTorchLive .

11

153

536

PyTorch

@PyTorch

4 years

PyTorch/XLA, a package that lets PyTorch connect to @GCPcloud TPUs and use TPU cores as devices, is now generally available. Highlights: - Support for Intra-Layer Model Parallelism - Additional XLA ops - Integrations with Colab and Kaggle notebooks

PyTorch / XLA is now Generally Available on Google Cloud TPUs

PyTorch / XLA, a package that lets PyTorch connect to Cloud TPUs and use TPU cores as devices, is now generally available.

medium.com

2

145

532

PyTorch

@PyTorch

2 years

Torch-TensorRT is now an official part of the PyTorch ecosystem and now available on PyTorch GitHub and Documentation. Torch-TensorRT is a TensorRT integration for PyTorch that accelerates inference up to 4x on NVIDIA GPUs with just a single line of code.

5

101

521

PyTorch

@PyTorch

4 years

The Computer Vision Recipes repository by researchers at Microsoft provides examples and best practice guidelines for building CV systems. It supports classification, retrieval, tracking, action recognition, and more. Learn:

1

174

515

PyTorch

@PyTorch

4 years

PyTorch Lightning V0.9 is available now featuring the final API with better data decoupling, shorter logging syntax, synchronized batchnorm, and more. Learn more:

4

121

513

PyTorch

@PyTorch

4 years

Captum is a library for model interpretability. Its algorithms include integrated gradients, conductance, SmoothGrad and VarGrad, and DeepLift. Learn more:

1

162

502

PyTorch

@PyTorch

3 years

PyTorch 1.9 extends PyTorch’s support for linear algebra operations with the torch.linalg module. The module has 26 operators, including every function from NumPy’s linear algebra module extended with accelerator and autograd support, and more. Read more:

The torch.linalg module: Accelerated Linear Algebra with Autograd in PyTorch

Linear algebra is essential to deep learning and scientific computing, and it’s always been a core part of PyTorch. PyTorch 1.9 extends PyTorch’s support for linear algebra operations with the...

pytorch.org

3

100

494

PyTorch

@PyTorch

6 years

Github Engineering experiments with Semantic Code Search: search for code snippets using natural language. Built on top of fastai + PyTorch, it's fully open-source Read about their approach here: Online Demo:

4

157

491

PyTorch

@PyTorch

3 years

This tutorial will introduce compute and data-efficient transformers and provide a step-by-step to create your own Vision Transformers. Through this guide, you'll be able to train state of the art results for classification in both computer vision & NLP.

2

124

493

PyTorch

@PyTorch

3 years

Introducing “Learn the Basics" - a guide to a complete ML workflow with detailed explanations on concepts like Tensors, DataLoaders, Transforms, and more. Thanks @sethjuarez , @subramen , @Cassieview , @shwars , @pythiccoder for your contributions! Click👇

1

126

487

PyTorch

@PyTorch

2 years

FX-based feature extraction is a new TorchVision utility that allows access to intermediate transformations of an input during the forward pass of a PyTorch Module. Read more below on what makes TorchVision's utility more versatile than existing methods.

Feature Extraction in TorchVision using Torch FX

pytorch.org

2

93

480

PyTorch

@PyTorch

4 years

Lyft Level 5 has adopted #PyTorch to build an internal framework for their ML efforts as they build self-driving technology. They reduced the median job training time for heavy production jobs such as 2D and 3D detectors and segmenters to just 1 hour. Read:

4

104

480

PyTorch

@PyTorch

3 years

Our community member from Japan, Yutaro Ogawa, shares the PyTorch Tutorials in Japanese. コミュニティメンバの小川さん（電通国際情報サービスISID AIトランスフォーメーションセンター） @ISID_AI_team より、日本語版PyTorchチュートリアルが公開されました

PyTorchチュートリアル（日本語訳版）

PyTorch公式チュートリアルの日本語翻訳版です。PyTorch入門として、PyTorchを初めて学ぶ初心者、中級者の方におすすめです。

yutaroogawa.github.io

1

113

481

PyTorch

@PyTorch

6 years

Tensor Comprehensions are now integrated and interoperable with @PyTorch . Read our blog post to get started:

Soumith Chintala

@soumithchintala

6 years

Tensor Comprehensions: einstein-notation like language transpiles to CUDA, and autotuned via evolutionary search to maximize perf. Know nothing about GPU programming? Still write high-performance deep learning. @PyTorch integration coming in <3 weeks.

13

431

1K

2

200

476

PyTorch

@PyTorch

3 years

PyTorch is excited to partner with OpenMined to make private AI education more accessible for everyone.

OpenMined

@openminedorg

3 years

After *months* of preparation - we're *extremely* excited to announce: The Private AI Series In partnership with: - @FHIOxford - @PyTorch - @FacebookAI - @UNBigData w/ guests: - Cynthia Dwork - @HNissenbaum - @dawnsongtweets -... Sign Up Here:

20

278

992

6

71

471

PyTorch

@PyTorch

3 years

All PyTorch Developer Day 2020 presentations are available now. Watch the full livestream:

PyTorch Developer Day 2020 | Full Livestream

Join us for PyTorch Developer Day 2020, where we'll look at technical talks, core updates, and project deep dives. The video will cover a variety of topics, ...

www.youtube.com

0

117

475

PyTorch

@PyTorch

6 years

Try out @NvidiaAI 's Vid2Vid project for photorealistic video-to-video translation, synthesizing label maps to realistic videos, people talking from edge maps, or generating human motions from poses Now supports the latest PyTorch v0.4.1:

2

163

468

PyTorch

@PyTorch

3 years

Ray is an open-source library for parallel and distributed Python. It can be paired with #PyTorch to rapidly scale machine learning applications. Learn more below:

3

123

464

PyTorch

@PyTorch

3 years

FairScale, a PyTorch extension for efficient large scale training, is releasing FullyShardedDataParallel, which shards model params across GPUs (+offload to CPU). Details: . Inspired by DeepSpeed/ @MSFTResearch , and made by @myleott @m1nxu @sam_shleifer

1

124

468

PyTorch

@PyTorch

4 years

PyTorch Lightning 0.8.4 now provides a Metrics package, for tens of common out of the box metrics (eg. ROC, PR, ConfusionMatrix, F1, etc.), along with a scikit-learn interface as well. Learn more:

0

115

452

PyTorch

@PyTorch

2 years

TorchX now supports PyTorch job submission via a newly developed Ray Scheduler in collaboration with @anyscalecompute . You can now deploy and scale your distributed production PyTorch infrastructure on top of Ray via an easy to use CLI based experience.

Large-Scale Distributed Training with TorchX and Ray

Ray, created at RISELab by the founders of Anyscale. It provides a rich set of native libraries for ML workloads and a general-purpose core

medium.com

4

57

118