Source Hugging Face · Published · Open the original ↗
Lab notes
TorchNeuron: running HF models on AWS Trainium is easier than ever
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
TorchNeuron provides a new native backend for PyTorch on AWS Trainium. Transformers, Diffusers and Kernels natively support it, making it easier than ever to run models on Trainium and to share them on the HF hub.
TorchNeuron is a PyTorch plugin that brings a new backend for Trainium enabling support for eager mode, torch.compile and native distributed APIs like FSDP and TP. Read the Pytorch blog to learn more about TorchNeuron.
Starting Oct. 20, 2026, TorchNeuron will be available as a public beta. Researchers and developers will be able to install it with pip install torch-neuronx .
The opening of the post, quoted unchanged from Hugging Face. The full text continues at the source.