Does Your Model Run on AWS Trainium? Look It Up
Web page · https://huggingface.co/blog/torch-neuronx-model-support
First seen by Oriel on .
AI summary
The torch-neuronx model support Space reports which popular Transformers models run on AWS Trainium and provides tested scripts and environment details to reproduce runs.
- The Space lets users search selected, trending, and downloaded Hub models, and view results by neuronx-cc and Transformers versions.
- For each tested model, it reports Trainium core count, wall time including compilation, peak device memory, tested software stack, and the run.py script.
- Tests run on Trainium2, generate 32 tokens, and check them; models must fit on at most 16 cores, and PASS does not indicate throughput or longer-generation quality.
- Results are published in the aws-neuron/torch-neuronx-model-support dataset, with Parquet files for compiler and library version pairs; coverage currently focuses on text generation and image-text-to-text models.
#aws trainium #pytorch #transformers #model evaluation
Generated by gpt-5.6-sol. Check the original for details.
Aliases
| Source | External ID | URL |
|---|---|---|
| Hugging Face Blog | https://huggingface.co/blog/torch-neuronx-model-support | https://huggingface.co/blog/torch-neuronx-model-support Read discussion |