Oriel — AI & technology worth noticing, every day.

Does Your Model Run on AWS Trainium? Look It Up

Web page · https://huggingface.co/blog/torch-neuronx-model-support

First seen by Oriel on .

AI summary

The torch-neuronx model support Space reports which popular Transformers models run on AWS Trainium and provides tested scripts and environment details to reproduce runs.

  • The Space lets users search selected, trending, and downloaded Hub models, and view results by neuronx-cc and Transformers versions.
  • For each tested model, it reports Trainium core count, wall time including compilation, peak device memory, tested software stack, and the run.py script.
  • Tests run on Trainium2, generate 32 tokens, and check them; models must fit on at most 16 cores, and PASS does not indicate throughput or longer-generation quality.
  • Results are published in the aws-neuron/torch-neuronx-model-support dataset, with Parquet files for compiler and library version pairs; coverage currently focuses on text generation and image-text-to-text models.

#aws trainium #pytorch #transformers #model evaluation

Generated by gpt-5.6-sol. Check the original for details.

Aliases

SourceExternal IDURL
Hugging Face Bloghttps://huggingface.co/blog/torch-neuronx-model-supporthttps://huggingface.co/blog/torch-neuronx-model-support Read discussion