Hugging Face Neuron Deep Learning AMI (DLAMI) makes it easy to use Amazon EC2 Inferentia & Trainium instances for efficient training and inference of Hugging Face Transformers and Diffusers models.

With the Hugging Face Neuron DLAMI, scale your Transformers and Diffusion workloads quickly on Amazon EC2 while reducing your costs, with up to 50% cost-to-train savings over comparable GPU-based DLAMIs.

This DLAMI is the officially supported, and recommended solution by Hugging Face, to run training and inference on Trainium and Inferentia EC2 instances, and supports most Hugging Face use cases, including:

Fine-tuning and pre-training Transformers models like BERT, GPT, or T5

Running inference with Transformers models like BERT, GPT, or T5

Fine-tuning and deploying Diffusers models like Stable Diffusion

This DLAMI is provided at no additional charge to Amazon EC2 users.

For more information and documentation, visit the Hugging Face Neuron Developer Guide: https://awsdocs-neuron.readthedocs-hosted.com/en/latest/frameworks/torch/torch-neuronx/tutorials/training/bert.html

AMI Name format: Hugging Face Neuron Deep Learning AMI (Ubuntu 22.04) ${YYYY-MM-DD}

The AMI includes the following:

Supported AWS Service: EC2

Operating System: Ubuntu 22.04

Compute Architecture: x86

EBS volume type: gp2

Python version: 3.8

Supported EC2 Instances: Trn1/Inf2

Pytorch: 1.13 Neuron SDK

Hugging Face Libraries: transformers, datasets, accelerate, evaluate, diffusers