AWS Trainium2

Owner The company that specified the chip and runs it in its own cloud, data centers or products.

Amazon Web Services 1

Role What the owner says the chip is for: training, inference, both, or a general-purpose server CPU.

Training and inference 1

Design partner The ASIC house that co-designed or physically implemented the chip (Broadcom, Marvell, MediaTek, Alchip, GUC and others), as stated by the owner, the partner, a filing or named trade-press reporting. 'In-house' when the owner states it designed the chip itself, including through an acquired team such as Annapurna Labs.

In-house (Annapurna Labs) 3

Memory On-package memory type (HBM2e, HBM3, HBM3E, LPDDR5) or, for CPUs, the memory the socket drives (DDR5).

HBM 1

Memory capacity GB On-package memory per chip in GB. Blank for CPUs, whose memory sits off-package.

96 1

Memory bandwidth TB/s Peak memory bandwidth per chip in TB/s, as published.

2.9 1

BF16 TFLOPS Published BF16 throughput per chip or accelerator module in TFLOPS. FP16 is a separate column. See the precision note for sparsity and module scope.

667 1

FP8 TFLOPS Published peak FP8 throughput per chip in TFLOPS. The precision note records sparsity where the owner states it. Blank when the owner gives no FP8 figure.

1,299 1

Precision note What the throughput figures mean: dense or sparse, which precision, per chip or per package, and any figure the owner states only in another unit.

Per chip: 1,299 FP8 TFLOPS and 667 BF16/FP16/TF32 TFLOPS. AWS lists 2,563 TFLOPS separately as sparse, not used here. 1

Largest pod chips The largest scale-up domain the owner states: chips per pod, UltraServer, supernode or rack joined by the chip-to-chip interconnect.

64 2

Status Announced: public roadmap without verified deployment. Sampling: first silicon or limited internal use. Preview: customers can request early access, without a GA claim. Deployed: stated production use or general availability. Discontinued: program stopped.

Deployed 2

Announced Year the owner first announced the chip publicly.

2,023 4

Deployment scale The largest deployment the owner or a named report states: chip counts, clusters, gigawatts or regions.

Project Rainier: nearly 500,000 Trainium2 chips live in October 2025; Anthropic’s Claude now runs on more than one million Trainium2 chips (Amazon). 2

How to get it How an outside buyer can use the chip: a named cloud instance or service, a product, or 'Internal only'.

AWS EC2 Trn2 instances and Trn2 UltraServers 2

Not verified in the sources reviewed: partner basis, foundry, node, fp16, mxfp8, mxfp4, mx8, mx4, int8, fp4, power.

1. AWS Neuron docs: Trainium2 architecture accessed 2026-11-11
2. Amazon: Project Rainier, one of the world's largest AI compute clusters accessed 2026-11-11
3. Amazon: How Amazon became one of the world's top chip companies in a decade accessed 2026-11-11
4. Amazon: AWS unveils Graviton4 and Trainium2, November 28, 2023 accessed 2026-11-11