AWS Inferentia2

Owner The company that specified the chip and runs it in its own cloud, data centers or products.

Amazon Web Services 1

Role What the owner says the chip is for: training, inference, both, or a general-purpose server CPU.

Inference 1

Design partner The ASIC house that co-designed or physically implemented the chip (Broadcom, Marvell, MediaTek, Alchip, GUC and others), as stated by the owner, the partner, a filing or named trade-press reporting. 'In-house' when the owner states it designed the chip itself, including through an acquired team such as Annapurna Labs.

In-house (Annapurna Labs) 2

Memory On-package memory type (HBM2e, HBM3, HBM3E, LPDDR5) or, for CPUs, the memory the socket drives (DDR5).

HBM 1

Memory capacity GB On-package memory per chip in GB. Blank for CPUs, whose memory sits off-package.

32 1

Memory bandwidth TB/s Peak memory bandwidth per chip in TB/s, as published.

0.88 1

BF16 TFLOPS Published BF16 throughput per chip or accelerator module in TFLOPS. FP16 is a separate column. See the precision note for sparsity and module scope.

190 1

INT8 TOPS Peak INT8 throughput per chip in TOPS, as published. Mostly given for inference chips.

380 1

Precision note What the throughput figures mean: dense or sparse, which precision, per chip or per package, and any figure the owner states only in another unit.

AWS gives one shared figure of 190 TFLOPS for FP16, BF16, cFP8 and TF32, plus 380 INT8 TOPS and 47.5 FP32 TFLOPS. Memory bandwidth is 820 GiB/s (0.88 TB/s). 1

Status Announced: public roadmap without verified deployment. Sampling: first silicon or limited internal use. Preview: customers can request early access, without a GA claim. Deployed: stated production use or general availability. Discontinued: program stopped.

Deployed 1

Announced Year the owner first announced the chip publicly.

2,022 3

How to get it How an outside buyer can use the chip: a named cloud instance or service, a product, or 'Internal only'.

AWS EC2 Inf2 instances 1

Not verified in the sources reviewed: partner basis, foundry, node, fp16, mxfp8, mxfp4, mx8, mx4, fp8, fp4, power, largest pod, deployment scale.

1. AWS Neuron docs: Inferentia2 architecture accessed 2026-11-11
2. Amazon: How Amazon became one of the world's top chip companies in a decade accessed 2026-11-11
3. AWS: Inf2 GA announcement recalls re:Invent 2022 preview accessed 2026-11-11