AWS Inferentia

Owner The company that specified the chip and runs it in its own cloud, data centers or products.

Amazon Web Services 2

Role What the owner says the chip is for: training, inference, both, or a general-purpose server CPU.

Inference 1

Design partner The ASIC house that co-designed or physically implemented the chip (Broadcom, Marvell, MediaTek, Alchip, GUC and others), as stated by the owner, the partner, a filing or named trade-press reporting. 'In-house' when the owner states it designed the chip itself, including through an acquired team such as Annapurna Labs.

In-house (Annapurna Labs) 4

Memory On-package memory type (HBM2e, HBM3, HBM3E, LPDDR5) or, for CPUs, the memory the socket drives (DDR5).

DRAM (not HBM) 1

Memory capacity GB On-package memory per chip in GB. Blank for CPUs, whose memory sits off-package.

8 1

Memory bandwidth TB/s Peak memory bandwidth per chip in TB/s, as published.

0.05 1

BF16 TFLOPS Published BF16 throughput per chip or accelerator module in TFLOPS. FP16 is a separate column. See the precision note for sparsity and module scope.

64 1

INT8 TOPS Peak INT8 throughput per chip in TOPS, as published. Mostly given for inference chips.

128 1

Precision note What the throughput figures mean: dense or sparse, which precision, per chip or per package, and any figure the owner states only in another unit.

AWS lists 128 INT8 TOPS and 64 FP16/BF16 TFLOPS per chip, with 8 GB of device DRAM at 50 GB/s. 1

Largest pod chips The largest scale-up domain the owner states: chips per pod, UltraServer, supernode or rack joined by the chip-to-chip interconnect.

16 2

Status Announced: public roadmap without verified deployment. Sampling: first silicon or limited internal use. Preview: customers can request early access, without a GA claim. Deployed: stated production use or general availability. Discontinued: program stopped.

Deployed 2

Announced Year the owner first announced the chip publicly.

2,018 3

How to get it How an outside buyer can use the chip: a named cloud instance or service, a product, or 'Internal only'.

AWS EC2 Inf1 instances 2

Not verified in the sources reviewed: partner basis, foundry, node, fp16, mxfp8, mxfp4, mx8, mx4, fp8, fp4, power, deployment scale.

1. AWS Neuron docs: Inferentia architecture accessed 2026-11-11
2. AWS News Blog: Inf1 instances with AWS Inferentia chips accessed 2026-11-11
3. AWS: Amazon EC2 Inf1 instances accessed 2026-11-11
4. Amazon: How Amazon became one of the world's top chip companies in a decade accessed 2026-11-11