Skip to main content

AMD Instinct MI325X (CDNA 3 Refresh)

Overview​

The AMD Instinct MI325X launched in H2 2024 as a memory upgrade over the MI300X. Memory was upgraded from 192GB HBM3 to 256GB HBM3e, and bandwidth increased from 5.3 TB/s to 6.48 TB/s. It directly competes with the NVIDIA H200.

Core Specifications​

ItemSpecification
ArchitectureCDNA 3
Memory256 GB HBM3e
Memory Bandwidth6.48 TB/s
FP16 Matrix1,307 TFLOPS (same as MI300X)
FP8 Matrix2,614 TFLOPS
TDP750 W
Form FactorOAM

MI300X vs MI325X vs H200​

MetricMI300XMI325XH200
Memory192 GB256 GB141 GB
Bandwidth5.3 TB/s6.48 TB/s4.8 TB/s
Memory TypeHBM3HBM3eHBM3e
FP8 Compute2,614 TFLOPS2,614 TFLOPS3,958 TFLOPS

Vendor Information​

ItemDetails
ManufacturerAMD, Inc.
Official Websitehttps://www.amd.com
Drivershttps://www.amd.com/en/support/accelerators/amd-instinct.html
ROCm6.0+ recommended

Use Cases​

  • Large model inference (>100B parameters)
  • MoE models
  • Long-context inference
  • LLM fine-tuning