AMD Instinct MI350: Up to 288GB HBM3E, FP4 and FP6 Support, and Up to 1400W TDP
Two days before the official announcement at ISC 2025 in Hamburg, the characteristics of the accelerator series became known AMD Instinct MI350, built on architecture cDNA 4. At the exhibition stand were seen as MI350X, as well as a more powerful model MI355X, both of which are available in configurations with 8 GPU per node.
The series received support new AI formats FP8, FP6 and FP4, which allows for double the performance compared to FP8. According to the data from the showcase, FP4/FP6 reaches 18-20 PFLOPS, FP8 - up to 10,1 PFLOPS. It twice as high early benchmarks and is in line with the figures previously attributed to FP4/6.
The memory capacity is 288 GB HBM3E, and the throughput reaches 8 TB/s per OAM module... Model MI355X focused on liquid cooling, with a thermal package of up to 1400 WWhereas MI350X uses traditional solutions with power consumption of up to 1000 W.
Despite the impressive performance, the series does not offer scalability beyond 8 GPU, as in solutions NVIDIA NVL36/NVL72. This feature will only appear in a future series. MI400, whose release is expected in 2026. Confirmation of all characteristics is expected on June 13 at 18:30 at the official AMD presentation.
