Advanced Micro Devices Chair and CEO Dr. Lisa Su took center stage at the 'Advancing AI 2024' gala in San Francisco on Thursday, unveiling the company's next-generation Instinct MI325X artificial intelligence accelerator and fifth-generation AMD EPYC server processors codenamed 'Turin'.
The high-profile semiconductor showcase directly targets Nvidia's dominance in the booming generative AI market, positioning AMD as an open-ecosystem powerhouse capable of delivering superior memory density and compute efficiency for hyperscale cloud environments.
Instinct MI325X Delivers Leading HBM3E Memory Bandwidth
The flagship Instinct MI325X features an industry-leading 256GB of ultra-fast HBM3E memory operating at a blistering 6.0 terabytes per second of bandwidth. AMD demonstrated that the chip delivers up to 1.3 times greater inference throughput than Nvidia's H200 on leading large language models like Meta's Llama 3.1.
Production shipments of the MI325X are scheduled to begin in the fourth quarter of 2024, with major server partners including Dell Technologies, Hewlett Packard Enterprise, Lenovo, and Supermicro deploying integrated server platforms early next year.
“AI represents the most transformative technology revolution in fifty years. Our new Instinct accelerators and EPYC processors deliver the performance, memory, and open software needed to scale generative AI globally.” — Lisa Su, Chair and CEO of Advanced Micro Devices
EPYC Turin CPUs Redefine Enterprise Data Center Compute
Complementing the GPU accelerator, AMD introduced its 5th Gen EPYC server CPUs built on the cutting-edge 'Zen 5' architecture. Packing up to 192 cores and 384 threads in a single socket, Turin delivers up to 2.7 times the performance of competing x86 server chips for virtualized cloud workloads.
Addressing investors and tech executives, Dr. Su raised AMD's long-term forecast for the data center AI chip market, predicting total industry spending will surge to $500 billion by 2028 as enterprises accelerate private model training and edge deployment.
Frequently Asked Questions
How does the AMD Instinct MI325X compare to Nvidia's H200?
The MI325X offers 256GB of HBM3E memory and 6.0 TB/s bandwidth, providing higher memory capacity and up to 1.3x faster inference on large models than the H200.
What are the key specifications of AMD's 5th Gen EPYC Turin processors?
EPYC Turin processors feature up to 192 'Zen 5' cores, offering unmatched compute density and power efficiency for enterprise data centers.
Comments (0)
Log in to join the discussion.