InfoTechTarget and Informa Tech's Digital Businesses Combine.

Together, we power an unparalleled network of 220+ online properties covering 10,000+ granular topics, serving an audience of 50+ million professionals with original, objective content from trusted sources. We help you gain critical insights and make more informed decisions across your business priorities.

AI Training & AI Inference performance - Does the CPU matter?

Presented by

AMD EPYC

About this talk

Get the most out of your investment in GPUs! AMD Instinct™ MI300X (AMD EPYC™ 9575F as host node CPU) vs. AMD Instinct™ MI300X (Intel® Xeon® Platinum 8592+ as host node CPU) RESULTS: ~1.20X the AI Training throughput performance on SDXL v2 ~1.08X the AI Inference performance on Llama 3.1-70B https://www.amd.com/content/dam/amd/en/documents/epyc-business-docs/white-papers/maximize-ai-gpu-efficiency-with-amd-epyc-processors.pdf
AMD

AMD

1144 subscribers27 talks
together we advance_
Get the competitive edge for AI, data center, business computing solutions & gaming with AMD processors, graphics, FPGAs, Adaptive SOCs, & software. The world’s most advanced processors For the world’s most ambitious ideas AMD processors power people to lead their fields at the cutting edge. From healthcare and entertainment to science and autonomous driving—when AMD performance meets the potential of our partners, we can solve the world’s most important challenges. together we advance_
Related topics