Addressing the Hidden Costs of AI

Logo
Presented by

Rob Davis, NVIDIA; David McIntyre, Samsung; Mishali Naik, Intel; Justin Potuznik, Dell; Erik Smith, Dell

About this talk

The latest buzz around generative artificial intelligence (AI) ignores the massive costs to run and power the technology. Without any guard rails in place, what are the impacts of AI on sustainability and costs across our technology resources? This webinar will offer insights on the potentially hidden technical and infrastructure costs associated with generative AI, best practices and potential solutions to be considered, discussing: • Scalability considerations for generative AI in enterprises • Significant computational requirements and cost for Large Language Model inferencing • Fabric requirements and costs • Sustainability impacts due to increased power consumption, heat dissipation, and cooling implications • AI infrastructure savings - On-prem vs. Cloud • Practical steps to reduce impact, leveraging existing pre-trained models for specific market domains
Related topics:

More from this channel

Upcoming talks (2)
On-demand talks (119)
Subscribers (55609)
SNIA is a not-for-profit global organization made up of corporations, universities, startups, and individuals. The members collaborate to develop and promote vendor-neutral architectures, standards, and education for management, movement, and security for technologies related to handling and optimizing data. SNIA focuses on the transport, storage, acceleration, format, protection, and optimization of infrastructure for data.