Name: Accelerating Generative AI – Options for Conquering the Dataflow Bottlenecks
Start: 2024-01-24T18:00:00Z
End: 2024-01-24T18:00:56.000Z
Location: BrightTALK
Rating: 0

With today’s pressures on lowering our carbon footprint and cost constraints within organizations, IT departments are increasingly in the front line to formulate and enact an IT strategy that greatly improves energy efficiency and the overall performance of data centers. 

This channel will cover the strategic issues on ‘going green’ as well as practical tips and techniques for busy IT professionals to manage their data centers. Channel discussion topics will include: 
- Data center efficiency, monitoring and infrastructure management;
- Data center design, facilities management and convergence;
- Cooling technologies and thermal management
And much more

The digital landscape is in hyperdrive, demanding an IT metamorphosis that transcends mere tools. Enter AIOps – not just a technological upgrade, but a paradigm shift redefining how we approach IT operations. This presentation delves beyond the nuts and bolts, unveiling AIOps as a revolution that infuses AI's intelligence into the very fabric of IT thinking and processes.
Key Themes:
• From Dev to Production and Reactive to Proactive: Revolutionizing the IT Mindset: We'll move beyond the "fix it when it breaks" mentality, embracing a shift left, a future-proof approach where AI analyzes risk, anticipates issues, prescribes solutions, and learns continuously.
• Beyond Siloed Solutions: Embracing Holistic Collaboration:  AIOps fosters seamless integration across departments, applications, and infrastructure, promoting real-time visibility and unified action.
• Automating the process: From Insights to Intelligent Action: Dive into the world of self-healing IT, where AI-powered workflows and automation resolve issues and optimize performance without human intervention.

AIOps: Reactive to Proactive – Revolutionizing the IT Mindset

Data is one of the most critical resources of our time. Storage for data is always a critical architectural element in any data center. There are considerations for storage: performance, scalability, reliability, etc. A decade ago, the market was aggressively embracing public storage because of its agility and scalability. In the last few years, people are rethinking that approach, moving toward on-premises storage with cloud consumption models. The new cloud native architecture on-premises has the promise of the traditional data center’s security and reliability with cloud agility and scalability. 
Ceph, an enterprise unified SDS, is the perfect solution for this cloud native on-premises architecture. In this webinar, we will describe how Ceph is uniquely qualified to satisfy this architecture and how the technology community is investing to enable the vision of “Ceph, the Linux of Storage Today”.

Ceph: The Linux of Storage Today

What new storage trends are developing in the coming year? What applications and other factors are driving these trends? Learn from this discussion between industry experts Jeff Janukowicz, Research Vice President at IDC; Brian Beeler, Owner and Editor In Chief, StorageReview.com; and Cameron T. Brett, SNIA STA Forum Chair.

This discussion will cover:

·      How are AI and machine learning affecting storage needs?

·      What is the state of the storage industry in 2024?

·      Security concerns being addressed in data storage.

·      EDSFF E1 and E3: should you make the switch?

·      Is SAS dead? What is the role of SAS in the future of storage?

·      How to make data storage sustainable for current and future need.

Hear about applications driving upcoming trends and learn about market data illustrating the assertions. This promises to be a lively session and you don’t want to miss it!

Storage Trends 2024

The latest buzz around generative artificial intelligence (AI) ignores the massive costs to run and power the technology. Without any guard rails in place, what are the impacts of AI on sustainability and costs across our technology resources? This webinar will offer insights on the potentially hidden technical and infrastructure costs associated with generative AI, best practices and potential solutions to be considered, discussing:   

• Scalability considerations for generative AI in enterprises 
• Significant computational requirements and cost for Large Language Model inferencing 
• Fabric requirements and costs 
• Sustainability impacts due to increased power consumption, heat dissipation, and cooling implications 
• AI infrastructure savings - On-prem vs. Cloud
• Practical steps to reduce impact, leveraging existing pre-trained models for specific market domains

Addressing the Hidden Costs of AI

Any discussion about storage systems is incomplete without the mention of Throughput, IOPs, and Latency. But what exactly do these terms mean and why are they important?
Collectively, these three terms are often referred to as storage performance metrics. Performance can be defined as the effectiveness of a storage system to address I/O needs of an application or workload. Different application workloads have different I/O patterns, and with that arises different bottlenecks, so there is no “one-size fits all” in storage systems. These storage performance metrics help with storage solution design and selection based on application/workload demands
 In this webinar, we’ll cover:
• What storage performance metrics mean – understanding key terminology nuances
• Why users/storage administrators should care about them
• How these metrics impact application performance 
• Real-world use cases

Everything You Wanted to Know About Throughput, IOPs, and Latency

Emerging memories are now found in multiple applications both as stand-alone chips and embedded into systems on chips (SoCs) as they replace established technologies, including SRAM, NOR flash, and DRAM. In this webinar, SNIA CMSI members and leading experts Tom Coughlin (Coughlin Associates/IEEE President)  and Jim Handy (Objective Analysis) will discuss the latest developments in MRAM, ReRAM, FRAM, PCM, and other new memory technologies to explain why, how, and when these technologies will grow, and how their success will impact both the semiconductor and the capital equipment markets.

Emerging Memories Branch Out

Object Storage has firmly established itself as a cornerstone of modern data centers and cloud infrastructure. Ensuring API compatibility has become crucial for object storage developers who want to benefit from the wide ecosystem of existing applications. However, achieving compatibility can be challenging due to the complexity and variety of the APIs, access control mechanisms, and performance and scalability requirements.

In this webinar, we'll highlight real-world incompatibilities found in various object storage implementations. We'll discuss specific examples of existing discrepancies, such as missing or incorrect response headers, unsupported API calls, and unexpected behavior. We’ll also describe the implications these have on actual client applications.
 
This analysis is based on years of experience with implementation, deployment and evaluation of a wide range of object storage systems on the market. Attendees will leave with a deeper understanding of the challenges around compatibility and how to address them in their own applications.
 
During this webinar, we'll call for participation in a Cloud Object Storage Plugfest, facilitated by SNIA and co-located at Storage Developer Conference (SDC) 2024, aimed at improving cross-implementation compatibility for client and/or server implementations of private and public cloud object storage solutions. This endeavor is designed to be an independent, vendor-neutral effort with broad industry support, focused on a variety of solutions, including on-premises and in the cloud.

Navigating the Complexities of Object Storage Compatibility

The majority of today’s SAN infrastructures leverage the traditional SCSI/FCP protocol. The relatively new NVMe/FC protocol has become ubiquitous in enterprise storage offerings, delivering multiple advantages including high performance, low tail latency, and precision error recovery that can run on the same Fibre Channel SAN infrastructure. In this talk we will discuss:

• The architecture of NVMe/FC at protocol level
• Building blocks of NVMe like NVMe subsystem
• NVMe controllers, Namespaces etc. 
• Overview of FC-NVMe T11 standards
• Key advantages of NVMe/FC, including application use cases

NVMe over FC: Deep Dive in Protocol, Architecture and Use Cases

The enterprise storage market is rapidly expanding to include NVMe and NVMe-oF products pervasively. This presents the challenge: how do you manage these as part of your enterprise data center?

As the NVM Express family of specifications continue to develop, the corresponding Swordfish management capabilities are also evolving. The SNIA Swordfish management bundle (including the specification, schema, documentation, and more) has expanded to include full NVMe and NVMe-oF technology enablement and alignment across DMTF, NVMe and SNIA for NVMe and NVMe-oF technology use cases.

In conjunction with Redfish®, Swordfish's capabilities to manage NVMe and NVMe-oF devices in the enterprise provide a seamless management ecosystem. 

This presentation will introduce management of NVMe and NVMe-oF technology with SNIA Swordfish. Using an example of the SNIA Swordfish functionality, the presenters will introduce how to manage the complexity of discovery controllers with the simplified model presented to Swordfish clients.

Catch the Wave – Managing NVMe-oF™ in the Enterprise

The days of simple, static, self-contained file systems have long passed. Today, we have complex, dynamic namespaces, mixing block, file, object, key-value, queue, and graph-based resources, accessed via multiple protocols, and distributed across multiple systems and geographic sites. These complexities result in new challenges for simplifying management. 

The good news is, that the SNIA Cloud Data Management Interface (CDMI™), an open ISO standard (ISO/IEC 17826:2022) for managing data objects and containers, already includes extensive capabilities for simplifying the management of complex namespaces. In this webinar, attendees will learn how to simplify namespace management – the open standards way, including namespace discovery, introspection, exports, imports and more, discussing:

• Challenges and limitations with proprietary namespace management
• Overview of namespaces and industry evolution
• Lack of portability between platforms
• Using CDMI for simplified and consistent namespace management
• Use cases for namespace management

Simplified Namespace Management – The Open Standards Way

AI is disrupting so many domains and industries and by doing so, AI models and algorithms are becoming increasingly large and complex. This complexity is driven by the proliferation in size and diversity of localized data everywhere, which creates the need for a unified data fabric and/or federated learning. It could be argued that whoever wins the data race will win the AI race, which is inherently built on two premises: 1) Data is available in a central location for AI to have full access to it, 2) Compute is centralized and abundant. 

Edge AI though, defies these assumptions. If centralized (or in the cloud) AI is a superpower and super expert, edge AI is a community of many smart wizards. As humans, we can appreciate the power of cumulative knowledge over a central superpower. In this webinar, we will touch on: 
• The value and use cases of distributed edge AI 
• How data fabric on the edge differs from the cloud and its impact on AI
• Edge device data privacy trade-offs and distributed agency trends
• Privacy mechanisms for federated learning, inference, and analytics
• How interoperability between cloud and edge AI can happen

Why Distributed Edge Data is the Future of AI

With cloud data privacy regulations evolving worldwide and accelerated adoption of AI technologies such as ChatGPT, Large Language Models (LLMs) and more, companies must ensure data and AI models are compliant. Confidential AI is a new collaborative platform for data and AI teams to work with sensitive data sets and run AI models in a confidential environment. It includes infrastructure, software, and workflow orchestration to create a secure, on-demand work environment that meets organizations' privacy requirements and complies with regulatory mandates. In this session, you’ll learn:

• What confidential AI is and why it is important
• Changing privacy and compliance landscape for AI use and models
• Biggest data privacy threats and opportunities 
• Pragmatic examples and next steps

The Rise of Confidential AI

Since its ratification in late 2018, NVMe/TCP has gained a lot of attention due to its great performance characteristics and relatively low cost. Since then, the NVMe/TCP protocol has been enhanced to add features such as Discovery Automation, Authentication and Secure Channels that make it more suitable for use in enterprise environments. More recently, as customers evaluate their options and consider adopting NVMe/TCP for use in their environment, many find they need a bit more information before deciding how to move forward and are asking questions such as:
• How does NVMe/TCP stack up against my existing block storage protocol of choice in terms of performance?
• Should I use a dedicated storage network when deploying NVMe/TCP or is a converged network ok?
• How can I automate interaction with my IP-Based SAN?

Join us for an open discussion regarding these questions and more.

NVMe/TCP: Performance, Deployment and Automation

Data Fabric is an architecture, set of services and platform that standardizes and integrates data across the enterprise regardless of data location (On-Prem, Cloud, Multi Cloud, Hybrid Cloud), enabling self-service data access to support various applications, analytics, and use cases.  The data fabric leaves data where it lives and applies intelligent automation to govern, secure and bring AI to your data. This session will discuss:
• Different types of data sources for data fabric integration
• Unification of structured and unstructured data sources into the data fabric
• How to simplify data access by virtually connecting data end points across a hybrid cloud landscape
• Providing automatic enrichment leveraging AI to contextualize data with semantics and knowledge
• Apply global and automated data governance and data privacy policy enforcement for increased data protection and quality

Data Fabric: Connecting the Dots between Structured and Unstructured Data

Join Jim Handy of Objective Analysis as he moderates a panel featuring Andy Rudoff and Bhushan Chitlur from Intel, David McIntyre from Samsung, and  Sudhir Balasubramanian and Arvind Jagannath from VMware as they discuss Persistent Memory , Compute Express Link™ (CXL™), and Memory Tiering; and how the eco-system is working together to provide solutions for memory tiering using CXL for customer use cases.

Persistent Memory , CXL, and Memory Tiering - Past , Present & Future

Explore the exciting and rapidly evolving world of decentralized storage and how it is bridging the gap between Web 2.0 and Web 3.0

In this webinar, we will provide an overview of the importance of enterprise decentralized storage and why it is more relevant now than ever before. We will delve into the benefits and demand of decentralized storage and discuss the evolution of on-premises to cloud to decentralized storage (cloud 2.0).

We will also explore the various use cases of decentralized storage, including its role in data privacy and security, and the potential for decentralized applications (dApps) and blockchain technology.

As part of this webinar, we will introduce you to the Decentralized Storage Alliance, a group of like-minded individuals and organizations committed to advancing the adoption of decentralized storage. We will provide insights into the members of the Alliance and the Working Groups that are driving innovation and progress in this exciting field and answer questions such as: 

● Why is enterprise decentralized storage important?
● What are the benefits, the demand, and why now?
● How will on-premises to cloud to decentralized storage evolve?
● What are the use cases of decentralized storage?
● Who are the members and Working Groups of the Decentralized Storage Alliance?

Join us to gain valuable insights into the future of decentralized storage and discover how you can be part of this game-changing technology.

Why Web 3.0 is Important to Enterprise Storage

Composable disaggregated infrastructures provide a promising solution to addressing the provisioning and computational efficiency limitations, as well as hardware and operating costs, of integrated, siloed systems. But how do we solve these problems in an open, standards-based way?

DMTF, SNIA, the OFA, and the CXL™ Consortium are working together to provide elements of the overall solution, with Redfish® and SNIA Swordfish™ manageability providing the standards-based interface. OFA is developing an OpenFabrics Management Framework (OFMF) designed for configuring fabric interconnects and managing composable disaggregated resources in dynamic High Performance Computing (HPC) infrastructures using client-friendly abstractions.

In this webinar, attendees will understand how use cases for scaling management of storage and fabrics and beyond are addressed in these architectures, and the applicability to additional technologies.

Casting the Net: Scaling Management of Storage and Fabrics

Workloads using generative artificial intelligence trained on large language models are frequently throttled by insufficient resources (e.g., memory, storage, compute, or network dataflow bottlenecks). If not identified and addressed, these dataflow bottlenecks can constrain Gen AI application performance well below optimal levels. 

Given the compelling uses across natural language processing (NLP), video analytics, document resource development, image processing, image generation, and text generation, being able to run these workloads efficiently has become critical to many IT and industry segments. The resources that contribute to generative AI performance and efficiency include CPUs, DPUs, GPUs, FPGAs, plus memory and storage controllers.  

This webinar, with a broad cross-section of industry veterans, provides insight into the following:

• Defining the Gen AI dataflow bottlenecks
• Tools and methods for identifying acceleration options
• Matchmaking the right xPU solution to the target Gen AI workload(s)
• Optimizing the network to support acceleration options
• Moving data closer to processing, or processing closer to data
• The role of the software stack in determining Gen AI performance

Accelerating Generative AI – Options for Conquering the Dataflow Bottlenecks

Artificial Intelligence

The data center management community focuses on the holistic management and optimization of the data center. From technologies such as virtualization and cloud computing to data center design, colocation, energy efficiency and monitoring, the BrightTALK data center management community provides the most up-to-date and engaging content from industry experts to better your infrastructure and operations. Engage with a community of your peers and industry experts by asking questions, rating presentations and participating in polls during webinars, all while you gain insight that will help you transform your infrastructure into a next generation data center.

Data Center Management

As an IT professional, many of the problems you face are multifaceted, complex and don’t lend themselves to simple solutions. The information technology community features useful and free information technology resources. Join to browse thousands of videos and webinars on ITIL best practices, IT security strategy and more presented by leading CTOs, CIOs and other technology experts.

Information Technology

The energy community on BrightTALK brings together top experts from around the world. Find relevant webinars and videos on renewable energy, efficiency and more presented by recognized energy management thought leaders. Join the conversation by participating in live webinars and round table discussions on energy trends.

Energy

The research and development community on BrightTALK brings together leading professionals in healthcare, technology and manufacturing to present on current topics in their fields. From big data in healthcare to online forensics training and medical research practices, the community is an exceptional resource for those looking to expand their knowledge. Be part of the conversation by joining the community and participating in interactive live webinars.

Accelerating Generative AI – Options for Conquering the Dataflow Bottlenecks

Presented by

About this talk

More from this channel