Name: You’ve Been Framed! xPU, GPU & Computational Storage Programming Frameworks
Start: 2022-10-26T17:00:00Z
End: 2022-10-26T17:00:53.000Z
Location: BrightTALK
Rating: 4.8

SNIA is a not-for-profit global organization made up of corporations, universities, startups, and individuals. The members collaborate to develop and promote vendor-neutral architectures, standards, and education for management, movement, and security for technologies related to handling and optimizing data. SNIA focuses on the transport, storage, acceleration, format, protection, and optimization of infrastructure for data.

The latest buzz around generative artificial intelligence (AI) ignores the massive costs to run and power the technology. Without any guard rails in place, what are the impacts of AI on sustainability and costs across our technology resources? This webinar will offer insights on the potentially hidden technical and infrastructure costs associated with generative AI, best practices and potential solutions to be considered, discussing:   

• Scalability considerations for generative AI in enterprises 
• Significant computational requirements and cost for Large Language Model inferencing 
• Fabric requirements and costs 
• Sustainability impacts due to increased power consumption, heat dissipation, and cooling implications 
• AI infrastructure savings - On-prem vs. Cloud
• Practical steps to reduce impact, leveraging existing pre-trained models for specific market domains

Addressing the Hidden Costs of AI

Any discussion about storage systems is incomplete without the mention of Throughput, IOPs, and Latency. But what exactly do these terms mean and why are they important?
Collectively, these three terms are often referred to as storage performance metrics. Performance can be defined as the effectiveness of a storage system to address I/O needs of an application or workload. Different application workloads have different I/O patterns, and with that arises different bottlenecks, so there is no “one-size fits all” in storage systems. These storage performance metrics help with storage solution design and selection based on application/workload demands
 In this webinar, we’ll cover:
• What storage performance metrics mean – understanding key terminology nuances
• Why users/storage administrators should care about them
• How these metrics impact application performance 
• Real-world use cases

Everything You Wanted to Know About Throughput, IOPs, and Latency

Object Storage has firmly established itself as a cornerstone of modern data centers and cloud infrastructure. Ensuring API compatibility has become crucial for object storage developers who want to benefit from the wide ecosystem of existing applications. However, achieving compatibility can be challenging due to the complexity and variety of the APIs, access control mechanisms, and performance and scalability requirements.

In this webinar, we'll highlight real-world incompatibilities found in various object storage implementations. We'll discuss specific examples of existing discrepancies, such as missing or incorrect response headers, unsupported API calls, and unexpected behavior. We’ll also describe the implications these have on actual client applications.
 
This analysis is based on years of experience with implementation, deployment and evaluation of a wide range of object storage systems on the market. Attendees will leave with a deeper understanding of the challenges around compatibility and how to address them in their own applications.
 
During this webinar, we'll call for participation in a Cloud Object Storage Plugfest, facilitated by SNIA and co-located at Storage Developer Conference (SDC) 2024, aimed at improving cross-implementation compatibility for client and/or server implementations of private and public cloud object storage solutions. This endeavor is designed to be an independent, vendor-neutral effort with broad industry support, focused on a variety of solutions, including on-premises and in the cloud.

Navigating the Complexities of Object Storage Compatibility

OK, I'll be honest, the title is a little dramatic, but ask yourself this question, how much data do you have today, and have you ever considered what impact you are having on the environment? The reality is, data centers have been shown to account for approximately 1 – 1.5% of global electricity use. In this session, we will explore what sustainability is, and I will give you a hint, it’s not just environmental. We will look at the impact digitization can have on energy consumption, and therefore the environment, and some practical applications that you can do to help address data challenges to address environmental sustainability.

How is Data Harming Your Health?

The enterprise storage market is rapidly expanding to include NVMe and NVMe-oF products pervasively. This presents the challenge: how do you manage these as part of your enterprise data center?

As the NVM Express family of specifications continue to develop, the corresponding Swordfish management capabilities are also evolving. The SNIA Swordfish management bundle (including the specification, schema, documentation, and more) has expanded to include full NVMe and NVMe-oF technology enablement and alignment across DMTF, NVMe and SNIA for NVMe and NVMe-oF technology use cases.

In conjunction with Redfish®, Swordfish's capabilities to manage NVMe and NVMe-oF devices in the enterprise provide a seamless management ecosystem. 

This presentation will introduce management of NVMe and NVMe-oF technology with SNIA Swordfish. Using an example of the SNIA Swordfish functionality, the presenters will introduce how to manage the complexity of discovery controllers with the simplified model presented to Swordfish clients.

Catch the Wave – Managing NVMe-oF™ in the Enterprise

The days of simple, static, self-contained file systems have long passed. Today, we have complex, dynamic namespaces, mixing block, file, object, key-value, queue, and graph-based resources, accessed via multiple protocols, and distributed across multiple systems and geographic sites. These complexities result in new challenges for simplifying management. 

The good news is, that the SNIA Cloud Data Management Interface (CDMI™), an open ISO standard (ISO/IEC 17826:2022) for managing data objects and containers, already includes extensive capabilities for simplifying the management of complex namespaces. In this webinar, attendees will learn how to simplify namespace management – the open standards way, including namespace discovery, introspection, exports, imports and more, discussing:

• Challenges and limitations with proprietary namespace management
• Overview of namespaces and industry evolution
• Lack of portability between platforms
• Using CDMI for simplified and consistent namespace management
• Use cases for namespace management

Simplified Namespace Management – The Open Standards Way

AI is disrupting so many domains and industries and by doing so, AI models and algorithms are becoming increasingly large and complex. This complexity is driven by the proliferation in size and diversity of localized data everywhere, which creates the need for a unified data fabric and/or federated learning. It could be argued that whoever wins the data race will win the AI race, which is inherently built on two premises: 1) Data is available in a central location for AI to have full access to it, 2) Compute is centralized and abundant. 

Edge AI though, defies these assumptions. If centralized (or in the cloud) AI is a superpower and super expert, edge AI is a community of many smart wizards. As humans, we can appreciate the power of cumulative knowledge over a central superpower. In this webinar, we will touch on: 
• The value and use cases of distributed edge AI 
• How data fabric on the edge differs from the cloud and its impact on AI
• Edge device data privacy trade-offs and distributed agency trends
• Privacy mechanisms for federated learning, inference, and analytics
• How interoperability between cloud and edge AI can happen

Why Distributed Edge Data is the Future of AI

With cloud data privacy regulations evolving worldwide and accelerated adoption of AI technologies such as ChatGPT, Large Language Models (LLMs) and more, companies must ensure data and AI models are compliant. Confidential AI is a new collaborative platform for data and AI teams to work with sensitive data sets and run AI models in a confidential environment. It includes infrastructure, software, and workflow orchestration to create a secure, on-demand work environment that meets organizations' privacy requirements and complies with regulatory mandates. In this session, you’ll learn:

• What confidential AI is and why it is important
• Changing privacy and compliance landscape for AI use and models
• Biggest data privacy threats and opportunities 
• Pragmatic examples and next steps

The Rise of Confidential AI

Since its ratification in late 2018, NVMe/TCP has gained a lot of attention due to its great performance characteristics and relatively low cost. Since then, the NVMe/TCP protocol has been enhanced to add features such as Discovery Automation, Authentication and Secure Channels that make it more suitable for use in enterprise environments. More recently, as customers evaluate their options and consider adopting NVMe/TCP for use in their environment, many find they need a bit more information before deciding how to move forward and are asking questions such as:
• How does NVMe/TCP stack up against my existing block storage protocol of choice in terms of performance?
• Should I use a dedicated storage network when deploying NVMe/TCP or is a converged network ok?
• How can I automate interaction with my IP-Based SAN?

Join us for an open discussion regarding these questions and more.

NVMe/TCP: Performance, Deployment and Automation

Data Fabric is an architecture, set of services and platform that standardizes and integrates data across the enterprise regardless of data location (On-Prem, Cloud, Multi Cloud, Hybrid Cloud), enabling self-service data access to support various applications, analytics, and use cases.  The data fabric leaves data where it lives and applies intelligent automation to govern, secure and bring AI to your data. This session will discuss:
• Different types of data sources for data fabric integration
• Unification of structured and unstructured data sources into the data fabric
• How to simplify data access by virtually connecting data end points across a hybrid cloud landscape
• Providing automatic enrichment leveraging AI to contextualize data with semantics and knowledge
• Apply global and automated data governance and data privacy policy enforcement for increased data protection and quality

Data Fabric: Connecting the Dots between Structured and Unstructured Data

Join Jim Handy of Objective Analysis as he moderates a panel featuring Andy Rudoff and Bhushan Chitlur from Intel, David McIntyre from Samsung, and  Sudhir Balasubramanian and Arvind Jagannath from VMware as they discuss Persistent Memory , Compute Express Link™ (CXL™), and Memory Tiering; and how the eco-system is working together to provide solutions for memory tiering using CXL for customer use cases.

Persistent Memory , CXL, and Memory Tiering - Past , Present & Future

Explore the exciting and rapidly evolving world of decentralized storage and how it is bridging the gap between Web 2.0 and Web 3.0

In this webinar, we will provide an overview of the importance of enterprise decentralized storage and why it is more relevant now than ever before. We will delve into the benefits and demand of decentralized storage and discuss the evolution of on-premises to cloud to decentralized storage (cloud 2.0).

We will also explore the various use cases of decentralized storage, including its role in data privacy and security, and the potential for decentralized applications (dApps) and blockchain technology.

As part of this webinar, we will introduce you to the Decentralized Storage Alliance, a group of like-minded individuals and organizations committed to advancing the adoption of decentralized storage. We will provide insights into the members of the Alliance and the Working Groups that are driving innovation and progress in this exciting field and answer questions such as: 

● Why is enterprise decentralized storage important?
● What are the benefits, the demand, and why now?
● How will on-premises to cloud to decentralized storage evolve?
● What are the use cases of decentralized storage?
● Who are the members and Working Groups of the Decentralized Storage Alliance?

Join us to gain valuable insights into the future of decentralized storage and discover how you can be part of this game-changing technology.

Why Web 3.0 is Important to Enterprise Storage

Composable disaggregated infrastructures provide a promising solution to addressing the provisioning and computational efficiency limitations, as well as hardware and operating costs, of integrated, siloed systems. But how do we solve these problems in an open, standards-based way?

DMTF, SNIA, the OFA, and the CXL™ Consortium are working together to provide elements of the overall solution, with Redfish® and SNIA Swordfish™ manageability providing the standards-based interface. OFA is developing an OpenFabrics Management Framework (OFMF) designed for configuring fabric interconnects and managing composable disaggregated resources in dynamic High Performance Computing (HPC) infrastructures using client-friendly abstractions.

In this webinar, attendees will understand how use cases for scaling management of storage and fabrics and beyond are addressed in these architectures, and the applicability to additional technologies.

Casting the Net: Scaling Management of Storage and Fabrics

Cloud storage providers and anyone developing enterprise datacenters have an unprecedented array of new technologies to choose from to build their next-generation environments.  These new technologies present more potential permutations to work with, enabling even greater opportunities for optimization.  

Adding additional virtualization and acceleration technologies presents more flexibility and options to build a custom configuration but doing so increases the management challenges exponentially.  With the proliferation of different technologies and multiple vendors, standards-based management is more critical than ever to successfully develop, integrate, deploy, and manage systems and storage at scale.
 
This session will provide an overview of:
The latest technologies in storage for virtualization, acceleration, and fabrics
The organizations delivering standards-based management
A discussion of open-source projects delivering value-add using standards-based management

Why Storage Management Standards Matter in Complex Virtualized Environments

Data centers continue to expand their environmental footprints, currently consuming 2% of the developed world’s electricity. Experts predict this number could rise to 13% by 2030. This webinar will cover energy-efficiency in data centers and ways to rein in costs and improve sustainability. This includes delivering more power efficiency per capacity, revolutionizing cooling to reduce heat, increasing system processing to enhance performance, and infrastructure consolidation to reduce the physical and carbon footprint.
 
Join this webcast and you’ll hear our panel of experts discuss:

• Defining Sustainability  
• Why Does Sustainability Matter for IT? 
• Sustainability for Storage & Networking 
• The Importance of Measurement and KPIs
• Sustainability vs. Efficiency 
• Best practices - Now vs. Future  
• Bringing your IT, Facilities and Sustainability Organizations Together

Sustainability in the Data Center Ecosystem

The SODA Foundation, in partnership with Linux Foundation Research, has recently published its Data and Storage Trends 2022 Report, “Data and Storage Strategies in the Era of the Data-Driven Enterprise.” The findings from this global study provide a comprehensive look at the intersection of cloud computing, data and storage management, the configuration of environments that end-user organizations are gravitating to, and priorities of selected capabilities over the next several years. 

SNIA is pleased to host SODA members who led this important research for a live discussion and in-depth look at key trends driving data and storage, including:

• The top 12 trends in data and storage
• Data security challenges facing container deployments
• Approaches to public cloud deployment
• Challenges for storage observability
• Focus on hybrid and multi-cloud deployments
• Top use cases for cloud storage services
• The impact of open source and data and storage

Top 12 Trends in Data and Cloud Storage

Cybercriminals have always been about data – stealing data, compromising data, holding data hostage. Businesses continue to respond with malware detection on laptops and networks to protect data and prevent breaches, so why should storage be left out?  Storage houses what the bad actors are targeting - your data.  Is there anything we can do from within the storage layer to further enhance defense in depth?  
 
Enter "Cyberstorage", a term coined by Gartner, which is defined as doing threat detection and response in storage software or hardware. A parallel, related trend in the security industry is eXtended Detection and Response (XDR) which shifts some of the threat detection from centralized security monitoring tools (SIEMs) down into each domain (e.g., endpoint, network) for faster detection and automated response.  Factor in the growing impact of ransomware and all these forces are driving the need to find creative, new ways to detect malware, including from inside the storage domain.   
 
In this session we'll discuss:
• Cyberstorage and XDR – what are these emerging trends?
• Threat detection and response methods through a storage lens
• Possible approaches for detection when used in conjunction with security tooling
• Why silos between security and storage need to be addressed for successful threat detection

Cyberstorage and XDR: Threat Detection through a Storage Lens

Industry analysts predict Deep Learning will account for the majority of cloud workloads. Additionally, training of Deep Learning models will represent the majority of server applications in the next few years. Among Deep Learning workloads, foundation models -- a new class of AI models that are trained on broad data (typically via self-supervision) using billions of parameters – are expected to consume the majority of the infrastructure.
 
This webcast will discuss how Deep Learning models are gaining prominence in various industries, and provide examples of the benefits of AI adoption. We’ll enumerate considerations for selection of Deep Learning infrastructure in on-premises and cloud datacenters. Our presentation will include an assessment of various solution approaches, and identify challenges faced by enterprises in their adoption of AI and Deep Learning technologies. We’ll answer questions like:
·       What benefits are enterprises enjoying from innovations in AI, Machine Learning, and Deep Learning?
·       How should cost, performance, and flexibility be traded off when designing deep learning infrastructure?
·       How are cloud native AI software stacks such as Kubernetes being leveraged by organizations to reduce complexity with rapidly evolving software stacks (TensorFlow, PyTorch, etc.)?
·       What are the challenges in operationalizing Deep Learning infrastructure?
·       How can Deep Learning solutions scale?
·       Besides cost, time-to-train, data storage capacity and data bandwidth, what else should be considered when selecting a Deep Learning infrastructure?

Training Deep Learning Models in the Cloud

With the emergence of GPUs, xPUs (DPU, IPU, FAC, NAPU, etc) and computational storage devices for host offload and accelerated processing, a panoramic wild west of frameworks are emerging, consolidating and vying for the preferred programming software stack that best integrates the application layer with these underlying processing units. 
 
This webcast will provide an overview of programming frameworks that support (1) GPUs (CUDA, SYCL, OpenCL, oneAPI), (2) xPUs (DASH, DOCA, OPI, IPDK), and (3) Computational Storage (SNIA computational storage API, NVMe TP4091 and FPGA programming shells). 

We will discuss strengths and challenges and market adoption across these programming frameworks as we untangle the alphabet soup of new frameworks that include:
• AI/ML: OpenCL, CUDA, SYCL, oneAPI 
• xPU: DOCA, OPI, DASH, IPDK 
• Core data path frameworks: SPDK, DPDK 
• Computational Storage: SNIA Standard 0.8 (in public review), TP4091

You’ve Been Framed! xPU, GPU & Computational Storage Programming Frameworks

Programming Frameworks

Computational Storage

Are you an IT service management professional interested in developing your knowledge and improving your job performance? Join the IT service management community to access the latest updates from industry experts. Learn and share insights related to IT service management (ITSM) including topics such as the service desk, service catalog, problem and incident management, ITIL v4 and more. Engage with industry experts on current best practices and participate in active discussions that address the needs and challenges of the ITSM community.

IT Service Management

Cloud computing has exploded over the past few years, delivering a previously unimagined level of workplace mobility and flexibility. The cloud computing community on BrightTALK is made up of thousands of engaged professionals learning from the latest cloud computing research and resources. Join the community to expand your cloud computing knowledge and have your questions answered in live sessions with industry experts and vendor representatives.

Cloud Computing

The IT security community on BrightTALK is composed of more than 200,000 IT security professionals trading relevant information on software assurance, network security and mobile security. Join the conversation by watching on-demand and live information security webinars and asking questions of experts and industry leaders.

IT Security

The data center management community focuses on the holistic management and optimization of the data center. From technologies such as virtualization and cloud computing to data center design, colocation, energy efficiency and monitoring, the BrightTALK data center management community provides the most up-to-date and engaging content from industry experts to better your infrastructure and operations. Engage with a community of your peers and industry experts by asking questions, rating presentations and participating in polls during webinars, all while you gain insight that will help you transform your infrastructure into a next generation data center.

Data Center Management

The unexpected nature of natural disasters and other disruptive events means that preparation is key to managing disaster recovery and business continuity planning. Join the business continuity and disaster recovery community for live and recorded presentations discussing best practices for business continuity planning, disaster recovery programs and business continuity management. Learn from BCDR experts to develop your critical infrastructure and gain insight into tactical solutions to your BCDR issues.

Business Continuity / Disaster Recovery

The storage community on BrightTALK is made up of thousands of storage and IT professionals. Find relevant webinars and videos on storage architecture, cloud storage, storage virtualization and more presented by recognized thought leaders. Join the conversation by participating in live webinars and round table discussions.

Storage

As an IT professional, many of the problems you face are multifaceted, complex and don’t lend themselves to simple solutions. The information technology community features useful and free information technology resources. Join to browse thousands of videos and webinars on ITIL best practices, IT security strategy and more presented by leading CTOs, CIOs and other technology experts.

You’ve Been Framed! xPU, GPU & Computational Storage Programming Frameworks

Presented by

About this talk

More from this channel