Name: f4: Facebook’s Warm BLOB Storage System
Start: 2016-03-16T17:00:00Z
End: 2016-03-16T17:00:47.000Z
Location: BrightTALK
Rating: 4.4

SNIA is a not-for-profit global organization made up of corporations, universities, startups, and individuals. The members collaborate to develop and promote vendor-neutral architectures, standards, and education for management, movement, and security for technologies related to handling and optimizing data. SNIA focuses on the transport, storage, acceleration, format, protection, and optimization of infrastructure for data.

The days of simple, static, self-contained file systems have long passed. Today, we have complex, dynamic namespaces, mixing block, file, object, key-value, queue, and graph-based resources, accessed via multiple protocols, and distributed across multiple systems and geographic sites. These complexities result in new challenges for simplifying management. 

The good news is, that the SNIA Cloud Data Management Interface (CDMI™), an open ISO standard (ISO/IEC 17826:2022) for managing data objects and containers, already includes extensive capabilities for simplifying the management of complex namespaces. In this webinar, attendees will learn how to simplify namespace management – the open standards way, including namespace discovery, introspection, exports, imports and more, discussing:

• Challenges and limitations with proprietary namespace management
• Overview of namespaces and industry evolution
• Lack of portability between platforms
• Using CDMI for simplified and consistent namespace management
• Use cases for namespace management

Simplified Namespace Management – The Open Standards Way

AI is disrupting so many domains and industries and by doing so, AI models and algorithms are becoming increasingly large and complex. This complexity is driven by the proliferation in size and diversity of localized data everywhere, which creates the need for a unified data fabric and/or federated learning. It could be argued that whoever wins the data race will win the AI race, which is inherently built on two premises: 1) Data is available in a central location for AI to have full access to it, 2) Compute is centralized and abundant. 

Edge AI though, defies these assumptions. If centralized (or in the cloud) AI is a superpower and super expert, edge AI is a community of many smart wizards. As humans, we can appreciate the power of cumulative knowledge over a central superpower. In this webinar, we will touch on: 
• The value and use cases of distributed edge AI 
• How data fabric on the edge differs from the cloud and its impact on AI
• Edge device data privacy trade-offs and distributed agency trends
• Privacy mechanisms for federated learning, inference, and analytics
• How interoperability between cloud and edge AI can happen

Why Distributed Edge Data is the Future of AI

With cloud data privacy regulations evolving worldwide and accelerated adoption of AI technologies such as ChatGPT, Large Language Models (LLMs) and more, companies must ensure data and AI models are compliant. Confidential AI is a new collaborative platform for data and AI teams to work with sensitive data sets and run AI models in a confidential environment. It includes infrastructure, software, and workflow orchestration to create a secure, on-demand work environment that meets organizations' privacy requirements and complies with regulatory mandates. In this session, you’ll learn:

• What confidential AI is and why it is important
• Changing privacy and compliance landscape for AI use and models
• Biggest data privacy threats and opportunities 
• Pragmatic examples and next steps

The Rise of Confidential AI

Since its ratification in late 2018, NVMe/TCP has gained a lot of attention due to its great performance characteristics and relatively low cost. Since then, the NVMe/TCP protocol has been enhanced to add features such as Discovery Automation, Authentication and Secure Channels that make it more suitable for use in enterprise environments. More recently, as customers evaluate their options and consider adopting NVMe/TCP for use in their environment, many find they need a bit more information before deciding how to move forward and are asking questions such as:
• How does NVMe/TCP stack up against my existing block storage protocol of choice in terms of performance?
• Should I use a dedicated storage network when deploying NVMe/TCP or is a converged network ok?
• How can I automate interaction with my IP-Based SAN?

Join us for an open discussion regarding these questions and more.

NVMe/TCP: Performance, Deployment and Automation

Data Fabric is an architecture, set of services and platform that standardizes and integrates data across the enterprise regardless of data location (On-Prem, Cloud, Multi Cloud, Hybrid Cloud), enabling self-service data access to support various applications, analytics, and use cases.  The data fabric leaves data where it lives and applies intelligent automation to govern, secure and bring AI to your data. This session will discuss:
• Different types of data sources for data fabric integration
• Unification of structured and unstructured data sources into the data fabric
• How to simplify data access by virtually connecting data end points across a hybrid cloud landscape
• Providing automatic enrichment leveraging AI to contextualize data with semantics and knowledge
• Apply global and automated data governance and data privacy policy enforcement for increased data protection and quality

Data Fabric: Connecting the Dots between Structured and Unstructured Data

Join Jim Handy of Objective Analysis as he moderates a panel featuring Andy Rudoff and Bhushan Chitlur from Intel, David McIntyre from Samsung, and  Sudhir Balasubramanian and Arvind Jagannath from VMware as they discuss Persistent Memory , Compute Express Link™ (CXL™), and Memory Tiering; and how the eco-system is working together to provide solutions for memory tiering using CXL for customer use cases.

Persistent Memory , CXL, and Memory Tiering - Past , Present & Future

Explore the exciting and rapidly evolving world of decentralized storage and how it is bridging the gap between Web 2.0 and Web 3.0

In this webinar, we will provide an overview of the importance of enterprise decentralized storage and why it is more relevant now than ever before. We will delve into the benefits and demand of decentralized storage and discuss the evolution of on-premises to cloud to decentralized storage (cloud 2.0).

We will also explore the various use cases of decentralized storage, including its role in data privacy and security, and the potential for decentralized applications (dApps) and blockchain technology.

As part of this webinar, we will introduce you to the Decentralized Storage Alliance, a group of like-minded individuals and organizations committed to advancing the adoption of decentralized storage. We will provide insights into the members of the Alliance and the Working Groups that are driving innovation and progress in this exciting field and answer questions such as: 

● Why is enterprise decentralized storage important?
● What are the benefits, the demand, and why now?
● How will on-premises to cloud to decentralized storage evolve?
● What are the use cases of decentralized storage?
● Who are the members and Working Groups of the Decentralized Storage Alliance?

Join us to gain valuable insights into the future of decentralized storage and discover how you can be part of this game-changing technology.

Why Web 3.0 is Important to Enterprise Storage

Composable disaggregated infrastructures provide a promising solution to addressing the provisioning and computational efficiency limitations, as well as hardware and operating costs, of integrated, siloed systems. But how do we solve these problems in an open, standards-based way?

DMTF, SNIA, the OFA, and the CXL™ Consortium are working together to provide elements of the overall solution, with Redfish® and SNIA Swordfish™ manageability providing the standards-based interface. OFA is developing an OpenFabrics Management Framework (OFMF) designed for configuring fabric interconnects and managing composable disaggregated resources in dynamic High Performance Computing (HPC) infrastructures using client-friendly abstractions.

In this webinar, attendees will understand how use cases for scaling management of storage and fabrics and beyond are addressed in these architectures, and the applicability to additional technologies.

Casting the Net: Scaling Management of Storage and Fabrics

Cloud storage providers and anyone developing enterprise datacenters have an unprecedented array of new technologies to choose from to build their next-generation environments.  These new technologies present more potential permutations to work with, enabling even greater opportunities for optimization.  

Adding additional virtualization and acceleration technologies presents more flexibility and options to build a custom configuration but doing so increases the management challenges exponentially.  With the proliferation of different technologies and multiple vendors, standards-based management is more critical than ever to successfully develop, integrate, deploy, and manage systems and storage at scale.
 
This session will provide an overview of:
The latest technologies in storage for virtualization, acceleration, and fabrics
The organizations delivering standards-based management
A discussion of open-source projects delivering value-add using standards-based management

Why Storage Management Standards Matter in Complex Virtualized Environments

Data centers continue to expand their environmental footprints, currently consuming 2% of the developed world’s electricity. Experts predict this number could rise to 13% by 2030. This webinar will cover energy-efficiency in data centers and ways to rein in costs and improve sustainability. This includes delivering more power efficiency per capacity, revolutionizing cooling to reduce heat, increasing system processing to enhance performance, and infrastructure consolidation to reduce the physical and carbon footprint.
 
Join this webcast and you’ll hear our panel of experts discuss:

• Defining Sustainability  
• Why Does Sustainability Matter for IT? 
• Sustainability for Storage & Networking 
• The Importance of Measurement and KPIs
• Sustainability vs. Efficiency 
• Best practices - Now vs. Future  
• Bringing your IT, Facilities and Sustainability Organizations Together

Sustainability in the Data Center Ecosystem

The SODA Foundation, in partnership with Linux Foundation Research, has recently published its Data and Storage Trends 2022 Report, “Data and Storage Strategies in the Era of the Data-Driven Enterprise.” The findings from this global study provide a comprehensive look at the intersection of cloud computing, data and storage management, the configuration of environments that end-user organizations are gravitating to, and priorities of selected capabilities over the next several years. 

SNIA is pleased to host SODA members who led this important research for a live discussion and in-depth look at key trends driving data and storage, including:

• The top 12 trends in data and storage
• Data security challenges facing container deployments
• Approaches to public cloud deployment
• Challenges for storage observability
• Focus on hybrid and multi-cloud deployments
• Top use cases for cloud storage services
• The impact of open source and data and storage

Top 12 Trends in Data and Cloud Storage

Cybercriminals have always been about data – stealing data, compromising data, holding data hostage. Businesses continue to respond with malware detection on laptops and networks to protect data and prevent breaches, so why should storage be left out?  Storage houses what the bad actors are targeting - your data.  Is there anything we can do from within the storage layer to further enhance defense in depth?  
 
Enter "Cyberstorage", a term coined by Gartner, which is defined as doing threat detection and response in storage software or hardware. A parallel, related trend in the security industry is eXtended Detection and Response (XDR) which shifts some of the threat detection from centralized security monitoring tools (SIEMs) down into each domain (e.g., endpoint, network) for faster detection and automated response.  Factor in the growing impact of ransomware and all these forces are driving the need to find creative, new ways to detect malware, including from inside the storage domain.   
 
In this session we'll discuss:
• Cyberstorage and XDR – what are these emerging trends?
• Threat detection and response methods through a storage lens
• Possible approaches for detection when used in conjunction with security tooling
• Why silos between security and storage need to be addressed for successful threat detection

Cyberstorage and XDR: Threat Detection through a Storage Lens

Industry analysts predict Deep Learning will account for the majority of cloud workloads. Additionally, training of Deep Learning models will represent the majority of server applications in the next few years. Among Deep Learning workloads, foundation models -- a new class of AI models that are trained on broad data (typically via self-supervision) using billions of parameters – are expected to consume the majority of the infrastructure.
 
This webcast will discuss how Deep Learning models are gaining prominence in various industries, and provide examples of the benefits of AI adoption. We’ll enumerate considerations for selection of Deep Learning infrastructure in on-premises and cloud datacenters. Our presentation will include an assessment of various solution approaches, and identify challenges faced by enterprises in their adoption of AI and Deep Learning technologies. We’ll answer questions like:
·       What benefits are enterprises enjoying from innovations in AI, Machine Learning, and Deep Learning?
·       How should cost, performance, and flexibility be traded off when designing deep learning infrastructure?
·       How are cloud native AI software stacks such as Kubernetes being leveraged by organizations to reduce complexity with rapidly evolving software stacks (TensorFlow, PyTorch, etc.)?
·       What are the challenges in operationalizing Deep Learning infrastructure?
·       How can Deep Learning solutions scale?
·       Besides cost, time-to-train, data storage capacity and data bandwidth, what else should be considered when selecting a Deep Learning infrastructure?

Training Deep Learning Models in the Cloud

Panelists include Gary Kotzur, CTO Marvell; Andy Mills, Sr. Director Advanced Product Development, SMART Modular; Pekon Gupta, Business Strategy Specialist, Intel, and David McIntyre, Director Product Planning and Business Enablement, Samsung Corporation

Where do companies see the industry going with regard to persistent memory? With the improvement of SSD and DRAM I/O over CXL, the overlap of CXL and NVMe, high density persistent memory, and memory-semantic SSDs, there is a lot to talk about! Our panel of experts will widen the lens on persistent memory, take a system level approach, and see how the persistent memory landscape is being redefined.

Persistent Memory Trends - A Panel Discussion

A new class of cloud and datacenter infrastructure is emerging into the marketplace. This new infrastructure element, often referred to as Data Processing Unit (DPU), Infrastructure Processing Unit (IPU) or xPU as a general term, takes the form of a server hosted PCIe add-in card or on-board chip(s), containing one or more ASIC’s or FPGA's, usually anchored around a single powerful SoC device. 

The OPI project has been created to foster the emergence of an open and creative software ecosystem for DPU/IPU based cloud infrastructure. The project intends to delineate what a DPU/IPU is, to loosely define a framework(s) and architecture for a DPU/IPU-based software stack(s) applicable to any vendors hardware solution, to allow the creation of a rich open- source application ecosystem, to integrate with existing open-source projects aligned to the same vision such as the Linux kernel, IPDK.io, DPDK and SPDK to create new APIs for interaction with and between the elements of the DPU/IPU ecosystem:
• the DPU/IPU hardware 
• DPU/IPU hosted applications 
• the host node 
• remote provisioning software 
• remote orchestration software

Learning Objectives: 
• OPI introduction 
• OPI workstream definitions and status 
• How you too can contribute to OPI

An Introduction to the OPI (Open Programmable Infrastructure) Project

Which storage trends are continuing, growing, or emerging for 2023 and beyond? Learn from this discussion between:

• Don Jeanette, TRENDFOCUS, a leading storage market analyst;
• Patrick Kennedy, ServeTheHome, a prominent storage & server market influencer; and
• Rick Kutcipal, SCSI Trade Association & Broadcom, a storage industry veteran expert.

We will be talking about trends in the storage market specifically around hyperscale environment platforms, EDSFF, data protection, the role of DPUs, security, and more. Hear about applications driving those trends, and market data supporting the idea exchange.

Storage Trends in 2023 and Beyond

Have you ever wondered how intelligent Industry 4.0 factories or smart cities of the future will process massive amounts of sensor and machine data? What you may not expect is a digital twin will most likely play a role. A digital twin is a virtual representation of an object, system or process that spans its lifecycle, is updated from real-time data, and uses simulation, machine learning and reasoning to help decision-making. Digital twins can be used to help answer what-if AI-analytics questions, yield insights on business objectives and make recommendations on how to control or improve outcomes.

This webinar will introduce digital twin usage in edge IoT applications, highlighting what is available today, what to expect in the next couple of years, and what the future holds.  We will provide examples of how digital twin methods help capture virtual representation of real-world entities and processes, discussing: 

• What is driving the edge IoT need 
• Data analytics problems solved by digital twins
• How digital twins are being used today, tomorrow and beyond
• Use cases: adaptive agile factories, massive data generation across industries, and system of systems processes
• Why this is a technology and trend that is here to stay

Journey to the Center of Massive Data: Digital Twins

Using software to perform memory copies has been the gold standard for applications performing memory-to-memory data movement or system memory operations. With new accelerators and memory types enriching the system architecture, accelerator-assisted memory data movement and transformation need standardization.

SNIA's Smart Data Accelerator Interface (SDXI) Technical Work Group (TWG) is at the forefront of standardizing this. The SDXI TWG is designing an industry-open standard for a memory-to-memory data movement and acceleration interface that is – Extensible, Forward-compatible, and Independent of I/O interconnect technology. A candidate for the v1.0 SNIA SDXI standard is now in review.

Adjacently, Compute Express Link™ (CXL™) is an industry-supported Cache-Coherent Interconnect for Processors, Memory Expansion, and Accelerators. CXL is designed to be an industry-open standard interface for high-speed communications, as accelerators are increasingly used to complement CPUs in support of emerging applications such as Artificial Intelligence and Machine Learning.

In this webcast, we will: 
• Introduce SDXI and CXL 
• Discuss data movement needs in a CXL ecosystem  
• Cover SDXI advantages in a CXL interconnect

What’s in a Name? Memory Semantics and Data Movement with CXL™ and SDXI

The Reality Of Software Defined Storage

What is NFS: An NFS Primer

4 Ways to Improve NetApp Storage Performance Without Replacing It

A New Way to Store, Protect & Access Unlimited File Data

How to leverage object storage to solve your data challenges

All-Flash, All Software-Defined, for All Workloads

Dealing with growing storage demands: Improving TCO & performance

The Storage Evolution: The Journey to the Virtualized Flash Datacenter

Storage Performance Benchmarking: Block Components

Enterprise Storage

Originally presented at SNIA’s 2015 Storage Developer Conference, this webcast will discuss how Facebook’s massive and continuously growing corpus of photos, videos, and other Binary Large OBjects (BLOBs) need to be reliably stored and quickly accessed.

As the footprint of BLOBs increases, storing them in their traditional storage system, Haystack, is becoming increasingly inefficient. To increase Facebook’s storage efficiency, measured in the effective-replication-factor of BLOBs, they examine the underlying access patterns of BLOBs and identify temperature zones that include hot BLOBs that are accessed frequently and warm BLOBs that are accessed far less often.

Facebook’s overall BLOB storage system is designed to isolate warm BLOBs and enable them to use a specialized warm BLOB storage system, f4. f4 is a new system that lowers the effective-replication-factor of warm BLOBs while remaining fault tolerant and able to support the lower throughput demands.

f4: Facebook’s Warm BLOB Storage System

storage

data center

haystack

Are you an IT service management professional interested in developing your knowledge and improving your job performance? Join the IT service management community to access the latest updates from industry experts. Learn and share insights related to IT service management (ITSM) including topics such as the service desk, service catalog, problem and incident management, ITIL v4 and more. Engage with industry experts on current best practices and participate in active discussions that address the needs and challenges of the ITSM community.

IT Service Management

Cloud computing has exploded over the past few years, delivering a previously unimagined level of workplace mobility and flexibility. The cloud computing community on BrightTALK is made up of thousands of engaged professionals learning from the latest cloud computing research and resources. Join the community to expand your cloud computing knowledge and have your questions answered in live sessions with industry experts and vendor representatives.

Cloud Computing

The IT security community on BrightTALK is composed of more than 200,000 IT security professionals trading relevant information on software assurance, network security and mobile security. Join the conversation by watching on-demand and live information security webinars and asking questions of experts and industry leaders.

IT Security

The data center management community focuses on the holistic management and optimization of the data center. From technologies such as virtualization and cloud computing to data center design, colocation, energy efficiency and monitoring, the BrightTALK data center management community provides the most up-to-date and engaging content from industry experts to better your infrastructure and operations. Engage with a community of your peers and industry experts by asking questions, rating presentations and participating in polls during webinars, all while you gain insight that will help you transform your infrastructure into a next generation data center.

Data Center Management

The unexpected nature of natural disasters and other disruptive events means that preparation is key to managing disaster recovery and business continuity planning. Join the business continuity and disaster recovery community for live and recorded presentations discussing best practices for business continuity planning, disaster recovery programs and business continuity management. Learn from BCDR experts to develop your critical infrastructure and gain insight into tactical solutions to your BCDR issues.

Business Continuity / Disaster Recovery

The storage community on BrightTALK is made up of thousands of storage and IT professionals. Find relevant webinars and videos on storage architecture, cloud storage, storage virtualization and more presented by recognized thought leaders. Join the conversation by participating in live webinars and round table discussions.

Storage

As an IT professional, many of the problems you face are multifaceted, complex and don’t lend themselves to simple solutions. The information technology community features useful and free information technology resources. Join to browse thousands of videos and webinars on ITIL best practices, IT security strategy and more presented by leading CTOs, CIOs and other technology experts.

f4: Facebook’s Warm BLOB Storage System

Presented by

About this talk

More from this channel