Hi [[ session.user.profile.firstName ]]

f4: Facebook’s Warm BLOB Storage System

Originally presented at SNIA’s 2015 Storage Developer Conference, this webcast will discuss how Facebook’s massive and continuously growing corpus of photos, videos, and other Binary Large OBjects (BLOBs) need to be reliably stored and quickly accessed.

As the footprint of BLOBs increases, storing them in their traditional storage system, Haystack, is becoming increasingly inefficient. To increase Facebook’s storage efficiency, measured in the effective-replication-factor of BLOBs, they examine the underlying access patterns of BLOBs and identify temperature zones that include hot BLOBs that are accessed frequently and warm BLOBs that are accessed far less often.

Facebook’s overall BLOB storage system is designed to isolate warm BLOBs and enable them to use a specialized warm BLOB storage system, f4. f4 is a new system that lowers the effective-replication-factor of warm BLOBs while remaining fault tolerant and able to support the lower throughput demands.
Recorded Mar 16 2016 48 mins
Your place is confirmed,
we'll send you email reminders
Presented by
Satadru Pan, Software Engineer, Facebook
Presentation preview: f4: Facebook’s Warm BLOB Storage System

Network with like-minded attendees

  • [[ session.user.profile.displayName ]]
    Add a photo
    • [[ session.user.profile.displayName ]]
    • [[ session.user.profile.jobTitle ]]
    • [[ session.user.profile.companyName ]]
    • [[ userProfileTemplateHelper.getLocation(session.user.profile) ]]
  • [[ card.displayName ]]
    • [[ card.displayName ]]
    • [[ card.jobTitle ]]
    • [[ card.companyName ]]
    • [[ userProfileTemplateHelper.getLocation(card) ]]
  • Channel
  • Channel profile
  • Designing Data Lakes: Architecture options with open source tools Oct 25 2017 12:00 pm UTC 60 mins
    Maloy Manna, PM Engineering, AXA Data Innovation Lab, Paris
    The concept of Data lakes evolved to address challenges and opportunities in managing big data.

    Organizations are investing massive amounts of time and money to upgrade existing data infrastructures and build data lakes whether on-premises or in the cloud.

    This talk will discuss architectures and design options to implement data lakes with open source tools. Also covered are challenges of upgrade & migration from existing data warehouses, metadata management, supporting self-service and managing production deployments.
  • Introduction to Blockchain: Bitcoin, Ethereum, Ledgers, and more Oct 9 2017 2:00 pm UTC 60 mins
    David Siegel, Blockchain, decentralization and business agility expert
    Still confused about this whole Blockchain thing? Interested in investing in digital currencies, but not sure where to start? Want to get a better idea of the threats and opportunities?

    David Siegel is a Blockchain, decentralization and business agility expert who has been a high-level management & strategy consultant to companies like Sony, Hewlett Packard, Amazon, NASA, Intel, and many start-ups. David has been praised for being able to explain Blockchain in the most simple and interesting way.

    What you will learn:
    -What is Bitcoin?
    -What is the blockchain?
    -What is Ethereum? What is Ether?
    -What is a distributed application?
    -What is a smart contract?
    -What is a triple ledger?
    -What about identity and security?
    -What business models are at risk?
    -What are the opportunities?
    -What should we do?
  • Everything You Wanted to Know About Storage - Cyan: Storage Management Sep 28 2017 5:00 pm UTC 75 mins
    Richelle Ahlvers, Broadcom, Mark Rogov, Dell/EMC, Alex McDonald, NetApp, J Metz, Cisco
    Storage can be something of a “black box,” a monolithic entity that is at once mysterious and scary. That’s why we created “The Everything You Wanted To Know About Storage But Were Too Proud to Ask” webcast series. So far, we’ve explored various and sundry aspects of storage, focusing on “the naming of the parts.” Our goal has been to break down some of the components of storage and explain how they fit into the greater whole.

    This time, however, we’re going to open up Pandora’s Box and peer inside the world of storage management, uncovering some of the key technologies that are used to manage devices, storage traffic, and storage architectures. In particular, we’ll be discussing:

    •SNMP – The granddaddy of management protocols
    •SMI-S – The bread-and-butter of vendor-neutral storage management
    •SNIA Swordfish – The new storage management solution gaining widespread momentum
    •Software-Defined Storage – the catch-all term for storage that includes architectures and management

    There’s so much to say on each of these subjects we could do a full webcast on any one of them, but for a quick overview of many of the technologies that affect storage in one place, we think you will find your time has been well spent.

    Join us on September 28th, 2017, for our continuation of the “Too Proud To Ask” series with Cyan, the Storage Management Pod.
  • Cloud Object Storage and the Use of Gateways Sep 26 2017 5:00 pm UTC 75 mins
    Dan Albright, Cloud Object Storage Program Manager, IBM, Alex McDonald, SNIA Cloud Storage Chair, NetApp
    The use of cloud object storage is ramping up sharply, especially in the public cloud, to reduce capital budgets and operating expenses. However, enterprises are challenged with legacy applications that do not support standard protocols to move data to and from the cloud.

    Enterprises have developed strategies specific to the public cloud for Data Protection, Archive, Application development, DevOps, Big Data Analytics and Cognitive Artificial Intelligence. However, these same organizations have legacy applications and infrastructure that are not cloud friendly.

    Object storage is a secure, simple, scalable, and cost-effective means of managing the explosive growth of unstructured data enterprises generate every day. Gateways enable SMB and NFS data transfers to be converted to Amazon’s S3 protocol while optimizing data with deduplication and providing QoS efficiency on the data path to the cloud.

    This webcast will highlight the market trends toward the adoption of object storage and the use of gateways to execute a cloud strategy, the benefits of object storage when gateways are deployed, and the use cases that are best suited to leverage this solution.

    Join this webcast to learn:
    •The benefits of object storage when gateways are deployed
    •Primary use cases for using object storage and gateways in private, public or hybrid cloud
    •How gateways can help achieve the goals of your cloud strategy without
    retooling your on-premise infrastructure and applications
  • Deep Stupidity: Probing the limits of AI, Deep Learning and Analytics Sep 25 2017 1:00 pm UTC 60 mins
    Prof J. Mark Bishop, Director, TCIDA (The Centre for Intelligent Data Analytics)
    On December 2nd 2014, provoked by the impact of `Deep Learning’ and other recent scientific and technical advances in Artificial Intelligence, Professor Stephen Hawking released a terrifying warning about the coming technological singularity and the existential danger of AI: "The development of full artificial intelligence could spell the end of the human race. It would take off on its own, and re-design itself at an ever-increasing rate," Professor Hawking said. "Humans, who are limited by slow biological evolution, couldn't compete, and would be superseded".

    Fashions in AI come and go - and the hype around so called ‘Deep Learning’ networks is not without precedence - so what is it about ‘nouveau AI’ that warrants such alarm?

    Conversely, in this talk, I will endeavour to situate recent technological landmarks more properly in their historical niche; concluding, by foregrounding the computationally-impregnatable barriers which remain between ‘Deep Minds’ and `Real Minds`.
  • The Cognitive Bank: Leveraging Advanced Analytics and Artificial Intelligence Sep 21 2017 12:00 pm UTC 60 mins
    Vivek Bajaj, Global VP of Solutions for IBM Financial Services
    Today the payments industry faces a rebirth by necessity. Financial institutions process massive volumes of customer and payments transaction data, much of it unstructured and untapped.

    Cognitive Systems have the ability to understand, reason and learn. In Financial Services applying cognitive capabilities to real world payments issues like safer and faster payments is yielding significant results. Furthermore Risk and Compliance and segment of one engagement are areas where ROI is tremendous when leveraging advanced analytics and artificial intelligence in cohesion.

    Learn from real world use cases of how financial institutions globally have gained significant competitive advantage by becoming a truly Cognitive Bank.
  • A Tactical Guide to Reducing Your Data Breach Risk Aug 29 2017 5:00 pm UTC 75 mins
    Dr. Branden Williams; Farshad Ghazi, HPE; Yo Delmar, MetricStream; Jordan Rogers, Rapid7; and Billy Sokol, MarkLogic
    Over 90% of the world’s data has been generated in the last few years. Accompanying this rapid growth in data comes exponential risks, as witnessed by the spike in cyber attacks of which no organization seems immune. The financial rewards gained by the perpetuators of cyber attacks is blatant, and this is driving continued attacks on companies containing massive amounts of consumer data. For these companies securing data is only half the battle. The risks can be greater when data is transmitted externally, hence it is critical that organizations know where sensitive data is going, how it is being transmitted, and how it is being handled and stored.

    On this webinar our panel of experts will discuss some of the best practices organizations can consider to reduce the risk of suffering from a data breach, and to proactively prepare for any subsequent breach that could happen.
  • Data scientists: Can't live with them, can't live without them. Aug 24 2017 3:00 pm UTC 45 mins
    Wyatt Benno, CEO, DataHero
    There has been a flood of publicity around big data, data processing, and the role of predictive analytics in businesses of the future.
    As business operators how do we get access to these valuable business insights, even when there is not a data analyst around to walk us through their results?

    - Should your software emulate a data scientist?
    - Learn about the power of data visualizations.
    - Learn about creating value from disperse data sets.
  • Data Visualization for Predictive Analytics Aug 24 2017 2:00 pm UTC 60 mins
    Andy Kriebel, Eva Murray, Benedetta Tagliaferri
    What does the future hold?

    Predictive Analytics - everyone is talking about it and many organisations claim to be doing it. But are they? And what insights do they gain to then make tactical or strategic changes? How can analysts work with decision makers by sharing results in a visually effective and meaningful way while also informing them about possible courses of action?

    This webinar is presented by Andy Kriebel, Head Coach at the Data School and Eva Murray, Tableau Evangelist at Exasol. Our guest speaker on Predictive Analytics is Benedetta Tagliaferri, Consulting Analyst at The Information Lab.

    The webinar will look at some examples of predictive analysis and will show data visualization examples that are actionable and can drive further questions and discussions in an organisation.
  • Ask the Visualization Expert: Live Q&A on Advanced Data Visualization Aug 24 2017 1:00 pm UTC 60 mins
    Carl Edwards, BI Consultant, Brett Churchill, BI Consultant
    Looking to take your graphs to the next level? Want to make sure you choose the right visualization? Plagued by the challenges of geospatial heat maps?

    Get your questions ready and join this session where data experts Carl and Brett will go over the common questions they get asked and answer all the data visualization issues you've been plagued with, including how to:

    -Use location-based data to put your visualization on the map
    -Uncover new relationships, patterns and opportunities
    -Identify emerging trends
    -Answering comparative business questions with set analysis
    -Understand best practices for creating an aesthetically-pleasing and useful visualization
  • How Many Analysts Does It Take To Change a Lightbulb? Aug 24 2017 10:00 am UTC 45 mins
    Steve Adams, Senior Consultant, Visual DJ, Ltd.
    When analysis needs to be used by decision makers that didn’t create it, the communication of the information and the message it conveys becomes critical. There is a plethora of ways to layout reports and dashboards, even within a single company.
    Enter the SUCCESS formula, that “lightbulb” moment.

    Introduced by the IBCS Association (International Business Communication Standards) the SUCCESS formula provides conceptual, perceptual and semantic rules that enable faster, better, and less-costly results in all stages of business communications and decision-making processes.

    This webinar will introduce the 7 Rules of SUCCESS that provides a toolkit to aid analysts in designing their visualisations for better reach and decisions in their target audience.

    The webinar will also introduce The Philips journey to implementing IBCS principles in their global "Accelerate!” Initiative.
  • Tensorflow machine learning library and sample of application Aug 24 2017 9:00 am UTC 45 mins
    Marwa Ayad Mohamed ( Founder of YourChildCode ,Team lead software Engineer, Women Techmakers Cairo Lead)
    Tensorflow is an open source software library for numerical computation and machine learning.

    Join this session where Marwa will discuss:

    -Introduction to Artificial intelligence, machine learning and deep learning
    -Sample of machine learning applications
    -Tensorflow Story, Model and windows installation steps with object recognition demo.
  • Artificial Intelligence: Methods, Applications and Impacts Recorded: Aug 23 2017 49 mins
    Arinze Akutekwe, PhD Data Scientist, BAS EMEIA – Intelligent Enterprise - Analytics at Fujitsu
    Artificial intelligence has greatly changed the way we live since the 20th century. It involves the science and engineering of making machines intelligent and autonomous using computer programs.

    The processing power of computers has been on the exponential increase with cost of processors and storage decreasing. This has made research and developments efforts in AI areas such as deep learning, once thought to be impossible possible.

    In this webinar, we will examine current methods, application domains of specific methods, their impacts on our daily lives and try to answer questions on ethics of applying these technologies.
  • Ask the Data Expert: Live Q&A on All Things Machine Learning & AI Recorded: Aug 23 2017 59 mins
    Wim Stoop, Cloudera
    Join this webinar where data expert Wim Stoop from Cloudera will answer all of your Machine Learning & AI questions live.

    Wim will also go over some frequently asked questions on Machine Learning and AI such as:

    - Why is machine learning and AI crucial to master for organisations?
    - What components are needed to take advantage of data science?
    - Which use cases drive the greatest value?
  • Putting AI into LeAdershIp Recorded: Aug 23 2017 45 mins
    Prof. Dr. Michael Feindt, Founder & Chief Scientific Officer, Blue Yonder
    Artificial Intelligence (AI) is not a technology for the future; it’s a huge business opportunity for today. But how can your organisation become a trailblazer for AI innovation, transforming the way you work to deliver immediate – and lasting – bottom line value?

    Former CERN scientist, Prof. Dr. Michael Feindt, is one of the brightest minds in Machine Learning. Join him for a 30-minute masterclass in how to apply AI to your business.

    You’ll learn how AI can:
    •Make sense of market and customer complexity, to deliver quick and effective decisions every single day
    •Increase workforce productivity to improve output and staff morale
    •Enhance decision-making and forecasting accuracy, for operational efficiency and improved productivity
    •Be implemented into your business quickly, easily, with minimal disruption

    Michael will also share real-life examples of how international businesses are using AI as a transformation tool, from his experience as founder of market-leading AI solution provider, Blue Yonder.
  • Analytics Nightmares and How You Can Prevent Them Recorded: Aug 22 2017 49 mins
    Meta S. Brown, Author, Data Mining for Dummies and President, A4A Brown, Inc.
    Analytics risks can keep you up at night. What if…
    · We make a big investment and don’t break even?
    · Management doesn’t trust the results?
    · Analysts cross data privacy boundaries?

    What a dilemma! You see the perils, yet you want the rewards that analytics can bring. The appropriate process enables you to dramatically reduce risks and maximize returns on your data and analytics investment.

    In this presentation, you will learn:
    · What causes most analytics failures
    · How you can diminish risk and maximize returns through strong analytics process
    · Why you (yes, you!) have a pivotal opportunity to establish high standards for analytics process right now
  • Unsupervised learning to uncover advanced cyber attacks Recorded: Aug 22 2017 49 mins
    Rafael San Miguel Carrasco, Senior Specialist, British Telecom EMEA
    This case study is framed in a multinational company with 300k+ employees, present in 100+ countries, that is adding one extra layer of security based on big data analytics capabilities, in order to provide net-new value to their ongoing SOC-related investments.

    Having billions of events being generated on a weekly basis, real-time monitoring must be complemented with deep analysis to hunt targeted and advanced attacks.

    By leveraging a cloud-based Spark cluster, ElasticSearch, R, Scala and PowerBI, a security analytics platform based on anomaly detection is being progressively implemented.

    Anomalies are spotted by applying well-known analytics techniques, from data transformation and mining to clustering, graph analysis, topic modeling, classification and dimensionality reduction.
  • Everything You Wanted To Know About Storage-Turquoise: Where Does My Data Go Recorded: Aug 1 2017 61 mins
    Rob Peglar, Symbolic IO, Scott Shadley, Micron, J Metz, Cisco, Chad Hintz, Cisco
    In this, the seventh entry in the “Everything You Wanted To Know About Storage But Were Too Proud To Ask,” popular webcast series we look into the mysticism and magic of what happens when you send your data off into the wilderness. Once you click “save,” for example, where does it actually go?

    When we start to dig deeper beyond the application layer, we often don’t understand what happens behind the scenes. It’s important to understand multiple aspects of the type of storage our data goes to along with their associated benefits and drawbacks as well as some of the protocols used to transport it.

    In this webcast we will show you more about the following:

    •Volatile v Non-Volatile v Persistent Memory
    •NVDIMM v RAM v DRAM v SLC v MLC v TLC v NAND v 3D NAND v Flash v SSDs v NVMe
    •NVMe (the protocol)

    Many people get nervous when they see that many acronyms, but all too often they come up in conversation, and you’re expected to know all of them? Worse, you’re expected to know the differences between them, and the consequences of using them? Even worse, you’re expected to know what happens when you use the wrong one?

    We’re here to help.

    It’s an ambitious project, but these terms and concepts are at the heart of where compute, networking and storage intersect. Having a good grasp of these concepts ties in with which type of storage networking to use, and how data is actually stored behind the scenes.

    Please join us on August 1st for another edition of the “Too Proud To Ask” series, as we work towards making you feel more comfortable in the strange, mystical world of storage.

    After the webcast, check out the Q&A blog http://sniaesfblog.org/?p=643
  • Containers and Persistent Memory Recorded: Jul 27 2017 55 mins
    Arthur Sainio, SNIA NVDIMM SIG Co-chair, SMART Modular, Chad Thibodeau, Veritas, Alex McDonald, NetApp
    Containers can make it easier for developers to know that their software will run, no matter where it is deployed. This webcast, presented by the SNIA Cloud Storage Initiative and the SNIA Solid State Storage Initiative, will discuss how persistent memory is a revolutionary technology, which will boost the performance of next-generation packaging of applications and libraries into containers.

    You’ll learn:
    •What SNIA is doing to advance persistent memory
    •What the ecosystem enablement efforts are around persistent memory solutions
    •How NVDIMMs are paving the way for plug-n-play adoption into containers environments

    Join SNIA experts, Arthur Sainio, SNIA NVDIMM SIG Co-chair, Chad Thibodeau, SNIA Cloud Storage member and Alex McDonald Co-chair of SNIA Solid State Storage and SNIA Cloud Storage Initiatives to find out what customers, storage developers, and the industry want to see to fully unlock the potential of persistent memory in a container environment.
  • Data Analytics in Financial Services: Identifying obstacles and key issues Recorded: Jul 20 2017 61 mins
    Alex Kwiatkowski (Finastra), Peter Jackson (Southern Water), Jessica Holzbach (Penta)
    In an increasingly digitalised world, the value of information grows ever higher. Winning organisations – whether in financial services or any other vertical sector – will be those who can harness the power of data analytics to develop microscopic levels of insight and foresight into customer behaviours and operational activities in order to make progressive improvements on a continuous basis. Product development informed by factual evidence rather than educated guesswork, or real-time risk management based on a hyper-accurate picture of exposures, bring significant internal and external benefits.

    However, while banks want to get closer to their customers, is the feeling mutual? Data privacy is a very sensitive issue, and the perception of what constitutes intrusion will likely vary between individuals. Institutions, therefore, need to walk a fine line between what’s genuinely useful and what’s genuinely creepy.

    During this webinar, a panel of respected subject matter experts will discuss and dissect the key issues related to the widespread use of data analytics in financial services, identifying the obstacles which need to be overcome and the enablers that will drive FS forward successfully.
Making data intelligent
You've got data. It's time manage it. Find information here on everything from data governance and data quality, to master and metadata management, data architecture, and the thing that was just invented ten seconds ago.

Embed in website or blog

Successfully added emails: 0
Remove all
  • Title: f4: Facebook’s Warm BLOB Storage System
  • Live at: Mar 16 2016 5:00 pm
  • Presented by: Satadru Pan, Software Engineer, Facebook
  • From:
Your email has been sent.
or close