Data Engineering with Modern Data Pipelines for Hybrid Cloud

Presented by

Joshua Robinson, Chief Technologist – File & Object Solutions, Pure Storage

About this talk

In this session, our Chief Technologist will discuss how we are helping companies build on prem as-a service models with the same agility, flexibility, and time-to-value as public cloud but at lower and more predictable cost. Pure invests heavily in software engineering to modernise architecture and produce better outcomes for the tools and workflows such as Spark, Kubernetes, ElasticSearch, Kafka, S3 and many more. Our accelerated file and object platform reduces cost, delivers new levels of simplicity, and allows engineers and developers to do things they simply couldn’t do before. Our team of engineers built a custom scale-out data platform optimised for flash. This software and hardware innovation delivers best of breed metadata, bandwidth, and low latency capabilities for modern hybrid cloud models. This session highlights our experience building and supporting internal and external data pipelines for complex data-based systems. The vast ecosystem of open source data pipeline tools presents a challenge as these tools bring multiple types of access patterns and file/object sizes that put excessive strain on older storage systems, and thus, suffer from unexpected bottlenecks and utilisation issues that cause data engineers, software developers, and DBAs to waste valuable time and effort designing resilience and performance into their programs and applications just in order to offset these fundamental shortcomings. Join us to discover how Pure and it’s customers benefit from a modern data engineering platform that helps them to produce better outcomes and over achieve on their KPI’s.
Related topics:

More from this channel

Upcoming talks (0)
On-demand talks (282)
Subscribers (10439)
Pure is redefining the storage experience and empowering innovators by simplifying how people consume and interact with data.