InfoTechTarget and Informa Tech's Digital Businesses Combine.

Together, we power an unparalleled network of 220+ online properties covering 10,000+ granular topics, serving an audience of 50+ million professionals with original, objective content from trusted sources. We help you gain critical insights and make more informed decisions across your business priorities.

How to Process Tons of Data for Cheap with Spark + Kubernetes

Presented by

Gus Cavanaugh, Solution Engineer @ Dataiku

About this talk

This webinar has something for everyone, whether technical or not. On the business side, you’ll get an overview of how to better manage your infrastructure spend while providing the compute your analysts and data scientists need as well as a practical demonstration of how autoscaling your data processing infrastructure provides the horsepower you need without breaking the bank. On the technical side, if you like Spark for processing big data and Kubernetes for scaling and managing containers but you haven’t run Spark on Kubernetes yet, this is the webinar for you. In this one hour session, you’ll learn: - Why Kubernetes is a great scheduler for Spark jobs - How to quickly spin up a managed Kubernetes cluster on AWS and run you first Spark job from your environment - How Dataiku lets data scientists spin up Kubernetes clusters and run Spark jobs with just a few mouse clicks
Dataiku

Dataiku

59982 subscribers285 talks
Everyday AI, Extraordinary People
Dataiku is the Universal AI Platform, uniting the technology, teams, and operations needed for companies to build intelligence into their daily operations, from modern analytics to generative AI. Together, they design, develop and deploy new AI capabilities, at all scales and in all industries. Organizations that use Dataiku enable their people to be extraordinary, creating the AI that will power their company into the future. More than 700 companies worldwide use Dataiku, driving diverse use cases from predictive maintenance and supply chain optimization, to quality control in precision engineering, to marketing optimization, generative AI customer proof, and everything in between.
Related topics