Presented by
Alex Pierce, Pepperdata Field Engineer
Optimize Spark Performance on Kubernetes - Part 1
About this talk
Running Spark on Kubernetes is growing in popularity. Reasons for the growth are improved isolation, better resource sharing, and the ability to leverage homogeneous and cloud-native infrastructure for the entire stack.
But running Spark on Kubernetes in a stable, performant, cost-efficient, and secure manner also presents specific challenges. In this webinar, Alex Pierce will talk about how to optimize Spark performance on Kubernetes. Topics include:
– Making Spark-on-k8s reliable at scale
– Core concepts and setup of Spark on Kubernetes
– Configuration tips for performance and efficient resource sharing
– Spark-app level dynamic allocation and cluster level autoscaling
– Monitoring and security best practices
Pepperdata
6421 subscribers3 talks
Real-time, automated cloud cost optimization with no manual tuning
Pepperdata Capacity Optimizer delivers 30-47% greater cost savings for data-intensive workloads, eliminating the need for manual tuning by optimizing CPU and memory in real time with no application changes. Pepperdata pays for itself, immediately decreasing instance hours/waste, increasing utilization, and freeing developers from manual tuning to focus on innovation.