Optimize Spark Performance on Kubernetes

Logo
Presented by

Alex Pierce, Pepperdata Field Engineer

About this talk

Running Spark on Kubernetes is growing in popularity. Reasons for the growth are improved isolation, better resource sharing, and the ability to leverage homogeneous and cloud-native infrastructure for the entire stack. But running Spark on Kubernetes in a stable, performant, cost-efficient, and secure manner also presents specific challenges. In this webinar, Alex Pierce will talk about how to optimize Spark performance on Kubernetes. Topics include: – Making Spark-on-k8s reliable at scale – Core concepts and setup of Spark on Kubernetes – Configuration tips for performance and efficient resource sharing – Spark-app level dynamic allocation and cluster level autoscaling – Monitoring and security best practices

Related topics:

More from this channel

Upcoming talks (3)
On-demand talks (102)
Subscribers (6001)
Pepperdata is the Big Data performance company. Fortune 1000 enterprises depend on Pepperdata to manage and optimize the performance of Hadoop and Spark applications and infrastructure. Developers and IT Operations use Pepperdata soluions to diagnose and solve performance problems in production, increase infrastructure efficiencies, and maintain critical SLAs. Pepperdata automatically correlates performance issues between applications and operations, accelerates time to production, and increases infrastructure ROI. Pepperdata works with customer Big Data systems on-premises and in the cloud.