Fix Spark Failures and Bottlenecks Faster and Easier

Presented by

Vinod Nair

About this talk

Fix Spark Failures and Bottlenecks Faster and Easier is a webinar presentation intended for software engineers, developers, and technical leads who develop Spark applications. Pepperdata has gathered trillions of performance data points on production clusters running Spark, covering a variety of industries, applications, and workload types. This presentation discusses the results of analyzing many Spark jobs on many multi-tenant production clusters. Pepperdata Field Engineer, Kirk Lewis will discuss common issues seen, the symptoms of those issues, and how developers can address them. This discussion includes key performance insights — best and worst practices, gotchas, and tuning recommendations — based on analyzing the behavior and performance of millions of Spark applications. In addition, Kirk will describe how we are turning these learnings into heuristics used in the open source Dr. Elephant project. This webinar is followed by a live Q & A. A replay of this webinar will be available within 24 hours at

Related topics:

More from this channel

Upcoming talks (0)
On-demand talks (117)
Subscribers (6403)
Pepperdata is the Big Data performance company. Fortune 1000 enterprises depend on Pepperdata to manage and optimize the performance of Hadoop and Spark applications and infrastructure. Developers and IT Operations use Pepperdata solutions to diagnose and solve performance problems in production, increase infrastructure efficiencies, and maintain critical SLAs. Pepperdata automatically correlates performance issues between applications and operations, accelerates time to production, and increases infrastructure ROI. Pepperdata works with customer Big Data systems on-premises and in the cloud.