Hi [[ session.user.profile.firstName ]]

Why Enhanced Visibility Matters for your Databricks Environment

Databricks has become a popular computing framework for big data as organizations increase their investments of moving data applications to the cloud. With that journey comes the promise of better collaboration, processing, and scaling of applications to the Cloud. However, customers are finding unexpected costs eating into their cloud budget as monitoring/observability tools like Ganglia, Grafana, the Databricks console only telling part of the story for charge/showback reports.
Join Mick Nolen, Senior Solutions Engineer at Unravel Data, as he takes you through Unravel’s approach to getting better and finer grain visibility with Databricks on AWS or Azure. He will take you through:
An overview of out of the box solutions for monitoring Databricks
Why enhanced visibility matters with Databricks environments
How Unravel helps you gain finer grain visibility into Databricks pipelines
Recorded Oct 6 2020 43 mins
Your place is confirmed,
we'll send you email reminders
Presented by
Mick Nolen, Senior Solution Engineer, Unravel Data
Presentation preview: Why Enhanced Visibility Matters for your Databricks Environment

Network with like-minded attendees

  • [[ session.user.profile.displayName ]]
    Add a photo
    • [[ session.user.profile.displayName ]]
    • [[ session.user.profile.jobTitle ]]
    • [[ session.user.profile.companyName ]]
    • [[ userProfileTemplateHelper.getLocation(session.user.profile) ]]
  • [[ card.displayName ]]
    • [[ card.displayName ]]
    • [[ card.jobTitle ]]
    • [[ card.companyName ]]
    • [[ userProfileTemplateHelper.getLocation(card) ]]
  • Channel
  • Channel profile
  • Operationalize Your Insights - The Self-Service Data Roadmap, Session 4 of 4 May 13 2021 5:00 pm UTC 60 mins
    Sandeep Uttamchandani, CDO & VP Engineering, Unravel Data
    In this webinar, Unravel CDO and VP Engineering Sandeep Uttamchandani describes the fourth and final step for any large, data-driven project: the Operationalize phase. You've found your data (Discover phase), readied it for processing (Prep phase), and built out your processing logic and machine learning model(s) (Build phase). Now you need to Operationalize all your work to data as a live project, in production.

    Sandeep Uttamchandani is a leader in the fields of data, AI, and machine learning. This webinar is the third talk from his new O'Reilly animal book, The Self-Service Data Roadmap. The book shows how to start, implement, and complete large data science projects, up to and including the creation of a complete, self-service data science platform for your organization.
  • CDO Sessions: Transforming DataOps in Banking May 6 2021 4:00 pm UTC 48 mins
    Sandeep Uttamchandani, CDO & VP Engineering, Unravel Data & Matteo Pelati, Executive Director, DBS
    Join Unravel’s CDO & VP of Engineering, Sandeep Uttamchandani and Matteo Pelati, Executive Director, Head of Technology - Data Platform at DBS Bank as they discuss:

    How their tactical/strategic focus areas are evolving in these challenging times
    Cloud big data migration strategy, do's and don'ts
    Practical advice they can share for other leaders in the big data community
    How Unravel has helped DBS optimize their big data
  • Reasons Why Big Data Cloud Migrations Fail - and Ways to Succeed Apr 29 2021 5:00 pm UTC 60 mins
    Chris Santiago, Global Solution Engineering Director, Unravel Data
    Organizations are moving big data from on-premises to the cloud, using best-of-breed technologies like Databricks, Amazon EMR, Azure HDI, and Cloudera, to name a few. However, many cloud migrations fail. Why? And, how can you overcome the barriers and succeed? Join Chris Santiago, Director of Solution Engineering, as he describes the biggest pain points and how you can avoid them, and make your move to the cloud a success. He will cover:

    The elements you must include in a successful cloud migration plan
    How to find the right strategy for your cloud migration
    Successful models for big data deployments in the cloud
    How Unravel customers are making solid plans, meeting their goals, and saving time and money
  • DataOps Unleashed - Building Checkpoints in Your DataOps Recorded: Apr 20 2021 33 mins
    Sandeep Uttamchandani, CDO & VP of Engineering at Unravel Data
    Behind every successful insight (BI analytics or ML model) is a reliable data pipeline! These pipelines are planned, implemented, deployed, and monitored in an ongoing fashion referred to as the DataOps infinity loop (similar to CI/CD for traditional software). This talk covers battle scars in managing DataOps at scale, and how building checkpoints in the DataOps loop can reduce missed SLAs, cost outages, escalation from data users, and most importantly avoid data pipeline surprises!
  • DataOps Unleashed - DataOps for the New Data Stack Recorded: Apr 20 2021 29 mins
    Shivnath Babu, Co-Founder and CTO at Unravel Data
    DataOps Unleashed is the first-ever event for the global DataOps community. We came together on Wednesday, March 17th, 2021 for DataOps Unleashed – a gathering of DataOps, CloudOps, AIOps, MLOps, and data-oriented DevOps professionals, including all data team members and their management, up to the CDO level. We shared the latest trends and best practices for running, managing, and monitoring data pipelines and data-intensive analytics workloads.

    This talk demystifies the new data stack that thousands of companies are deploying to convert data into insights continuously and with high agility. This stack continues to evolve with the emergence of new data roles like analytics engineers and ML engineers as well as new data technologies like lake houses and data validation.
    A new wave of operational challenges has emerged with this stack that, unless addressed from day one, will derail its success. Session presented by Shivnath Babu, Co-Founder and CTO, at Unravel Data discusses these DataOps challenges and the best practices to address them. The talk is accompanied by a brief demonstration.
  • DataOps Unleashed - How 84.51 Slashed Costs & Improved DataOps Efficiency Recorded: Apr 19 2021 30 mins
    Jeff Lambert, VP of Data Solutions at Kroger/84.51˚ and Suresh Devarakonda, Lead Database Engineer at Kroger/84.51˚
    DataOps Unleashed is the first-ever event for the global DataOps community. We came together on Wednesday, March 17th, 2021 for DataOps Unleashed – a gathering of DataOps, CloudOps, AIOps, MLOps, and data-oriented DevOps professionals, including all data team members and their management, up to the CDO level. We shared the latest trends and best practices for running, managing, and monitoring data pipelines and data-intensive analytics workloads. Sessions included talks by DataOps professionals at leading organizations, detailing how they’re establishing data predictability, increasing reliability, and reducing costs.

    Hear from Jeff Lambert, Vice President of Data Solutions at Kroger/84.51˚ and Suresh Devarakonda, Lead Database Engineer at Kroger/84.51˚ as they give a 30,000 ft view into their management of Yarn and Impala. They share how they solved challenges associated with small files and used a centralized DataOps approach to troubleshoot issues with their big data pipelines. 84.51° also take from their executive dashboards and share key learnings in helping your business improve efficiency and reduce operational costs.
  • DataOps Unleashed - A Journey to the Cloud for Adobe’s Corporate Data Platform Recorded: Apr 17 2021 25 mins
    Kevin Davis, Application Engineering, Adobe
    DataOps Unleashed is the first-ever event for the global DataOps community. We came together on Wednesday, March 17th, 2021 for DataOps Unleashed – a gathering of DataOps, CloudOps, AIOps, MLOps, and data-oriented DevOps professionals, including all data team members and their management, up to the CDO level. We shared the latest trends and best practices for running, managing, and monitoring data pipelines and data-intensive analytics workloads. Sessions included talks by DataOps professionals at leading organizations, detailing how they’re establishing data predictability, increasing reliability, and reducing costs.

    Adobe has just embarked on a multi-year journey to transition their on-premise Hadoop data platform to the cloud. With thousands of users, petabytes of data, and millions of monthly job executions, transitioning to the cloud will be a tremendously challenging task. Join Kevin Davis as he shares the catalysts that started Adobe on this journey, the processes being employed to ensure key customer challenges are addressed in the new environment, and other tools and strategies that are helping along the way.

    If your organization is contemplating a move to the cloud, this session will provide key insights into the early stages of Adobe’s transition that will help you plan your initiative.
  • DataOps Unleashed - The Evolution of a Data Platform Recorded: Apr 15 2021 32 mins
    James Felder, Senior Data Engineer, Cox Automotive
    DataOps Unleashed is the first-ever event for the global DataOps community. We came together on Wednesday, March 17th, 2021 for DataOps Unleashed – a gathering of DataOps, CloudOps, AIOps, MLOps, and data-oriented DevOps professionals, including all data team members and their management, up to the CDO level. We shared the latest trends and best practices for running, managing, and monitoring data pipelines and data-intensive analytics workloads.

    James Fielder, Senior Data Engineer at Cox Automotive, shows how a small data team manages DataOps for his organization’s global footprint, highlighting their use of Databricks on Microsoft Azure. Designing a data platform is no easy task, particularly when there are new technologies, techniques, and approaches appearing every week. At Cox Auto UK we have been on a journey from manually deployed Hadoop clusters to a full platform as a service setup using Azure Databricks. This journey hasn’t always been smooth however and we’ve learned some things along the way! In this talk, we examine how we have made design choices while evolving our platform, our decision to open source some of our work, and what our past, present, and future look like.
  • Build Your Insights & ML Models - The Self-Service Data Roadmap, Session 3 of 4 Recorded: Apr 15 2021 58 mins
    Sandeep Uttamchandani, CDO & VP Engineering, Unravel Data
    In this webinar, Unravel CDO and VP Engineering Sandeep Uttamchandani describes the third step for any large, data-driven project: the Build phase. You've found your data, in the Discover phase, and readied it for processing, in the Prep phase. Now you need to Build the logic that will actually process the data and the machine learning models that the data will be run through.

    Sandeep Uttamchandani is a leader in the fields of data, AI, and machine learning. This webinar is the third talk from his new O'Reilly animal book, The Self-Service Data Roadmap. The book shows how to start, implement, and complete large data science projects, up to and including the creation of a complete, self-service data science platform for your organization.
  • Mastering Databricks Environments with Unravel Recorded: Apr 1 2021 38 mins
    Chris Santiago, Global Solution Engineering Director, Unravel Data
    Databricks is a great solution for customers looking to unlock the powerful use cases that Spark enables, with the high performance of Databricks and the convenience of a managed service. Databricks is available in AWS, Microsoft Azure, and GCP clouds.
    If you are already a Databricks customer, you want to get the most out of your investment - and if you're considering Databricks, you'll be wondering how hard it is to move to the platform, and how to optimize your investment once you get there.
    Unravel has a powerful platform that supports Spark on-premises, cloud migration, and Databricks operations in the cloud. Please join Chris Santiago, Global Director of Solutions Engineering at Unravel Data, to learn how to maximize the opportunities that Databricks can bring you.
  • Prepare Your Data - The Self-Service Data Roadmap, Session 2 of 4 Recorded: Mar 23 2021 60 mins
    Sandeep Uttamchandani, CDO & VP Engineering, Unravel Data
    In this webinar, Unravel CDO and VP Engineering Sandeep Uttamchandani describes the second step for any large, data-driven project: the Prep phase. Having found the data you need in the Discover phase, it's time to get your data ready. You must structure, clean, enrich, and validate static data, and ensure that "live," updated or streamed data events are continually ready for processing.

    Sandeep Uttamchandani is a leader in the fields of data, AI, and machine learning. This webinar is the second talk from his new O'Reilly animal book, The Self-Service Data Roadmap. The book shows how to start, implement, and complete large data science projects, up to and including the creation of a complete, self-service data science platform for your organization.
  • Getting the Best Performance & Reliability Out of Kafka & Spark Applications Recorded: Mar 11 2021 55 mins
    Chris Santiago, Global Solution Engineering Director, Unravel Data
    Kafka & Spark data pipelines are ubiquitous in any modern data stack. Developing Spark and Kafka applications have become simpler over the years but operating them in production environments still remains challenging to say the least.

    Join Chris Santiago of Unravel Data to learn how to troubleshoot the root cause of why these real-time applications lag or fail. He will share how Unravel provides a single pane of glass to easily see & fix problems such as; poor data partitioning, load imbalance; resource exhaustion or suboptimal configurations. Chris will also share how you can automatically tune and optimize these for cost and performance.
  • Going Beyond Observability for Spark Applications & Databricks Environments Recorded: Mar 4 2021 60 mins
    Chris Santiago, Global Solution Engineering Director, Unravel
    Join Chris Santiago, Solutions Engineer Director at Unravel Data, as he takes you through Unravel’s approach to getting better and finer grain visibility with Spark applications and how to tune and optimize them for resource efficiency.

    He will take you through:
    An overview of out of the box tools like Ganglia and their overall lack of visibility on Databricks jobs
    How Unravel helps you gain finer grain visibility, observability, monitoring into Spark data pipelines
    How Unravel can recommend better configurations and tuning of Spark applications.
  • Discover Your Datasets - The Self-Service Data Roadmap, Session 1 of 4 Recorded: Feb 18 2021 61 mins
    Sandeep Uttamchandani, CDO & VP Engineering, Unravel Data
    In this session, Unravel CDO and VP Engineering Sandeep Uttamchandani describes the start of any large, data-driven project: the Discover phase. You must identify the insights you want to generate from the project, you must discover; that is, you must identify the current data assets you have, and the new data assets you will need, to generate the insights you want to produce. Sandeep expertly guides you through this process, and shows you how to invest the right amount of time and effort to get the job done.

    Sandeep Uttamchandani is a leader in the fields of data, AI, and machine learning. This webinar is the first talk from his new O'Reilly animal book, The Self-Service Data Roadmap. The book shows how to start, implement, and complete large data science projects, up to and including the creation of a complete, self-service data science platform for your organization.
  • Moving Big Data and Streaming Data Workloads to Google Cloud Platform Recorded: Feb 11 2021 61 mins
    Chris Santiago, Global Solution Engineering Director, & Floyd Smith, Product Marketing Director Unravel Data
    Cloud migration may be the biggest challenge, and the biggest opportunity, facing IT departments today - especially if you use big data and streaming data technologies, such as Cloudera, Hadoop, Spark, and Kafka. In this 55-minute webinar, Unravel Data product marketer Floyd Smith and Solutions Engineering Director Chris Santiago describe how to move workloads to Google Dataproc, BigQuery, and other destinations on GCP, fast and at the lowest possible cost.
  • High-Performance, Cost-Effective Move to Azure Recorded: Jan 28 2021 61 mins
    Mick Nolen, Senior Solutions Engineer, & Floyd Smith, Product Marketing Director Unravel Data
    Cloud migration may be the biggest challenge, and the biggest opportunity, facing IT departments today - especially if you use big data and streaming data technologies, such as Cloudera, Hadoop, Spark, and Kafka. In this 55-minute webinar, Unravel Data product marketer Floyd Smith and Solutions Engineering Director Chris Santiago describe how to move workloads to Azure HDInsights, Databricks, and other destinations on Azure, fast and at the lowest possible cost
  • Why You Need DataOps in Your Organization Recorded: Dec 15 2020 61 mins
    Kunal Agarwal, CEO Unravel Data
    DataOps is the hot new trend in IT, following on from the rapid rise of DevOps over the last decade. The growth of AI, machine learning, and move to cloud all contribute to the growing importance of DataOps. Kunal Agarwal, Unravel Data CEO will take you through the rise of DataOps and show you how to implement a data culture in your organization.
  • Moving Big Data and Streaming Data Workloads to AWS Recorded: Dec 3 2020 56 mins
    Chris Santiago, Global Solution Engineering Director, & Floyd Smith, Product Marketing Director Unravel Data
    Cloud migration may be the biggest challenge, and the biggest opportunity, facing IT departments today - especially if you use big data and streaming data technologies, such as Cloudera, Hadoop, Spark, and Kafka. In this 55-minute webinar, Unravel Data product marketer Floyd Smith and Solutions Engineering Director Chris Santiago describe how to move workloads to AWS EMR, Databricks, and other destinations on AWS, fast and at the lowest possible cost.
  • Cost Optimization on Microsoft Azure Recorded: Nov 18 2020 54 mins
    Chris Santiago, Solution Engineering Director, Unravel
    Do you use big data and streaming services - such as Azure HDInsight, Databricks, and Kafka/EventHubs? Do you have on-premises big data that you want to move to Azure? Keeping costs down in Microsoft Azure is difficult, but vital. Join Chris Santiago of Unravel Data and explore how to to reduce, manage, and allocate streaming data and big data costs in Azure.
  • Cost-Effective, High-Performance Move to Cloud Recorded: Nov 5 2020 55 mins
    Chris Santiago, Global Solution Engineering Director, & Floyd Smith, Product Marketing Director Unravel Data
    The move to cloud may be the biggest challenge, and opportunity, facing IT departments today. In this 45-minute webinar, Unravel Data product marketer Floyd Smith and Solutions Engineering Director Chris Santiago describe how to move workloads to the cloud quickly, cost-effectively, and with high performance for the newly cloud-based workloads. Tune in to find out the best way to de-risk your cloud migration projects with data driven insights.
AI-powered performance management for your modern data applications.
At Unravel, we see an urgent need to help every business understand and optimize the performance of their applications, while managing data operations with greater insight, intelligence, and automation.

For these businesses, Unravel is the AI-powered data operations company. We offer novel solutions that leverage AI, machine learning, and advanced analytics to help you fully operationalize the way you drive predictable performance in your modern data applications and pipelines.

Embed in website or blog

Successfully added emails: 0
Remove all
  • Title: Why Enhanced Visibility Matters for your Databricks Environment
  • Live at: Oct 6 2020 5:00 pm
  • Presented by: Mick Nolen, Senior Solution Engineer, Unravel Data
  • From:
Your email has been sent.
or close