Name: A Guide to Data Engineering using Databricks
Start: 2021-12-06T00:06:00Z
End: 2021-12-06T00:06:43.000Z
Location: BrightTALK
Rating: 0

No matter at what stage of your data journey you’re in, this channel will help you get a better understanding of the fundamental concepts of the Databricks Lakehouse platform and the problems we’re helping to solve for data teams.

Industry track: Financial Servies.
Presented by Naman Joshi, covering risk and compliance.

Risk & Compliance - Presented by Naman Joshi

During this keynote, you will hear directly from Databricks what innovating with Data + AI means.

Industry Leadership Forum Keynote: Innovating With Data + AI

Financial Services Solution Showcase - Data + AI Demo:
Creating deep customer connections through Hyper-personalized

Hyper-personalization Financial Services - Demo

Solution Showcase: Data + AI Demos
Personalization and Recommendations

M&E Personalization and Recommendations demo

Customer Behavioural Segmentation. Presented by Dan Morris

Segmentation Demo with Dan Morris

This is the complete recording of the media and entertainment track of our recent Asia-Pacific Industry Leadership Forum

Lakehouse for Media and Entertainment - Full Video

This is the complete recording of 'Lakehouse for retail and e-commerce' as part of the Databricks Industry leadership forum.

Lakehouse for retail and e-commerce

Solution Showcase: Data + AI Demo:
Customer Lifetime Value

Customer Lifetime Value - Demo orientation

This is the complete recording of the financial services session, as part of the Innovating With Data + AI Asia-Pacific Industry Leadership Forum

Industry Leadership Forum - FINANCIAL SERVICES SESSION

Lakehouse for Retail - Demand forecasting

eCloudvalley - Demand Forecasting

Customer Panel: The Future of Warehousing
Moderated by Joel Minnick - VP of Product Marketing, Databricks. You will hear from Dream11, Liven and Grab

Customer Panel: The Future of Warehousing

This is the complete recording of the general session, as part of the Innovating With Data + AI
Asia-Pacific Industry Leadership Forum

Industry Leadership Forum - GENERAL SESSION

Dream11 Keynote - Personalizing Fantasy Sports with Data + AI

Dream11 is the world’s largest fantasy sports platform, with over 120 million users playing fantasy cricket, football, kabaddi, basketball, hockey, volleyball, handball, rugby, futsal, American football and baseball. The platform manages about 100 million requests per minute, with more than 16 terabytes of information and billions of data points per day. With phenomenal volumes of user activity and engagement on its platform, Dream11 has been on a mission to raise the bar for driving adoption as well as personalizing its fantasy sports experience for users at scale. But without scalable machine learning capabilities, they were unable to tap into the promise of their data to create next-level fantasy sporting experiences. By leveraging Databricks, Dream11 aims to democratize data across teams, foster seamless collaboration to improve productivity and innovation, and deliver on customer-centric solutions that help them stay ahead of the curve in critical areas ranging from fraud detection to data security and personalization.

Dream11 Keynote - Personalizing Fantasy Sports with Data + AI

Databricks is the Data and AI company. As the first and only Lakehouse Platform in the cloud, Databricks unifies all your data, analytics, and AI on a simple, open, and collaborative platform.

Databricks Lakehouse Video

Organisations are looking to streamline their data management by melding their data warehouse and data lake into a single data lakehouse. A lakehouse provides a highly performant and reliable single source of data at a lower cost.
Learn how digital native businesses, Cascade and Liven, have used the Databricks Lakehouse Platform to:
- Address multiple data science use cases — including recommendation models, logistics and demand forecasting — as well as fraud detection
- Enable their business analysts to access dashboards to view business performance and address issues immediately
- Have a single automated system to manage their data pipelines to support these use cases and more

Building a Data Lakehouse at Cascade and Liven (Feb 2022)

At Databricks, our mission is to make big data simple. We solve the conundrum of how to store, manage and get insight from the sheer variety of data types that exist today using a simple, open and collaborative cloud data platform that we refer to as the Databricks Lakehouse. 

No matter at what stage of your data journey you’re in, this webinar series will help you get a better understanding of the fundamental concepts of the Databricks Lakehouse platform and the problems we’re helping to solve for data teams in being able to work collaboratively and be more productive using one common platform for all data uses-cases.

Introduction to Databricks Lakehouse (Non-technical overview)

Lakehouse is the modern data management paradigm that enables companies to get the most out of their data by leveraging the best of data lakes and data warehouses. This session walks through the evolution of data management and how the lakehouse model enables teams to work in a unified system that provides performant queries, support for streaming, data science, machine learning and BI capabilities -- all built on a single source of truth.

We will also explore Delta Lake - an open source storage layer that brings reliability to data lakes - enabling ACID transactions, scalable metadata handling, and unifies streaming and batch data processing.

Introduction to Databricks Lakehouse (Technical Overview)

As organisations continue to become more data-driven, a collaborative environment for easier access and visibility into the data, models trained against the data, reproducibility, and insights uncovered within the data is critical.


Explore how Databricks lets data scientists and ML engineers quickly move from experimentation to production-scale machine learning model deployments — all on the same platform. In this workshop, we’ll work with a single data set throughout the lifecycle as well as scikit-learn, MLflow and Apache Spark™ on Databricks.

A Guide to Data Science using Databricks

The rise of the lakehouse architectural pattern is built upon tech innovations enabling the data lake to support ACID transactions and other features of traditional data warehouse workloads. Join this session for a walkthrough of the Databricks Lakehouse architecture for Data Engineering.

Learning outcomes:
- How Databricks Lakehouse combines the reliability, performance and governance of data warehouses with the openness and flexibility of data lakes 
- Technology foundations of Delta Lake (Apache Spark™) and Databricks SQL
- How to build highly scalable data pipelines and tackling merged streaming and batch workloads
- Powering data science with Delta Lake and MLflow

A Guide to Data Engineering using Databricks

Lakehouse

Apache Spark

Delta lake

Data Lake

Data warehouse

Architecture

Data Architecture

Data Best Practices

Data Backup

IT Security

Cloud computing has exploded over the past few years, delivering a previously unimagined level of workplace mobility and flexibility. The cloud computing community on BrightTALK is made up of thousands of engaged professionals learning from the latest cloud computing research and resources. Join the community to expand your cloud computing knowledge and have your questions answered in live sessions with industry experts and vendor representatives.

Cloud Computing

Practicing business intelligence allows your company to transform raw data into sets of insights for targeted business growth. The business intelligence and analytics community on BrightTALK is made up of thousands of data scientists, database administrators, business analysts and other data professionals. Find relevant webinars and videos on business analytics, business intelligence, data analysis and more presented by recognized thought leaders. Join the conversation by participating in live webinars and round table discussions.

Business Intelligence and Analytics

Welcome to the big data and data management community on BrightTALK. Join thousands of data quality engineers, data scientists, database administrators and other professionals to find more information about the hottest topics affecting your data. Subscribe now to learn about efficiently storing, optimizing a complex infrastructure, developing governing policies, ensuring data quality and analyzing data to make better informed decisions. Join the conversation by watching live and on-demand webinars and take the opportunity to interact with top experts and thought leaders in the field.

Big Data and Data Management

As an IT professional, many of the problems you face are multifaceted, complex and don’t lend themselves to simple solutions. The information technology community features useful and free information technology resources. Join to browse thousands of videos and webinars on ITIL best practices, IT security strategy and more presented by leading CTOs, CIOs and other technology experts.

A Guide to Data Engineering using Databricks

Presented by

About this talk

More from this channel