How to Build Streaming Pipelines for Cloud Databases

Presented by

Italo Nesi, Solutions Engineer, Confluent

About this talk

Data pipelines do much of the heavy lifting in organisations for integrating, transforming, and preparing the data for subsequent use in downstream systems for operational use cases. Despite being critical to the data value stream, data pipelines fundamentally haven’t evolved in the last few decades. These legacy pipelines are holding organisations back from getting value from their data as real-time streaming becomes essential. This webinar will walk through the story of a bank that uses an Oracle database to store sensitive customer information and RabbitMQ as the message broker for credit card transaction events. Their goal is to perform real-time analysis on credit card transactions to flag fraudulent transactions and push suspicious activity flags to MongoDB Atlas, their modern cloud-native database that powers their in-app mobile notifications. To illustrate this use case, you’ll see a live demo of: • Confluent’s fully managed connectors for Oracle CDC Source and RabbitMQ Source to stream the data in real-time ksqlDB to merge the two data sources, generating a unified view of customers and their credit card activity and flagging fraudulent transactions • The fully managed MongoDB Atlas sink connector to load the aggregated and transformed data into MongoDB Atlas • Along with the live demo and customer use case, you’ll learn about the challenges with batch-based data pipelines and the benefits of streaming data pipelines to power modern data flows.
Related topics:

More from this channel

Upcoming talks (0)
On-demand talks (328)
Subscribers (10608)
Confluent is building the foundational platform for data in motion. Our cloud-native offering is designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organisation. With Confluent, organisations can create a central nervous system to innovate and win in a digital-first world.