Name: GCP for Apache Kafka® Users: Stream Ingestion and Processing
Start: 2019-07-30T09:00:00Z
End: 2019-07-30T09:00:59.000Z
Location: BrightTALK
Rating: 0

Confluent is building the foundational platform for data in motion. Our cloud-native offering is designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organisation. With Confluent, organisations can create a central nervous system to innovate and win in a digital-first world.

80% of consumer analytics happens on data that’s older than 1 day. Learn how to extract actionable real time insights for your shoppers and products through a streaming analytic application. 

With Confluent and Imply, you can build a streaming analytic application that provides a 360 view of your customer’s buying behavior in 1 hour.

1. Aggregate all your data to build timely context around each customer profile
2. Visualize buying patterns instantly
3. Identify top selling products and refill inventory
4. Identify potential revenue streams in real time
5. Connect teams for shared insights with a consistent view of both streaming and historical data

Join us for an exclusive opportunity to hear from the thought leaders of Kafka and Apache Druid on how Confluent Cloud and Imply Polaris enable customers to leverage the power of interactive streaming platforms to accelerate real time data analytics. Bring your laptop for this interactive workshop

Who should attend:

1. Application developers and engineers interested in real time analytics
2. Engineers, developers, architects, or anyone interested in understanding real time system design and use cases. 
3. Any skill or maturity level with event-drive systems, Apache Kafka, or messaging in general. 

Please note: 
Confluent Cloud account and Imply Polaris account are required for the lab session. 

Sign-up for Confluent Cloud. New signups receive $400 to spend on Confluent Cloud during their first 60 days.

Sign-up for Imply Polaris here. New signups receive free usage for the first 30 days valued at $1872.

Building a Streaming Analytics Application in 1 Hour

Data pipelines do much of the heavy lifting in organisations for integrating, transforming, and preparing the data for subsequent use in downstream systems for operational use cases. Despite being critical to the data value stream, data pipelines fundamentally haven’t evolved in the last few decades. These legacy pipelines are holding organisations back from getting value from their data as real-time streaming becomes essential.
 
This webinar will walk through the story of a bank that uses an Oracle database to store sensitive customer information and RabbitMQ as the message broker for credit card transaction events. Their goal is to perform real-time analysis on credit card transactions to flag fraudulent transactions and push suspicious activity flags to MongoDB Atlas, their modern cloud-native database that powers their in-app mobile notifications.
 
To illustrate this use case, you’ll see a live demo of:

• Confluent’s fully managed connectors for Oracle CDC Source and RabbitMQ Source to stream the data in real-time ksqlDB to merge the two data sources, generating a unified view of customers and their credit card activity and flagging fraudulent transactions

• The fully managed MongoDB Atlas sink connector to load the aggregated and transformed data into MongoDB Atlas

• Along with the live demo and customer use case, you’ll learn about the challenges with batch-based data pipelines and the benefits of streaming data pipelines to power modern data flows.

How to Build Streaming Pipelines for Cloud Databases

What is Apache Kafka® and how does it work?

Apache Kafka® was built with the vision to become the central nervous system that makes real-time data available to all the applications that need to use it, with numerous use cases like stock trading and fraud detection, to transportation, data integration, and real-time analytics.

In this 2 part series you will get an overview of what Kafka is, what it's used for, and the core concepts that enable it to power a highly scalable, available, and resilient real-time event streaming platform. The series begins with an introduction to the shift toward real-time data streaming and continues all the way through to best practices for developing applications with Apache Kafka® and how to integrate Kafka into your environment.

Whether you’re just getting started or have already built stream processing applications, you will find actionable insights in this series that will enable you to further derive business value from your data systems.

This training is comprised of the following topics::

1. Benefits of Stream Processing and Apache Kafka® Use Cases
2. Apache Kafka® Architecture & Fundamentals Explained
3. How Apache Kafka® Works
4. Integrating Apache Kafka® Into Your Environment
5. Confluent Cloud

Register now to learn Apache Kafka® from Confluent, the company founded by Kafka’s original developers.

Part 1: Fundamentals for Apache Kafka

Data Mesh has been gaining traction over the past year or two - and with good reason. With organizations constantly exploring the potential of data, it’s becoming increasingly clear that it’s Data Mesh that may be the key to enabling businesses to truly realize their data-driven initiatives.

In this Confluent webinar, experts are coming together to discuss how Data Mesh has emerged as a paradigm shift in data architecture and to share how teams can be empowered to harness the power of their data at scale. Join Lyndon Hedderly - Director of Customer Solutions at Confluent and Piethein Strengholt - Chief Data Officer (The Netherlands) at Microsoft as they explore:

- The core principles and fundamentals of Data Mesh 
- Best practices for implementing a Data Mesh into your organization, including how businesses can foster a culture of data ownership, accountability, and autonomy 
- What Data Mesh challenges may arise and how to navigate them 
- The stakeholders involved in implementing and managing a Data Mesh
- The business value and new revenue streams a Data Mesh can help realize

Unlocking the Power of Data Mesh: Decentralizing and Democratizing Data

Confluent is hosting a technical thought leadership session to discuss how leading organisations move to real-time architecture to support business growth and enhance customer experience. This is a forum to discuss use cases with your peers to understand how other digital-native companies are utilising data in motion to drive competitive advantage.

The session will be virtual and led by Kai Waehner, a Technical Evangelist and a thought leader in this space. Register today to network with your peers and hear about the use cases that are transforming business.

Data in Motion Use Cases for the CTO

Data is becoming more crucial by the day to the financial services industry. Financial institutions are using their expanded data pools and cloud infrastructure to make better loans, improve their services and offerings to customers, comply with regulations, and detect fraud. 

Many companies, however, are not using data to its full potential. The old ‘data at rest model’ is becoming outdated as new ‘data in motion’ systems provide companies the ability to see how data changes as it flows through their organizations, enabling them to provide new applications and services to their customers and build out more efficient operating systems for their business. 

In this session, we explore how data in motion platforms empower financial services companies to make better decisions when it comes to the way they conduct operations and offer services. 

We discuss: 
-How financial institutions have incorporated data into their operations
-The ways a ‘data in motion’ system differs from the old ‘data at rest’ system 
-How a ‘data in motion’ system helps companies improve their operations and expand their services
-What the future of data looks like for financial services companies

Our speakers:
Duncan Ash is VP of Global Industries at Confluent. He has spent the last 25 years working at the intersection of business and technology to solve complex data and analytics problems, with a specific focus on the financial services industry. Duncan has spearheaded a diverse range of solutions for low-latency trading, market risk, fraud detection, and wealth management, most recently at Splunk, and previously at Qlik, SAS, and Sybase.

Jim Zucker is Lead Architect at Ness Financial Services vertical. With over 25 years of experience, Jim is an expert in digital transformation of risk, trading, credit, derivatives and compliance systems. Before joining Ness, Jim held senior leadership positions at Salomon Brothers, Citi and Calypso and was CTO of EZOPS. He is a US Army Veteran.

Data in Motion: the New Paradigm in Financial Services

Microservices have emerged as a widely discussed and adopted way to build modern and scalable applications. They are easier to build, manage and maintain than monoliths due to smaller code bases; they isolate complexity, allowing for smaller, more agile teams to create services, and they are flexible—allowing the use of various platforms, programming languages, and tools since these choices affect only an individual service and a small team at a time.



While a microservices architecture provides a good pattern for application modernization efforts, refactoring applications and modernizing existing applications is no small feat. Enterprises must do this thoughtfully or risk adopting a short-sighted strategy for their innovation and business needs.



During this webinar, you’ll see how Confluent empowers your developers to innovate faster while incrementally refactoring and migrating your existing applications. Register today.

Application Modernization Through Event-Driven Microservices

This webinar explores the state of data streaming for the Financial Services Industry in 2023. Join this webinar to learn more about:

- What disruptive trends in financial services are driving the pace of innovation
- How data streaming provides the ability to integrate and correlate data in real-time at any scale.
- Which enterprise architectures are trending in the FinServ industry globally

The State of Data Streaming for Financial Services in 2023

Data mesh is a new approach to designing data architectures by embracing organisational and data-centric constructs, such as data management and governance. The idea is that data should be easily accessible and interconnected across the entire business.

In this talk, will cover:
 
- The basics of building a streaming data mesh with Kafka & how Confluent enables this. 
- The four principles of the data mesh: domain-driven decentralisation, data as a product, self-service data platform, and federated governance.
- The differences between working with event streams versus centralised approaches.
- How to onboard data from existing systems into a mesh, modelling the communication within the mesh
- How to deal with changes to your domain’s “public” data, give examples of global standards for governance
- The importance of taking a product-centric view of data sources and the data sets they share.

Apache Kafka®, Confluent, and the Data Mesh

Organisations are struggling to deliver on the promise of the DevOps culture and have instead defaulted to 'you build; you run it!' For many DevOps professionals, this approach is fruitless and ready for a reset. One solution is to take a PaaS approach which provides best-in-class tools to developers allowing them to build and deploy apps as needed.



Join the Confluent team on January 24th to learn how Confluent Cloud enables your developer community. By attending, you will:



1. Learn more about the basic principles of the DevOps culture,
2. Get 'hands-on' with Confluent Cloud by building a pipeline that meets the needs of any development team.
3. Hear a discussion of the CI/CD cycle
4. Learn about SRE and Platform Engineering
5. Discover how to transition from Infrastructure to Environment as a Code

Confluent Cloud, DevOpS and beyond: Managing your environments like a pro

What is Apache Kafka® and how does it work?

Apache Kafka® was built with the vision to become the central nervous system that makes real-time data available to all the applications that need to use it, with numerous use cases like stock trading and fraud detection, to transportation, data integration, and real-time analytics.

This 2 part series you will get an overview of what Kafka is, what it's used for, and the core concepts that enable it to power a highly scalable, available and resilient real-time event streaming platform. The series begins with an introduction to the shift toward real-time data streaming, and continues all the way through to best practices for developing applications with Apache Kafka® and how to integrate Kafka into your environment.

Whether you’re just getting started or have already built stream processing applications, you will find actionable insights in this series that will enable you to further derive business value from your data systems.

This training is comprised of the following topics::

1.Benefits of Stream Processing and Apache Kafka® Use Cases
2.Apache Kafka® Architecture & Fundamentals Explained
3.How Apache Kafka® Works
4. Integrating Apache Kafka® Into Your Environment
5. Confluent Cloud

Register now to learn Apache Kafka® from Confluent, the company founded by Kafka’s original developers.

Part 2: Fundamentals for Apache Kafka

Noam Berman delivers the motivation behind Wix's move from on-premise Kafka to Confluent Cloud.  In addition, he discusses the challenges faced and lessons learned by the Wix team after migrating over 2000 services between Kafka deployments across five regions - with (almost) no downtime to Confluent Cloud.

Wix's Migration to Confluent

Avec ce webinar retail & e-commerce pouver découvrir: 

un cas réel d'utilisation de Data In Motion et l'importance stratégique de Data in Motion
Comment optimiser la chaîne d'approvisionnement en améliorant l'efficacité et en réduisant les coûts
Le rôle de Kafka dans un système d'inventaire en temps réel, le client 360, la détection des fraudes et le Machine Learning.
Architecture microservices avec Kafka
Les possibilités offertes par les déploiements Edge/Hybrid/Multi-Cloud

Retail in Motion avec Confluent

Vous pouvez découvrir la transformation digital de Manufactoring: 

Avec des exemples concrets d'implémentation
une meilleure compréhension des composants logiciel de l'écosystème Confluent pour la mise en oeuvre
comment positionner Confluent dans vos approches actuelles d'Industrie 5.0
comment appréhender les bénéfices métier et techniques d'une adoption de Confluent

Kafka & Confluent: la pièce maîtresse pour vos projets d'Industrie 5.0

In private and public clouds, stream analytics commonly means stateless processing systems organized around Apache Kafka® or a similar distributed log service. GCP took a somewhat different tack, with Cloud Pub/Sub, Dataflow, and BigQuery, distributing the responsibility for processing among ingestion, processing and database technologies. 

We compare the two approaches to data integration and show how Dataflow allows you to join and transform and deliver data streams among on-prem and cloud Apache Kafka clusters, Cloud Pub/Sub topics and a variety of databases. The session will have a mix of architectural discussions and practical code reviews of Dataflow-based pipelines.

GCP for Apache Kafka® Users: Stream Ingestion and Processing

Apache Kafka

Google

Cloud

confluent

confluent cloud

Cloud computing has exploded over the past few years, delivering a previously unimagined level of workplace mobility and flexibility. The cloud computing community on BrightTALK is made up of thousands of engaged professionals learning from the latest cloud computing research and resources. Join the community to expand your cloud computing knowledge and have your questions answered in live sessions with industry experts and vendor representatives.

Cloud Computing

Increasing expectations for good governance, effective risk management and complex demands for corporate compliance are presenting a growing challenge for organizations of all sizes. Join industry thought leaders as they provide you with practical advice on how to implement successful risk and compliance management strategies across your organization. Browse risk management resources in the form of interactive webinars and videos and ask questions of expert GRC professionals.

IT Governance, Risk and Compliance

The data center management community focuses on the holistic management and optimization of the data center. From technologies such as virtualization and cloud computing to data center design, colocation, energy efficiency and monitoring, the BrightTALK data center management community provides the most up-to-date and engaging content from industry experts to better your infrastructure and operations. Engage with a community of your peers and industry experts by asking questions, rating presentations and participating in polls during webinars, all while you gain insight that will help you transform your infrastructure into a next generation data center.

Data Center Management

The application development community features top thought leadership focusing on optimal practices in software development, SDLC methodology, mobile app development and application development platforms and tools. Join top software engineers and coders as they cover emerging trends in everything from enterprise app development to developing for mobile platforms such as Android and iOS.

Application Development

Practicing business intelligence allows your company to transform raw data into sets of insights for targeted business growth. The business intelligence and analytics community on BrightTALK is made up of thousands of data scientists, database administrators, business analysts and other data professionals. Find relevant webinars and videos on business analytics, business intelligence, data analysis and more presented by recognized thought leaders. Join the conversation by participating in live webinars and round table discussions.

Business Intelligence and Analytics

Join thousands of engaged IT professionals in the application management community on BrightTALK. Interact with your peers in relevant webinars and videos on the latest trends and best practices for application lifecycle management, application performance management and application development.

Application Management

The IT project management community on BrightTALK includes thousands of IT project and portfolio management professionals. Find relevant webinars and videos on agile methodologies, scrum strategy, project management processes and more. Attend live webinars or view on demand content presented by recognized thought leaders in the IT project management industry.

IT Project Management

Welcome to the big data and data management community on BrightTALK. Join thousands of data quality engineers, data scientists, database administrators and other professionals to find more information about the hottest topics affecting your data. Subscribe now to learn about efficiently storing, optimizing a complex infrastructure, developing governing policies, ensuring data quality and analyzing data to make better informed decisions. Join the conversation by watching live and on-demand webinars and take the opportunity to interact with top experts and thought leaders in the field.

Big Data and Data Management

As an IT professional, many of the problems you face are multifaceted, complex and don’t lend themselves to simple solutions. The information technology community features useful and free information technology resources. Join to browse thousands of videos and webinars on ITIL best practices, IT security strategy and more presented by leading CTOs, CIOs and other technology experts.

GCP for Apache Kafka® Users: Stream Ingestion and Processing

Presented by

About this talk

More from this channel