Tickets
← Back to Schedule

talk

Conjuring Events out of Thin Air: Leveraging CDC for Real-Time Insights

Ben Bowers, Rami Ruhayel

Talk Description

Change Data Capture (CDC) offers a powerful solution for organisations struggling with rigid data architectures. By transforming database changes into real-time event streams, CDC enables companies to generate insights and synchronise data across systems without completely rebuilding their applications.

This talk will dive into how AWS services like Database Migration Service (DMS), Kinesis, and S3 can create seamless event streams from various databases. Attendees will learn practical approaches for capturing changes in different database environments, including DynamoDB Streams and Debezium.

We'll explore how to:
- Convert database changes into event streams
- Process and store events using AWS Kinesis and S3
- Use Amazon Athena for ad-hoc analysis
- Address challenges like schema changes and data consistency

Attendees will discover how to build a responsive analytics ecosystem that provides near real-time insights, empowering businesses to make faster, more informed decisions—even without a fully event-driven architecture.

Knowledge Level

Level 200: Experienced. Attendees should have an awareness of the topic but may not have practical experience.

The speakers
Ben Bowers
Ben Bowers
Speaker Linkedin Page
Software Engineer at JourneyOne who wanders Perth helping businesses get their cloud game right. Ben is your go-to engineer for making sure things actually deliver value (and are properly documented, or else!). A true software craftsman who applies development principles to real life – ask him about how he used the Liskov Substitution Principle to ensure backup pubs could seamlessly replace closed venues during his legendary pub crawl planning.
Rami Ruhayel
Rami Ruhayel
Speaker Linkedin Page
Program Lead (Graduate Developer Program) and Software Engineer (Jibility). Currently shaping minds at JourneyOne and crafting solutions at Jibility, Rami's approach is underpinned by a belief in the transformative power of education and innovation. He has a distinct affinity for the NaN data type, and is fascinated by the blobfish. He lives by the guiding principle that "Monads are monoids in the category of endofunctors". His favourite colleague is Ben Bower (no s).