Gunnar Morling Practical change data streaming use cases with Apache Kafka and Debezium
Apache Kafka is a highly popular option for asynchronous event propagation between microservices. Things get challenging though when adding a services database to the picture: how can you avoid inconsistencies between Kafka and the database Enter change data capture (CDC) and Debezium. By capturing changes from the log files of the database, Debezium gives you both reliable and consistent interservice messaging via Kafka and instant readyourownwrite semantics for services themselves. In this session youll see how to leverage CDC for reliable microservices integration as well as many other use cases such as extracting microservices out of monoliths, invalidating your 2ndlevel cache after external data changes, automatically keeping your fulltext search index in sync, maintaining audit logs, and much more. Well also discuss practical matters such as ensuring data quality in data streaming pipelines and implementing data conversions using single message transformations
|
|