Explore the complexities of managing event sequences in Kafka across multiple topics. This article delves into three advanced strategies designed for developers and architects: leveraging datastores for temporal event correlation, utilising Kafka Streams for real-time processing, and aggregating events at the source. Discover how these approaches can help you overcome Kafka’s ordering constraints, ensuring seamless, error-free operations in your event-driven architectures.
Dive into the dynamic world of Amazon Kinesis, a premier AWS service for real-time data processing and analytics. Designed for developers and architects, this introduction covers the fundamentals of Kinesis, including its ability to handle high-volume data streams from thousands of sources with minimal latency. Learn about its applications in real-time analytics, IoT data processing, log collection, and more. Understand how Kinesis facilitates immediate data ingestion, processing, and analysis, enabling timely decision-making across diverse sectors like finance, social media, and IoT.
Understanding the diverse landscape of AWS Messaging Services is essential for architecting robust, scalable, and efficient cloud solutions. AWS offers a suite of messaging services, each designed with unique features and collaboration patterns to cater to specific architectural needs. From SQS’s reliable message queuing and SNS’s dynamic pub/sub messaging to Kinesis’s real-time data streaming and MSK’s high-throughput message handling, the choice of service can profoundly impact your system’s performance, reliability, and scalability. Whether it’s decoupling components with SQS, broadcasting notifications with SNS, processing vast data streams with Kinesis, or handling high-volume events with MSK, understanding these services’ capabilities and use cases is crucial for making informed and strategic architectural decisions.
In this article, I will share my thoughts on using centralised versus decentralised orchestration when building event-driven serverless systems. I have over 15 years of experience in designing and developing distributed event-driven systems. I have spent years migrating from monolithic systems to microservices and now to serverless-powered systems. Event-driven architecture can help build highly loosely coupled, fault-tolerant, scalable,… Read More »