Downloads: 1 | Views: 35 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1
Research Paper | Information Technology | United States of America | Volume 11 Issue 3, March 2022 | Popularity: 4.9 / 10
Building High - Throughput Payment Transaction Systems with Kafka and Microservices
Pavan Kumar Joshi
Abstract: The incidence of payment transactions has grown exponentially, placing high throughput payment transaction systems in high demand. Payment processing systems need to be used for a large number of transactions while experiencing a low amount of delay, being highly scalable and tolerant to failures. In this context, Apache Kafka, which is a distributed event streaming platform coupled with a microservices architecture, has been seen as the best approach to the development of efficient, reliable, and scalable payment transaction systems. This is because Kafka is a distributed system combining the characteristics of microservices to important decentralized functionality while at the same time handling large transaction volumes, fault isolation, faster data recovery, and ease of development. For this paper, I propose the implementation of Kafka and microservices to develop a fast - processing payment transaction system. We expound on the storage architecture of Kafka, particularly issues of partitioning, replication, and message retention for real - time payment processing. Thinking of various functionalities, such as transaction validating, fraud, and settling, the microservices architecture can be analyzed to determine whether it can separate all these and more as individually deployable services or not. We also explain how the system achieves the concept of eventual consistency across distributed services; this is through Kafka as a message broker for microservices. In addition, this paper demonstrates and compares the throughput, fault tolerance, and scalability of the monolithic payment system and the microservices of the payment system connected with Kafka. Real - life examples of Kafka in financial organizations, as well as new benchmarks and case studies that demonstrate how Kafka and microservices can be used in actual payment systems, are also presented. Lastly, we look at some of the issues with adopting Kafka to existing payment platform architectures and how to solve them. We also suggest how it is possible to solve issues, including distributed transactions, data consistency, strict security and compliance requirements, before we draw our conclusion.
Keywords: Apache Kafka, Microservices architecture, Scalability, Fault tolerance, Event - driven architecture
Edition: Volume 11 Issue 3, March 2022
Pages: 1658 - 1665
DOI: https://www.doi.org/10.21275/SR22032110641
Please Disable the Pop-Up Blocker of Web Browser
Verification Code will appear in 2 Seconds ... Wait