Leveraging Kafka for Event-Driven Architecture in Fintech Applications
Abstract
The volume of payment transactions has grown exponentially, creating a high demand for high-throughput payment processing systems. These systems must be capable of handling a large number of transactions with minimal delay while also being highly scalable and resilient to failures. To overcome this challenge, leveraging kafka for event-driven architecture in fintech applications (LK-EDA-FA-BSCNN) is proposed. At first, input data is gathered from kafka streams. Then, the input data are pre-processed using adaptive two-stage unscented kalman filter (ATSUKF is used to clean the data to ensure high-quality input for downstream analysis. Then, the pre-processed data are fed into binarized simplicial convolutional neural network (BSCNN) is used to predict the future transactions from historical trends. The proposed LK-EDA-FA-BSCNN method is implemented using python and the performance metrics like accuracy, precision, sensitivity, specificity, F1-score, and computational time. The LK-EDA-FA-BSCNN method achieves the best performance with 98.5% accuracy, 95.3% precision and 1.150 seconds runtime with existing methods, like a DRL-based adaptive consortium blockchain sharding framework for supply chain finance (DRL-ACSF-SCF), a blockchain-based secure storage and access control scheme for supply chain finance (BC-SS-ACS-SCF), and analysis of banking fraud detection methods through machine learning strategies in the era of digital transactions respectively.
Keywords
References
Garcia, R.D., Ferreira, J.C., Zanotti, L., Ramachandran, G., Estrella, J.C. and Ueyama, J., 2024. An automated decision-making system employing complex networks and blockchain for the decentralized stock market. Expert Systems with Applications, 257, p.125131.
Yao, W., Deek, F.P., Murimi, R. and Wang, G., 2023. Sok: A taxonomy for critical analysis of consensus mechanisms in consorti-um blockchain. IEEE Access, 11, pp.79572-79587.
Singh, J. and Chaudhary, N.K., 2024. Rest security framework for event streaming bus architecture. International Journal of Infor-mation Technology, 16(5), pp.3033-3047.
Ibtissame, E.Z.Z.A.H.O.U.I., Rachida, A.A. and Abdelaziz, M.A.R.Z.A.K., 2024. Aquaponics Revolution: Reinforcing perfor-mance by means of Apache Spark and Apache Kafka. Procedia Computer Science, 241, pp.624-629.
Kumar, S.S., Chandra, R., Harsh, A. and Agarwal, S., 2025. Fuzzy rule-based intelligent cardiovascular disease prediction using complex event processing. The Journal of Supercomputing, 81(2), p.402.
Zahra, F.T., Bostanci, Y.S., Tokgozlu, O., Turkoglu, M. and Soyturk, M., 2024. Big Data Streaming and Data Analytics Infra-structure for Efficient AI-Based Processing. In Recent Advances in Microelectronics Reliability: Contributions from the European ECSEL JU project iRel40 (pp. 213-249). Cham: Springer International Publishing.
Gkoulis, D., Bardaki, C., Nikolaidou, M., Kousiouris, G. and Tsadimas, A., 2024. A Hybrid Simulation Platform for quality-aware evaluation of complex events in an IoT environment. Simulation Modelling Practice and Theory, 133, p.102919..
Steindl, G., Schwarzinger, T., Schreiberhuber, K. and Ekaputra, F.J., 2024. Towards Semantic Event-handling for building Ex-plainable Cyber-physical Systems. IEEE Open Journal of the Industrial Electronics Society.
Aishwarya, C.K., Lahari, C.S. and Saheb, S.H., 2024. Data Analytics Tools and Applications for Business and Finance Systems. In Data-Driven Modelling and Predictive Analytics in Business and Finance (pp. 18-34). Auerbach Publications.
Rosa-Bilbao, J., Boubeta-Puig, J., Lagares-Galán, J. and Vella, M., 2025. Leveraging complex event processing for monitoring and automatically detecting anomalies in Ethereum-based blockchain networks. Computer Standards & Interfaces, 91, p.103882.
Al?dahasi, E.M., Alsheikh, R.K., Khan, F.A. and Jeon, G., 2025. Optimizing fraud detection in financial transactions with machine learning and imbalance mitigation. Expert Systems, 42(2), p.e13682.
Rama, M., Kiranteja, V., Sireeshai, M., Vamsi, M. and Sohel, S., 2025. Analyzing the effectiveness of machine learning algo-rithms in detecting fraud transactions. In Hybrid and Advanced Technologies (pp. 116-124). CRC Press.
Banirostam, H., Banirostam, T., Pedram, M.M. and Rahmani, A.M., 2025. Analysis and Evaluation of Various Fraud Detection Methods for Electronic Payment Cards Transactions in Big Data. Journal of Signal Processing Systems, pp.1-22.
Sau, A., Banerjee, A. and Vedhavathy, T.R., Improving fraud detection efficiency: Leveraging machine learning strategies. In Hy-brid and Advanced Technologies (pp. 33-40). CRC Press.
Odufisan, O.I., Abhulimen, O.V. and Ogunti, E.O., 2025. Harnessing Artificial Intelligence and Machine Learning for Fraud De-tection and Prevention in Nigeria. Journal of Economic Criminology, p.100127.
Li, D., Han, D., Crespi, N., Minerva, R. and Li, K.C., 2023. A blockchain-based secure storage and access control scheme for supply chain finance. The Journal of Supercomputing, 79(1), pp.109-138.
Hu, S., Lin, J., Du, X., Huang, W., Lu, Z., Duan, Q. and Wu, J., 2023. ACSarF: a DRL-based adaptive consortium blockchain sharding framework for supply chain finance. Digital Communications and Networks.
Hanae, A., Youssef, G. and Saida, E., 2023, December. Analysis of Banking Fraud Detection Methods through Machine Learning Strategies in the Era of Digital Transactions. In 2023 7th IEEE Congress on Information Science and Technology (CiSt) (pp. 105-110). IEEE.
Mikhaylov, A. and Bhatti, M.I.M., 2024. The link between DFA portfolio performance, AI financial management, GDP, govern-ment bonds growth and DFA trade volumes. Quality & Quantity, pp.1-18.
Oza, J., Patil, A., Maniyath, C., More, R., Kambli, G. and Maity, A., 2024, May. Harnessing Insights from Streams: Unlocking Real-Time Data Flow with Docker and Cassandra in the Apache Ecosystem. In 2024 IEEE Recent Advances in Intelligent Compu-tational Systems (RAICS) (pp. 1-6). IEEE.
Carnero, A., Martín, C., Jeon, G. and Díaz, M., 2024. Online learning and continuous model upgrading with data streams through the kafka-ml framework. Future Generation Computer Systems, 160, pp.251-263.
Cui, Y. and Yao, F., 2024. Integrating deep learning and reinforcement learning for enhanced financial risk forecasting in supply chain management. Journal of the Knowledge Economy, pp.1-20.
Joshi, P.K., Building High-Throughput Payment Transaction Systems with Kafka and Micro services.
Hou, D., Sun, Y., Dinavahi, V. and Wang, Y., 2024. Adaptive two-stage unscented Kalman filter for dynamic state estimation of synchronous generator under cyber attacks against measurements. Journal of Modern Power Systems and Clean Energy, 12(5), pp.1408-1418.
Yan, Y. and Kuruoglu, E.E., 2025. Binarizedsimplicial convolutional neural networks. Neural Networks, 183, p.106928.
D. Tzeli and A. Mavridis, “First-Principles Investigation of the Boron and Aluminum Carbides BC and AlC and Their Anions BC- and AlC-. 1,” The Journal of Physical Chemistry A, vol. 105, no. 7, pp. 1175–1184, Jan. 2001, doi: https://doi.org/10.1021/jp003258k.
Ashkan Samiee, Payal Borulkar, R. F. DeMara, P. Zhao, and Y. Bai, “Low-Energy Acceleration of Binarized Convolutional Neu-ral Networks Using a Spin Hall Effect Based Logic-in-Memory Architecture,” IEEE Transactions on Emerging Topics in Compu-ting, vol. 9, no. 2, pp. 928–940, May 2019, doi: https://doi.org/10.1109/tetc.2019.2915589.
JIN, “An Introduction to Apache Kafka System Architecture,” Medium, Mar. 27, 2022. https://aws.plainenglish.io/apache-kafka-system-architecture-cc74e7d47904
Q. Qu, R. Xu, Seyed Yahya Nikouei, and Y. Chen, “An Experimental Study on Microservices based Edge Computing Platforms,” arXiv (Cornell University), Jul. 2020, doi: https://doi.org/10.1109/infocomwkshps50562.2020.9163068.
DOI: https://doi.org/10.52088/ijesty.v5i3.1074
Refbacks
- There are currently no refbacks.
Copyright (c) 2025 Jaya Krishna Modadugu, Ravi Teja Prabhala Venkata, Karthik Prabhala Venkata




























