Article Open Access

Real-Time Streaming and Intelligent Decision Systems for Telecommunications Infrastructure

Suresh Tambe

Abstract


Modern telecommunications systems generate billions of events daily through billing, fraud detection, customer operations, network telemetry, and infrastructure management. Traditional batch-processing architectures rely on scheduled data-processing windows and are therefore inadequate for operational environments requiring continuous responsiveness, low latency, and real-time decision-making. This article examines scalable real-time streaming architectures, event-driven processing frameworks, intelligent runtime decision systems, and distributed operational models designed for large-scale telecommunications environments. It further investigates customer routing optimization, workload balancing, backpressure management, and fault-tolerant state synchronization to support national-scale telecommunications operations. A synthesis of distributed-systems literature and benchmarking studies is employed to evaluate streaming coordination models, stateful processing architectures, and migration synchronization strategies. Six analytical models are formalized to characterize throughput scaling, backpressure detection, end-to-end latency decomposition, routing assignment optimization, workload balance efficiency, and fault recovery time. The analysis indicates that parallel partition-based streaming frameworks can achieve near-linear throughput scaling when coordination overhead is effectively controlled. The proposed backpressure coefficient provides a quantitative indicator for identifying emerging capacity constraints before significant performance degradation occurs. Routing assignment and workload balancing models further enable continuous optimization under dynamic workload and service conditions. Fault-tolerant state synchronization mechanisms contribute to operational continuity by supporting consistent state recovery during component failures and migration processes. These analytical frameworks shift telecommunications streaming-system design from empirical performance tuning toward analytically grounded engineering practices. Overall, event-driven architectures, scalable streaming coordination, and intelligent runtime decision systems represent foundational capabilities for responsive customer operations, efficient resource utilization, resilient service delivery, and reliable telecommunications infrastructure at national scale

Keywords


Backpressure Management, Distributed Stream Processing, Event-Driven Architecture, Intelligent Decision Systems, Real-Time Telecommunications

References


K. M. Chandy and L. Lamport, "Distributed Snapshots: Determining Global States of Distributed Systems," ACM Transactions on Computer Systems, vol. 3, no. 1, pp. 63-75, 1985. Available: https://dl.acm.org/doi/abs/10.1145/214451.214456

Shafi, M., Molisch, A. F., Smith, P. J., Haustein, T., Zhu, P., De Silva, P., Tufvesson, F., Benjebbour, A., & Wunder, G. (2017). 5G: A tutorial overview of standards, trials, challenges, deployment, and practice. IEEE Journal on Selected Areas in Communications, 35(6), 1201–1221. https://doi.org/10.1109/JSAC.2017.2692307

Saad, W., Bennis, M., & Chen, M. (2020). A vision of 6G wireless systems: Applications, trends, technologies, and open research problems. IEEE Network, 34(3), 134–142. https://doi.org/10.1109/MNET.001.1900287

Wang, C.-X., You, X., Gao, X., Zhu, X., Li, Z., Zhang, C., Wang, H., Huang, Y., Chen, Y., Haas, H., Thompson, J., Larsson, E. G., Di Renzo, M., Tong, W., Zhu, P., Shen, X., Poor, H. V., & Hanzo, L. (2023). On the road to 6G: Visions, requirements, key technologies, and testbeds. IEEE Communications Surveys & Tutorials, 25(2), 905–938. https://doi.org/10.1109/COMST.2023.3249835

Shi, W., Cao, J., Zhang, Q., Li, Y., & Xu, L. (2016). Edge computing: Vision and challenges. IEEE Internet of Things Journal, 3(5), 637–646. https://doi.org/10.1109/JIOT.2016.2579198

Mao, Y., You, C., Zhang, J., Huang, K., & Letaief, K. B. (2017). A survey on mobile edge computing: The communication perspective. IEEE Communications Surveys & Tutorials, 19(4), 2322–2358. https://doi.org/10.1109/COMST.2017.2745201

Mishra, A., Rathour, A., Raju, D., & Patil, S. (2025). Low-latency edge computing for real-time applications in wireless sensor networks. International Journal of Engineering, Science, and Information Technology, 5(1), 595–599. https://doi.org/10.52088/ijesty.v5i1.1490

Al-Fuqaha, A., Guizani, M., Mohammadi, M., Aledhari, M., & Ayyash, M. (2015). Internet of Things: A survey on enabling technologies, protocols, and applications. IEEE Communications Surveys & Tutorials, 17(4), 2347–2376. https://doi.org/10.1109/COMST.2015.2444095

Miorandi, D., Sicari, S., De Pellegrini, F., & Chlamtac, I. (2012). Internet of things: Vision, applications and research challenges. Ad Hoc Networks, 10(7), 1497–1516. https://doi.org/10.1016/j.adhoc.2012.02.016

Ravilla, L., Upadhyay, S., Louis, M. T., & Swain, B. (2025). Energy-efficient protocols for massive IoT connectivity in 6G networks. International Journal of Engineering, Science, and Information Technology, 5(1). https://doi.org/10.52088/ijesty.v5i1.1449

Rettig, L., Khayati, M., Cudré-Mauroux, P., & Piorkowski, M. (2019). Online anomaly detection over big data streams. In Applied Data Science (pp. 289–312). Springer. https://doi.org/10.1007/978-3-030-11821-1_16

Zhao, S., Chandrashekar, M., Lee, Y., & Medhi, D. (2015). Real-time network anomaly detection system using machine learning. In 2015 11th International Conference on the Design of Reliable Communication Networks (DRCN) (pp. 267–270). IEEE. https://doi.org/10.1109/DRCN.2015.7149025

Isah, H., Abughofa, T., Mahfuz, S., Ajerla, D., Zulkernine, F., & Khan, S. (2019). A survey of distributed data stream processing frameworks. IEEE Access, 7, 154423–154442. https://doi.org/10.1109/ACCESS.2019.2946884

Surianarayanan, C., & Kunasekaran, S. (2024). A high-throughput architecture for anomaly detection in streaming data using machine learning algorithms. International Journal of Information Technology, 16. https://doi.org/10.1007/s41870-023-01585-0

Putina, A., Rossi, D., Bifet, A., Barth, S., Pletcher, D., Precup, C., & Nivaggioli, P. (2018). Telemetry-based stream-learning of BGP anomalies. In Proceedings of the 2018 Workshop on Big Data Analytics and Machine Learning for Data Communication Networks (Big-DAMA '18) (pp. 15–20). ACM. https://doi.org/10.1145/3229607.3229611

Mulinka, P., & Casas, P. (2018). Stream-based machine learning for network security and anomaly detection. In Proceedings of the 2018 Workshop on Big Data Analytics and Machine Learning for Data Communication Networks (Big-DAMA '18) (pp. 1–7). ACM. https://doi.org/10.1145/3229607.3229612

Gulenko, A., Wallschläger, M., Schmidt, F., Kao, O., & Liu, F. (2016). A system architecture for real-time anomaly detection in large-scale NFV systems. Procedia Computer Science, 94, 491–498. https://doi.org/10.1016/j.procs.2016.08.076

[17] Gama, J., Žliobait?, I., Bifet, A., Pechenizkiy, M., & Bouchachia, A. (2014). A survey on concept drift adaptation. ACM Computing Surveys, 46(4), Article 44. https://doi.org/10.1145/2523813

Erhan, L., Ndubuaku, M., Di Mauro, M., Song, W., Chen, M., Fortino, G., Bagdasar, O., & Liotta, A. (2021). Smart anomaly detection in sensor systems: A multi-perspective review. Information Fusion, 67, 64–79. https://doi.org/10.1016/j.inffus.2020.10.001

Edozie, E., Shuaibu, A. N., Sadiq, B. O., & John, U. K. (2025). Artificial intelligence advances in anomaly detection for telecom networks. Artificial Intelligence Review, 58. https://doi.org/10.1007/s10462-025-11108-x

Raeiszadeh, M., Ebrahimzadeh, A., Glitho, R., Eker, J., & Mini, R. A. F. (2024). Real-time adaptive anomaly detection in industrial IoT environments. IEEE Transactions on Network and Service Management, 21(6). https://doi.org/10.1109/TNSM.2024.3447532

Fragkoulis, M., Carbone, P., Kalavri, V., & Katsifodimos, A. (2024). A survey on the evolution of stream processing systems. The VLDB Journal, 33(2), 507–541. https://doi.org/10.1007/s00778-023-00819-8

Kreps, J., Narkhede, N., & Rao, J. (2011). Kafka: A distributed messaging system for log processing. Proceedings of the NetDB Workshop, 11, 1–7.

Raptis, T. P., & Passarella, A. (2023). A survey on networked data streaming with Apache Kafka. IEEE Access, 11, 85333–85350. https://doi.org/10.1109/ACCESS.2023.3303810

Chandy, K. M., & Lamport, L. (1985). Distributed snapshots: Determining global states of distributed systems. ACM Transactions on Computer Systems, 3(1), 63–75. https://doi.org/10.1145/214451.214456

Carbone, P., Ewen, S., Fora, G., Haridi, S., Richter, S., & Tzoumas, K. (2017). State management in Apache Flink: Consistent stateful distributed stream processing. Proceedings of the VLDB Endowment, 10(12), 1718–1729. https://doi.org/10.14778/3137765.3137777

Jayasekara, S., Karunasekera, S., & Harwood, A. (2022). Optimizing checkpoint-based fault-tolerance in distributed stream processing systems: Theory to practice. Software: Practice and Experience, 52(1), 296–315. https://doi.org/10.1002/spe.3021

Vogel, S., Henning, S., Perez-Wohlfeil, E., Ertl, O., & Rabiser, R. (2024). A comprehensive benchmarking analysis of fault recovery in stream processing frameworks. Proceedings of the 18th ACM International Conference on Distributed and Event-based Systems, 171–182. https://doi.org/10.1145/3629104.3666040

Wang, X., Zhang, C., Fang, J., Zhang, R., Qian, W., & Zhou, A. (2022). A comprehensive study on fault tolerance in stream processing systems. Frontiers of Computer Science, 16(2), 162603. https://doi.org/10.1007/s11704-020-0248-x

Rahmatulloh, A., Nugraha, F., Gunawan, R., & Darmawan, I. (2022). Event-driven architecture to improve performance and scalability in microservices-based systems. In 2022 International Conference Advancement in Data Science, E-learning and Information Systems (ICADEIS) (pp. 01–06). IEEE. https://doi.org/10.1109/ICADEIS56544.2022.10037390

Cabane, H., & Farias, K. (2024). On the impact of event-driven architecture on performance: An exploratory study. Future Generation Computer Systems, 153, 52–69. https://doi.org/10.1016/j.future.2023.10.012

Henning, S., & Hasselbring, W. (2024). Benchmarking scalability of stream processing frameworks deployed as microservices in the cloud. Journal of Systems and Software, 208, 111879. https://doi.org/10.1016/j.jss.2023.111879

Singh, R., Mehbodniya, A., Webber, J. L., Dadheech, P., Pavithra, G., Alzaidi, M. S., & Akwafo, R. (2022). Analysis of network slicing for management of 5G networks using machine learning techniques. Wireless Communications and Mobile Computing, 2022, 9169568. https://doi.org/10.1155/2022/9169568

Ejaz, M. A., Wu, G., & Iqbal, T. (2024). Dynamic and efficient resource allocation for 5G end-to-end network slicing: A multi-agent deep reinforcement learning approach. International Journal of Communication Systems, 37(17), e5916. https://doi.org/10.1002/dac.5916

Lin, J.-Y., Chou, P.-H., & Hwang, R.-H. (2023). Dynamic resource allocation for network slicing with multi-tenants in 5G two-tier networks. Sensors, 23(10), 4698. https://doi.org/10.3390/s23104698

Roldan-Gomez, J., Martinez del Rincon, J., Boubeta-Puig, J., & Martinez, J. L. (2024). An automatic unsupervised complex event processing rules generation architecture for real-time IoT attacks detection. Wireless Networks, 30(6), 5127–5144. https://doi.org/10.1007/s11276-022-03219-y

Miano, S., Lettieri, G., Antichi, G., & Procissi, G. (2024). Accelerating network analytics with an on-NIC streaming engine. Computer Networks, 241, 110231. https://doi.org/10.1016/j.comnet.2024.110231

Li, T., Ying, S., Zhao, Y., & Shang, J. (2023). Batch jobs load balancing scheduling in cloud computing using distributional reinforcement learning. IEEE Transactions on Parallel and Distributed Systems, 35(1), 169–185. https://doi.org/10.1109/TPDS.2023.3334519

Kruekaew, B., & Kimpan, W. (2022). Multi-objective task scheduling optimization for load balancing in cloud computing environment using hybrid artificial bee colony algorithm with reinforcement learning. IEEE Access, 10, 17803–17818. https://doi.org/10.1109/ACCESS.2022.3149020

Subedi, P., Alsadoon, A., Prasad, P. W. C., Rehman, S., Giweli, N., Imran, M., & Arif, S. (2021). Network slicing: A next generation 5G perspective. EURASIP Journal on Wireless Communications and Networking, 2021, 102. https://doi.org/10.1186/s13638-021-01983-7

Zhang, S., Soto, J., & Markl, V. (2024). A survey on transactional stream processing. The VLDB Journal, 33(2), 451–479. https://doi.org/10.1007/s00778-023-00814-z




DOI: https://doi.org/10.52088/ijesty.v6i3.1910

Refbacks

  • There are currently no refbacks.


Copyright (c) 2026 Suresh Tambe

International Journal of Engineering, Science, and Information Technology (IJESTY) eISSN 2775-2674