Article Open Access

Predictive Analytics Using AI for Regression Risk Assessment in Storage Controller SoC Verification Cycles

Amit Kumar

Abstract


Meeting aggressive time-to-market and high-quality requirements for complex storage controller System-on-Chip (SoC) designs is an increasingly difficult task for the semiconductor industry. Verification consumes a significant portion of the design cycle in SoC design, with regression serving as the primary bottleneck that hinders time to market. Customary verification methodologies reactively locate high-risk design areas after the fact, followed by costly debug iterations and lengthy validation runs. However, machine learning-based predictive analytics can be used to analyze the trends in past verification runs, thus enabling the identification of the areas most prone to regression before they occur. The framework uses gradient-increasing decision trees trained on a large corpus of coverage metrics, structural design features, patterns of modification, and temporal failure histories learned across generations of controllers. Signal extraction across heterogeneous sources, including regression databases, coverage repositories, design revision history, and bug tracking systems, is a key part of this process. Benchmarking of enterprise-quality NVMe controllers shows that the proposed approach considerably reduces regression detection time and verification time while achieving the same coverage effectiveness. The deployed approach is compatible with Universal Verification Methodology workflows, offering visual dashboards and automated test prioritization methods that complement human intuition, rather than simply automating them. Our cross-architecture transfer learning results positively affect the generalization of the models across architectures and help speed up knowledge transfer to other projects in the organization. Our empirical results help challenge the status quo of coverage-driven planning and show that risk-based prioritization can effectively address the increasing complexity of modern semiconductor design

Keywords


Predictive Analytics, Regression Risk Assessment, Storage Controller Verification, Machine Learning, Universal Verification Methodology

References


Chen, W., Ray, S., Bhadra, J., Abadir, M. S., & Wang, L.-C. (2017). Challenges and trends in modern SoC design verification. IEEE Design & Test, 34(5), 7–22. https://doi.org/10.1109/MDAT.2017.2735383

Benso, A., Bosio, A., Di Carlo, S., & Prinetto, P. E. (2009). Are IEEE 1500 compliant cores really compliant to the standard? IEEE Design & Test of Computers, 26(3), 16–24. https://doi.org/10.1109/MDT.2009.46

Campbell, K., He, L., Yang, L., Gurumani, S., Rupnow, K., & Chen, D. (2016). Debugging and verifying SoC designs through effective cross-layer hardware-software co-simulation. Proceedings of the 53rd Annual Design Automation Conference, 1–6. https://doi.org/10.1145/2897937.2898002

Fallah, D., Abdul-Kareem, B. J., Murad, N. M., Mahdi, A. F., Janan, O., & Maidin, S. S. (2025). Predictive data analytics for fault diagnosis and energy optimization in industrial Internet of Things environments. International Journal of Engineering, Science and Information Technology, 5(2), 532–541. https://doi.org/10.52088/ijesty.v5i2.1392

Qiu, Y., Yin, W., & Wang, L. (2022). A high-performance and scalable NVMe controller featuring hardware acceleration. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 41(5), 1344–1357. https://doi.org/10.1109/TCAD.2021.3088784

Yoo, S., & Harman, M. (2012). Regression testing minimization, selection and prioritization: A survey. Software Testing, Verification and Reliability, 22(2), 67–120. https://doi.org/10.1002/stvr.430

Kazmi, R., Jawawi, D. N. A., Mohamad, R., & Ghani, I. (2017). Effective regression test case selection: A systematic literature review. ACM Computing Surveys, 50(2), Article 29. https://doi.org/10.1145/3057269

Spieker, H., Gotlieb, A., Marijan, D., & Mossige, M. (2017). Reinforcement learning for automatic test case prioritization and selection in continuous integration. Proceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis, 12–22. https://doi.org/10.1145/3092703.3092709

Li, Z., Harman, M., & Hierons, R. M. (2012). Search algorithms for regression test case prioritization. IEEE Transactions on Software Engineering, 38(4), 902–919. https://doi.org/10.1109/TSE.2011.12

Yaraghi, A. S., Bagherzadeh, M., Kahani, N., & Briand, L. C. (2023). Scalable and accurate test case prioritization in continuous integration contexts. IEEE Transactions on Software Engineering, 49(4), 2511–2531. https://doi.org/10.1109/TSE.2022.3184842

Minhas, M. K., Waris, H., Farooq, Y., Mohyuddin, N., & Baloch, S. (2023). Coverage-driven and constrained-randomized sub-system level verification methodology for RISC-V based SoCs. 2023 International Bhurban Conference on Applied Sciences and Technologies (IBCAST). https://doi.org/10.1109/IBCAST59916.2023.10712898

Woo, J. H., Cho, Y. K., & Park, S. K. (2016). Universal Verification Methodology based register test automation flow. Journal of Nanoscience and Nanotechnology, 16(5), 5316–5319. https://doi.org/10.1166/jnn.2016.12252

Witharana, H., Lyu, Y., Charles, S., & Mishra, P. (2023). A survey on assertion-based hardware verification. ACM Computing Surveys, 54(11s). https://doi.org/10.1145/3510578

Elmandouh, E. M., & Wassal, A. G. (2018). Guiding formal verification orchestration using machine learning methods. ACM Transactions on Design Automation of Electronic Systems, 23(5), Article 62. https://doi.org/10.1145/3224206

Ismail, K. A., & Ghany, M. A. A. E. (2021). Survey on machine learning algorithms enhancing the functional verification process. Electronics, 10(21), 2688. https://doi.org/10.3390/electronics10212688

Jing, Q. (2025). Hybrid CNN-LSTM model for predictive maintenance of wind turbine systems. International Journal of Engineering, Science and Information Technology, 5(4), 517–526. https://doi.org/10.52088/ijesty.v5i4.1679

Rapp, M., Amrouch, H., Lin, Y., Yu, B., Pan, D. Z., Wolf, M., & Henkel, J. (2021). MLCAD: A survey of research in machine learning for CAD keynote paper. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 40(12), 2482–2503. https://doi.org/10.1109/TCAD.2021.3124762

Parthasarathy, G., Rushdi, A., Choudhary, P., Nanda, S., Evans, M., Gunasekara, H., & Rajakumar, S. (2022). RTL regression test selection using machine learning. 2022 27th Asia and South Pacific Design Automation Conference (ASP-DAC), 281–287. https://doi.org/10.1109/ASP-DAC52403.2022.9712550

Jahan, H., Feng, Z., Mahmud, S. M. H., & Dong, P. (2019). Version specific test case prioritization approach based on artificial neural network. Journal of Intelligent & Fuzzy Systems, 36(6), 6181–6194. https://doi.org/10.3233/JIFS-181998

Ahmed, F. S., Majeed, A., Khan, T. A., & Bhatti, S. N. (2022). Value-based cost-cognizant test case prioritization for regression testing. PLOS ONE, 17(5), e0264972. https://doi.org/10.1371/journal.pone.0264972

Wu, N., Li, Y., Yang, H., Chen, H., Dai, S., Hao, C., & Xie, Y. (2024). Survey of machine learning for software-assisted hardware design verification: Past, present, and prospect. ACM Transactions on Design Automation of Electronic Systems, 29(3). https://doi.org/10.1145/3661308

Nalla, S., & Nagarajan, G. (2025). Continual learning-based regression testing for scalable VLSI verification across hierarchical design layers. Sustainable Computing: Informatics and Systems, 48, 101259. https://doi.org/10.1016/j.suscom.2025.101259

Huang, G., Hu, J., He, Y., Liu, J., Ma, M., Shen, Z., et al. (2021). Machine learning for electronic design automation: A survey. ACM Transactions on Design Automation of Electronic Systems, 26(5), Article 40. https://doi.org/10.1145/3451179

Ioannides, C., & Eder, K. I. (2012). Coverage-directed test generation automated by machine learning: A review. ACM Transactions on Design Automation of Electronic Systems, 17(1), Article 7. https://doi.org/10.1145/2071356.2071363

Fine, S., & Ziv, A. (2003). Coverage directed test generation for functional verification using Bayesian networks. Proceedings of the 40th Design Automation Conference, 286–291. https://doi.org/10.1145/775832.775907

Liu, L., Sheridan, D. C., Tuohy, W., & Vasudevan, S. (2012). A technique for test coverage closure using GoldMine. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 31(4), 601–614. https://doi.org/10.1109/TCAD.2011.2177461

Lessmann, S., Baesens, B., Mues, C., & Pietsch, S. (2008). Benchmarking classification models for software defect prediction: A proposed framework and novel findings. IEEE Transactions on Software Engineering, 34(4), 485–496. https://doi.org/10.1109/TSE.2008.35

Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5–32. https://doi.org/10.1023/A:1010933404324

Friedman, J. H. (2001). Greedy function approximation: A gradient boosting machine. The Annals of Statistics, 29(5), 1189–1232. https://doi.org/10.1214/aos/1013203451

Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., Chatila, R., & Herrera, F. (2020). Explainable artificial intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Information Fusion, 58, 82–115. https://doi.org/10.1016/j.inffus.2019.12.012

Lundberg, S. M., Erion, G., Chen, H., DeGrave, A., Prutkin, J. M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., & Lee, S.-I. (2020). From local explanations to global understanding with explainable AI for trees. Nature Machine Intelligence, 2(1), 56–67. https://doi.org/10.1038/s42256-019-0138-9

Rudin, C. (2019). Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence, 1(5), 206–215. https://doi.org/10.1038/s42256-019-0048-x

Tasiran, S., & Keutzer, K. (2001). Coverage metrics for functional validation of hardware designs. IEEE Design & Test of Computers, 18(4), 36–45. https://doi.org/10.1109/54.936247

Menzies, T., Greenwald, J., & Frank, A. (2007). Data mining static code attributes to learn defect predictors. IEEE Transactions on Software Engineering, 33(1), 2–13. https://doi.org/10.1109/TSE.2007.256941

Sagi, O., & Rokach, L. (2018). Ensemble learning: A survey. WIREs Data Mining and Knowledge Discovery, 8(4), e1249. https://doi.org/10.1002/widm.1249

Naveh, Y., Rimon, M., Jaeger, I., Katz, Y., Vinov, M., Marcus, E., & Shurek, G. (2007). Constraint-based random stimuli generation for hardware verification. AI Magazine, 28(3), 13–30. https://doi.org/10.1609/aimag.v28i3.2052

Wang, S., & Yao, X. (2013). Using class imbalance learning for software defect prediction. IEEE Transactions on Reliability, 62(2), 434–443. https://doi.org/10.1109/TR.2013.2259203

Nagappan, N., & Ball, T. (2005). Use of relative code churn measures to predict system defect density. Proceedings of the 27th International Conference on Software Engineering, 284–292. https://doi.org/10.1145/1062455.1062514

Bergmeir, C., & Benítez, J. M. (2012). On the use of cross-validation for time series predictor evaluation. Information Sciences, 191, 192–213. https://doi.org/10.1016/j.ins.2011.12.028

Kapoor, S., & Narayanan, A. (2023). Leakage and the reproducibility crisis in ML-based science. Patterns, 4(9), 100804. https://doi.org/10.1016/j.patter.2023.100804

Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002). SMOTE: Synthetic minority over-sampling technique. Journal of Artificial Intelligence Research, 16, 321–357. https://doi.org/10.1613/jair.953

He, H., & Garcia, E. A. (2009). Learning from imbalanced data. IEEE Transactions on Knowledge and Data Engineering, 21(9), 1263–1284. https://doi.org/10.1109/TKDE.2008.239




DOI: https://doi.org/10.52088/ijesty.v6i3.1899

Refbacks

  • There are currently no refbacks.


Copyright (c) 2026 Amit Kumar

International Journal of Engineering, Science, and Information Technology (IJESTY) eISSN 2775-2674