Exploring the role of machine learning models in risk assessment models for developed organizations’ management decision policies
Vol 8, Issue 13, 2024
VIEWS - 45 (Abstract) 13 (PDF)
Abstract
The goal of this work was to create and assess machine-learning models for estimating the risk of budget overruns in developed projects. Finding the best model for risk forecasting required evaluating the performance of several models. Using a dataset of 177 projects took into account variables like environmental risks employee skill level safety incidents and project complexity. In our experiments, we analyzed the application of different machine learning models to analyze the risk for the management decision policies of developed organizations. The performance of the chosen model Neural Network (MLP) was improved after applying the tuning process which increased the Test R2 from −0.37686 before tuning to 0.195637 after tuning. The Support Vector Machine (SVM), Ridge Regression, Lasso Regression, and Random Forest (Tuned) models did not improve, as seen when Test R2 is compared to the experiments. No changes in Test R2’s were observed on GBM and XGBoost, which retained same Test R2 across different tuning attempts. Stacking Regressor was used only during the hyperparameter tuning phase and brought a Test R2 of 0. 022219.Decision Tree was again the worst model among all throughout the experiments, with no signs of improvement in its Test R2; it was −1.4669 for Decision Tree in all experiments arranged on the basis of Gender. These results indicate that although, models such as the Neural Network (MLP) sees improvements due to hyperparameter tuning, there are minimal improvements for most models. This works does highlight some of the weaknesses in specific types of models, as well as identifies areas where additional work can be expected to deliver incremental benefits to the structured applied process of risk assessment in organizational policies.
Keywords
Full Text:
PDFReferences
Abbasov, R. (2023). Revolutionizing risk management in banking: Implementation of AI/ML-based gradient boosting machines (GBM) and random forest models for credit risk management. International Journal of Research in Finance and Management, 6(1), 441–444. https://doi.org/10.33545/26175754.2023.v6.i1d.324
Abo El Nasr, M. M., Abdelmegaly, A. A., & Abdo, D. A. (2024). Performance evaluation of different regression models: Application in a breast cancer patient data. Scientific Reports, 14(1), 12986. https://doi.org/10.1038/s41598-024-62627-6
Al-Mhdawi, M. K. S., O’connor, A., Qazi, A., Rahimian, F., & Dacre, N. (2024). Review of studies on risk factors in critical infrastructure projects from 2011 to 2023. Smart and Sustainable Built Environment, ahead-of-print(ahead-of-print). https://doi.org/10.1108/SASBE-09-2023-0285
Al-Saidi, M., Ellermann, A.-K., Fittkow, M. F., Perillieux, T. R., Saadaoui, I., & Ben-Hamadou, R. (2024). The perils of building big: Desalination sustainability and brine regulation in the Arab Gulf countries. Water Resources and Industry, 32, 100259. https://doi.org/10.1016/j.wri.2024.100259
Al-Shamsi, I. R., Shannaq, B., Adebiaye, R., & Owusu, T. (2024). Exploring biometric attendance technology in the Arab academic environment: Insights into faculty loyalty and educational performance in policy initiatives. Journal of Infrastructure, Policy and Development, 8(9), 6991. https://doi.org/10.24294/jipd.v8i9.6991
Alshamsi, I., Sadriwala, K. F., Ibrahim Alazzawi, F. J., & Shannaq, B. (2024). Exploring the impact of generative AI technologies on education: Academic expert perspectives, trends, and implications for sustainable development goals. Journal of Infrastructure, Policy and Development, 8(11), 8532. https://doi.org/10.24294/jipd.v8i11.8532
Antons, O., & Arlinghaus, J. C. (2024). Designing distributed decision-making authorities for smart factories – understanding the role of manufacturing network architecture. International Journal of Production Research. https://www.tandfonline.com/doi/abs/10.1080/00207543.2023.2217285
Arruda, M. R. T., Deividas, M., & Vadimas, K. (2024). State of the art on structural reinforced concrete design guidelines with non-linear analyses. Mechanics of Advanced Materials and Structures. https://www.tandfonline.com/doi/abs/10.1080/15376494.2023.2192214
Awwad, B. (Ed.). (2024). The AI Revolution: Driving Business Innovation and Research: Volume 2 (Vol. 525). Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-54383-8
Bakhamis, A. N., Bilal, H., Heggy, E., Al-Kuwari, M. S., & Al-Ansari, T. (2024). On the drivers, forecasts, and uncertainties of relative sea level rise in the Eastern Arabian Peninsula: A review. Regional Studies in Marine Science, 73, 103503. https://doi.org/10.1016/j.rsma.2024.103503
Chaker, R. (2024). Arab Gulf States’ naval procurement strategies: A three-level approach. Marine Policy, 166, 106237. https://doi.org/10.1016/j.marpol.2024.106237
Dada, M. A., Oliha, J. S., Majemite, M. T., Obaigbena, A., & Biu, P. W. (2024). A REVIEW OF PREDICTIVE ANALYTICS IN THE EXPLORATION AND MANAGEMENT OF U.S. GEOLOGICAL RESOURCES. Engineering Science & Technology Journal, 5(2), Article 2. https://doi.org/10.51594/estj.v5i2.763
Dunias, Z. S., Van Calster, B., Timmerman, D., Boulesteix, A., & Van Smeden, M. (2024). A comparison of hyperparameter tuning procedures for clinical prediction models: A simulation study. Statistics in Medicine, 43(6), 1119–1134. https://doi.org/10.1002/sim.9932
Farhan, Y. H., Shakir, M., Tareq, M. A., & Shannaq, B. (2024). Incorporating Deep Median Networks for Arabic Document Retrieval Using Word Embeddings-Based Query Expansion. Journal of Information Science Theory and Practice, 12(3), 36–48. https://doi.org/10.1633/JISTAP.2024.12.3.3
Görçün, Ö. F., Mishra, A. R., Aytekin, A., Simic, V., & Korucuk, S. (2024). Evaluation of Industry 4.0 strategies for digital transformation in the automotive manufacturing industry using an integrated fuzzy decision-making model. Journal of Manufacturing Systems, 74, 922–948. https://doi.org/10.1016/j.jmsy.2024.05.005
Guo, L., Song, R., Wu, J., Xu, Z., & Zhao, F. (2024). Integrating a machine learning-driven fraud detection system based on a risk management framework. Applied and Computational Engineering, 87, 80–86. https://doi.org/10.54254/2755-2721/87/20241541
Gupta, R., Yadav, A. K., Jha, S., & Pathak, P. K. (2024). A robust regressor model for estimating solar radiation using an ensemble stacking approach based on machine learning. International Journal of Green Energy, 21(8), 1853–1873. https://doi.org/10.1080/15435075.2023.2276152
Gurgun, A. P., Koc, K., & Kunkcu, H. (2024). Exploring the adoption of technology against delays in construction projects. Engineering, Construction and Architectural Management, 31(3), 1222–1253. https://doi.org/10.1108/ECAM-06-2022-0566
Hristov, I., Cimini, R., & Cristofaro, M. (2024). Assessing stakeholders’ perception influence on companies’ profitability: Evidence from Italian companies. Production Planning & Control. https://www.tandfonline.com/doi/abs/10.1080/09537287.2022.2078247
Jain, S., Jauhar, S. K., & Piyush. (2024). A machine-learning-based framework for contractor selection and order allocation in public construction projects considering sustainability, risk, and safety. Annals of Operations Research, 338(1), 225–267. https://doi.org/10.1007/s10479-024-05898-6
Manoharan, G., Durai, S., Rajesh, G. A., & Ashtikar, S. P. (2023). A Study on the Application of Expert Systems as a Support System for Business Decisions: A Literature Review. In Artificial Intelligence and Knowledge Processing. CRC Press.
Morshed, A. (2024). Assessing the Economic Impact of IFRS Adoption on Financial Transparency and Growth in the Arab Gulf Countries. Economies, 12(8), Article 8. https://doi.org/10.3390/economies12080209
Opeyemi Abayomi Odejide & Tolulope Esther Edunjobi. (2024). AI IN PROJECT MANAGEMENT: EXPLORING THEORETICAL MODELS FOR DECISION-MAKING AND RISK MANAGEMENT. Engineering Science & Technology Journal, 5(3), 1072–1085. https://doi.org/10.51594/estj.v5i3.959
Rashid Al-Shamsi, I., & Shannaq, B. (2024). Leveraging clustering techniques to drive sustainable economic innovation in the India–Gulf interchange. Cogent Social Sciences, 10(1), 2341483. https://doi.org/10.1080/23311886.2024.2341483
Roba, M., & Keltoum Moulay, O. (2024). Risk Management in Using Artificial Neural Networks. SocioEconomic Challenges, 8(2), 302–313. https://doi.org/10.61093/sec.8(2).302-313.2024
Sabet, N. S., & Khaksar, S. (2024). The performance of local government, social capital and participation of villagers in sustainable rural development. The Social Science Journal. https://www.tandfonline.com/doi/abs/10.1080/03623319.2020.1782649
Sawik, T., & Sawik, B. (2024). Risk-averse decision-making to maintain supply chain viability under propagated disruptions. International Journal of Production Research. https://www.tandfonline.com/doi/abs/10.1080/00207543.2023.2236726
Schini, M., Johansson, H., Harvey, N. C., Lorentzon, M., Kanis, J. A., & McCloskey, E. V. (2024). An overview of the use of the fracture risk assessment tool (FRAX) in osteoporosis. Journal of Endocrinological Investigation, 47(3), 501–511. https://doi.org/10.1007/s40618-023-02219-9
Shannaq, B. (2024a). Digital Formative Assessment as a Transformative Educational Technology. In K. Arai (Ed.), Advances in Information and Communication (Vol. 921, pp. 471–481). Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-54053-0_32
Shannaq, B. (2024b). Enhancing Human-Computer Interaction: An Interactive and Automotive Web Application - Digital Associative Tool for Improving Formulating Search Queries. In K. Arai (Ed.), Advances in Information and Communication (Vol. 921, pp. 511–523). Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-54053-0_35
Shannaq, B. (2024c). Unveiling the Nexus: Exploring TAM Components Influencing Professors’ Satisfaction With Smartphone Integration in Lectures: A Case Study From Oman. TEM Journal, 2365–2375. https://doi.org/10.18421/TEM133-63
Shannaq, B., Adebiaye, R., Owusu, T., & Al-Zeidi, A. (2024). An intelligent online human-computer interaction tool for adapting educational content to diverse learning capabilities across Arab cultures: Challenges and strategies. Journal of Infrastructure, Policy and Development, 8(9), 7172. https://doi.org/10.24294/jipd.v8i9.7172
Shannaq, B., Al Shamsi, I., & Abdul Majeed, S. (2019). Management Information System for Predicting Quantity Martial’s. TEM Journal, 8, 1143–1149. https://doi.org/10.18421/TEM84-06
Shannaq, B., & Shakir, M. (2024). Enhancing Security with Multi-Factor User Behavior Identification Via Longest Common Subsequence Analysis. Informatica 48 (2024) 73–82, 73, 48(16), 73–82. https://doi.org/10.31449/inf.v48i19.6529
Sharma, M., Kaur, I., Saini, G., Thakur, V., & Mishra, A. (2024). Predictive Modeling for Stroke Risk Assessment Using Machine Learning. 2024 International Conference on Intelligent Systems for Cybersecurity (ISCS), 1–6. https://doi.org/10.1109/ISCS61804.2024.10581155
Singh, A. V., Varma, M., Rai, M., Pratap Singh, S., Bansod, G., Laux, P., & Luch, A. (2024). Advancing Predictive Risk Assessment of Chemicals via Integrating Machine Learning, Computational Modeling, and Chemical/Nano‐Quantitative Structure‐Activity Relationship Approaches. Advanced Intelligent Systems, 6(4), 2300366. https://doi.org/10.1002/aisy.202300366
Sohrabi, H., & Noorzai, E. (2024). Risk-supported case-based reasoning approach for cost overrun estimation of water-related projects using machine learning. Engineering, Construction and Architectural Management, 31(2), 544–570. https://doi.org/10.1108/ECAM-05-2022-0450
Tolulope Esther Edunjobi & Opeyemi Abayomi Odejide. (2024). Theoretical frameworks in AI for credit risk assessment: Towards banking efficiency and accuracy. International Journal of Scientific Research Updates, 7(1), 092–102. https://doi.org/10.53430/ijsru.2024.7.1.0030
Vincoli, J. W. (2024). Basic Guide to System Safety. John Wiley & Sons.
Wang, S., Chen, Y., Cui, Z., Lin, L., & Zong, Y. (2024). Diabetes Risk Analysis based on Machine Learning LASSO Regression Model. Journal of Theory and Practice of Engineering Science, 4(01), Article 01. https://doi.org/10.53469/jtpes.2024.04(01).08
Wilhelmina Afua Addy, Chinonye Esther Ugochukwu, Adedoyin Tolulope Oyewole, Onyeka Chrisanctus Ofodile, Omotayo Bukola Adeoye, & Chinwe Chinazo Okoye. (2024). Predictive analytics in credit risk management for banks: A comprehensive review. GSC Advanced Research and Reviews, 18(2), 434–449. https://doi.org/10.30574/gscarr.2024.18.2.0077
Yu, C., Jin, Y., Xing, Q., Zhang, Y., Guo, S., & Meng, S. (2024). Advanced User Credit Risk Prediction Model using LightGBM, XGBoost and Tabnet with SMOTEENN (Version 1). arXiv. https://doi.org/10.48550/ARXIV.2408.03497
Yusuf, S. D., Omojorla, V., Umar, I., & Loko, A. Z. (2023). Implementation of a 220v Ac Overload and High Voltage Monitor Alert System with Auto Shut Down. International Journal of Engineering and Modern Technology, 8(5), 32–40. https://doi.org/10.56201/ijssmr.v8.no1.2022.pg32.40
Zhang, D., Tang, Y., & Yan, X. (2024). Supply chain risk management of badminton supplies company using decision tree model assisted by fuzzy comprehensive evaluation. Expert Systems, 41(5), e13275. https://doi.org/10.1111/exsy.13275
DOI: https://doi.org/10.24294/jipd9364
Refbacks
- There are currently no refbacks.
Copyright (c) 2024 Boumedyen Shannaq, Devarajanayaka Kalenahalli Muniyanayaka, Oualid Ali, Basel Bani-Ismail, Said Al Maqbali
License URL: https://creativecommons.org/licenses/by/4.0/
This site is licensed under a Creative Commons Attribution 4.0 International License.