iRodd (intelligent-road damage detection) for real-time infrastructure preservation in detection, classification, calculation, and visualization

Tri Joko Wahyu Adi, Priyo Suprobo, Yusroniya Eka Putri Rachman Waliulu

Article ID: 6162
Vol 8, Issue 11, 2024

VIEWS - 20 (Abstract) 15 (PDF)

Abstract


Preserving roads involves regularly evaluating government policy through advanced assessments using vehicles with specialized capabilities and high-resolution scanning technology. However, the cost is often not affordable due to a limited budget. Road surface surveys are highly expected to use low-cost tools and methods capable of being carried out comprehensively. This research aims to create a road damage detection application system by identifying and qualifying precisely the type of damage that occurs using a single CNN to detect objects in real time. Especially for the type of pothole, further analysis is to measure the volume or dimensions of the hole with a LiDAR smartphone. The study area is 38 province’s representative area in Indonesia. This research resulted in the iRodd (intelligent-road damage detection) for detection and classification per type of road damage in real-time object detection. Especially for the type of pothole damage, further analysis is carried out to obtain a damage volume calculation model and 3D visualization. The resulting iRodd model contributes in terms of completion (analyzing the parameters needed to be related to the road damage detection process), accuracy (precision), reliability (the level of reliability has high precision and is still within the limits of cost-effective), correct prediction (four-fifths of all positive objects that should be identified), efficient (object detection models strike a good balance between being able to recognize objects with high precision and being able to capture most objects that would otherwise be detected-high sensitivity), meanwhile, in the calculation of pothole volume, where the precision level is established according to the volume error value, comparing the derived data to the reference data with an average error of 5.35% with an RMSE value of 6.47 mm. The advanced iRodd model with LiDAR smartphone devices can present visualization and precision in efficiently calculating the volume of asphalt damage (potholes).


Keywords


3D visualization; accuracy; efficiency; object detection; prediction; precision; reliability

Full Text:

PDF


References


Abbas, I. H., & Ismael, M. Q. (2021). Automated Pavement Distress Detection Using Image Processing Techniques. Engineering, Technology and Applied Science Research, 11(5), 7702–7708. https://doi.org/10.48084/etasr.4450

Al Duhayyim, M., Malibari, A. A., Alharbi, A., et al. (2022). Road Damage Detection Using the Hunger Games Search with Elman Neural Network on High-Resolution Remote Sensing Images. Remote Sensing, 14(24). https://doi.org/10.3390/rs14246222

Alamgeer, M., Alkahtani, H. K., Maashi, M., et al. (2023). Optimal Fuzzy Wavelet Neural Network Based Road Damage Detection. IEEE Access, 11, 61986–61994. https://doi.org/10.1109/ACCESS.2023.3283299

Alqethami, S., Alghamdi, S., Alsubait, T., & Alhakami, H. (2022). RoadNet: Efficient Model to Detect and Classify Road Damages. Applied Sciences (Switzerland), 12(22). https://doi.org/10.3390/app122211529

Amelia Setiaputri, H., Isradi, M., Irfan Rifai, A., et al. (2021). Analysis Of Urban Road Damage With Pavement Condition Index (PCI) And Surface Distress Index (SDI) Methods. ADRI International Journal of Sciences, Engineering and Technology, 6(01), 10–19. https://doi.org/10.29138/ijset.v6i01.61

Benallal, M. A., & Tayeb, M. S. (2023). An image-based convolutional neural network system for road defect detection. IAES International Journal of Artificial Intelligence, 12(2), 577–584. https://doi.org/10.11591/ijai.v12.i2.pp577-584

Benmhahe, B., & Chentoufi, J. A. (2021). Automated Pavement Distress Detection, Classification and Measurement: A Review. International Journal of Advanced Computer Science and Applications, 12(8), 708–718. https://doi.org/10.14569/IJACSA.2021.0120882

Bera, K., Parthiban, R., & Karmakar, N. (2023). A Truly 3D Visible Light Positioning System Using Low Resolution High Speed Camera, LIDAR, and IMU Sensors. IEEE Access, 11, 98578–98585. https://doi.org/10.1109/ACCESS.2023.3312293

Bhatt, U., Mani, S., Xi, E., & Kolter, J. Z. (2017). Intelligent Pothole Detection and Road Condition Assessment. arXiv, arXiv:1710.02595.

Chaithavee, S., & Chayakul, T. (2022). Classification of 3D Point Cloud Data from Mobile Mapping System for Detecting Road Surfaces and Potholes using Convolution Neural Networks. International Journal of Geoinformatics, 18(6), 11–23. https://doi.org/10.52939/ijg.v18i6.2455

Choiri, A., Yusuf, M. S., Sari, R. N., & Artanti, L. D. (2024). Comparison of road damage analysis using PCI method and Bina Marga method and the analysis of road improvement methods using the road pavement design manual (Case study: Citayam—Parung road). E3S Web of Conferences, 479, 07017. https://doi.org/10.1051/e3sconf/202447907017

Coenen, T. B. J., & Golroo, A. (2017). A review on automated pavement distress detection methods. Cogent Engineering, 4(1), 1–23. https://doi.org/10.1080/23311916.2017.1374822

Costantino, D., Vozza, G., Pepe, M., & Alfio, V. S. (2022). Smartphone LiDAR Technologies for Surveying and Reality Modelling in Urban Scenarios: Evaluation Methods, Performance and Challenges. Applied System Innovation, 5(4). https://doi.org/10.3390/asi5040063

Desai, J., Liu, J., Hainje, R., et al. (2021). Assessing vehicle profiling accuracy of handheld lidar compared to terrestrial laser scanning for crash scene reconstruction. Sensors, 21(23). https://doi.org/10.3390/s21238076

Dollár, P., & Zitnick, C. L. (2015). Fast edge detection using structured forests. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37(8), 1558–1570. https://doi.org/10.1109/TPAMI.2014.2377715

Elmousalami, H. H. (2019). Intelligent methodology for project conceptual cost prediction. Heliyon, 5(5), e01625. https://doi.org/10.1016/j.heliyon.2019.e01625

Elwahsh, H., Allakany, A., Alsabaan, M., et al. (2023). A Deep Learning Technique to Improve Road Maintenance Systems Based on Climate Change. Applied Sciences (Switzerland), 13(15). https://doi.org/10.3390/app13158899

Eslami, E., & Yun, H. B. (2023). Comparison of deep convolutional neural network classifiers and the effect of scale encoding for automated pavement assessment. Journal of Traffic and Transportation Engineering (English Edition), 10(2), 258–275. https://doi.org/10.1016/j.jtte.2022.08.002

Everingham, M., Van Gool, L., Williams, C. K. I., et al. (2010). The Pascal Visual Object Classes (VOC) Challenge. International Journal of Computer Vision, 88(2), 303–338. https://doi.org/10.1007/s11263-009-0275-4

Gavilán, M., Balcones, D., Marcos, O., et al. (2011). Adaptive road crack detection system by pavement classification. Sensors, 11(10), 9628–9657. https://doi.org/10.3390/s111009628

Gollob, C., Ritter, T., Kraßnitzer, R., et al. (2021). Measurement of forest inventory parameters with Apple iPad Pro and integrated lidar technology. Remote Sensing, 13(16), 1–35. https://doi.org/10.3390/rs13163129

Guerrieri, M., & Parla, G. (2022). Flexible and stone pavements distress detection and measurement by deep learning and low-cost detection devices. Engineering Failure Analysis, 141, 106714. https://doi.org/10.1016/j.engfailanal.2022.106714

Huang, Y., Xu, X., He, Z., et al. (2023). A Lightweight Road Crack and Damage Detection Method Using Yolov5s for IoT Applications. In: Proceedings of the 2023 IEEE/CIC International Conference on Communications in China (ICCC). pp. 1–6. https://doi.org/10.1109/ICCC57788.2023.10233422

King, F., Kelly, R., & Fletcher, C. G. (2022). Evaluation of LiDAR-Derived Snow Depth Estimates From the iPhone 12 Pro. IEEE Geoscience and Remote Sensing Letters, 19, 1–5. https://doi.org/10.1109/LGRS.2022.3166665

Kulambayev, B., Beissenova, G., Katayev, N., et al. (2022). A Deep Learning-Based Approach for Road Surface Damage Detection. Computers, Materials and Continua, 73(2), 3403–3418. https://doi.org/10.32604/cmc.2022.029544

Lang, H., Lu, J. J., Lou, Y., & Chen, S. (2020). Pavement Cracking Detection and Classification Based on 3D Image Using Multiscale Clustering Model. Journal of Computing in Civil Engineering, 34(5), 1–12. https://doi.org/10.1061/(ASCE)cp.1943-5487.0000910

Liang, H., Lee, S. C., & Seo, S. (2022). Automatic Recognition of Road Damage Based on Lightweight Attentional Convolutional Neural Network. Sensors, 22(24). https://doi.org/10.3390/s22249599

Liu, Y., Duan, M., Ding, G., et al. (2023). HE-YOLOv5s: Efficient Road Defect Detection Network. Entropy, 25(9), 1–16. https://doi.org/10.3390/e25091280

Luetzenburg, G., Kroon, A., & Bjørk, A. A. (2021). Evaluation of the Apple iPhone 12 Pro LiDAR for an Application in Geosciences. Scientific Reports, 11(1), 1–9. https://doi.org/10.1038/s41598-021-01763-9

Ma, D., Fang, H., Xue, B., et al. (2020). Intelligent detection model based on a fully convolutional neural network for pavement cracks. CMES—Computer Modeling in Engineering and Sciences, 123(3), 1267–1291. https://doi.org/10.32604/cmes.2020.09122

Maeda, H., Sekimoto, Y., & Seto, T. (2016). An easy infrastructure management method using on-board smartphone images and citizen reports by deep neural network. In: Proceedings of the Second International Conference on IoT in Urban Space. https://doi.org/10.1145/2962735.2962738

Majidifard, H., Jin, P., Adu-Gyamfi, Y., & Buttlar, W. G. (2020). Pavement Image Datasets: A New Benchmark Dataset to Classify and Densify Pavement Distresses. Transportation Research Record: Journal of the Transportation Research Board, 2674(2), 328–339. https://doi.org/10.1177/0361198120907283

Neelam Jaikishore, C., Podaturpet Arunkumar, G., Jagannathan Srinath, A., et al. (2022). Implementation of Deep Learning Algorithm on a Custom Dataset for Advanced Driver Assistance Systems Applications. Applied Sciences (Switzerland), 12(18). https://doi.org/10.3390/app12188927

Pebrianto, T. D. (2023). Analysis damage pavement using Binamarga method on Lamongan-Gresik road STA 45+200-47+200. SONDIR, 7(2), 110–117. https://doi.org/10.36040/sondir.v7i2.5997

Pebrianto, T. D., Tjendani, H. T., & Hartatik, N. (2023). Analysis Damage Pavement Using Binamarga Method on Lamongan-Gresik Road Sta 45+200-47+200. Innovative: Journal of Social Science Research, 3(1), 689–703. https://doi.org/10.31004/innovative.v3i1.4804

Pham, V., Nguyen, D., & Donan, C. (2022). Road Damage Detection and Classification with YOLOv7. In: Proceedings of the 2022 IEEE International Conference on Big Data (Big Data). pp. 6416–6423. https://doi.org/10.1109/BigData55660.2022.10020856

Ramesh, A., Nikam, D., Balachandran, V. N., et al. (2022). Cloud-Based Collaborative Road-Damage Monitoring with Deep Learning and Smartphones. Sustainability (Switzerland), 14(14), 1–21. https://doi.org/10.3390/su14148682

Ruseruka, C., Mwakalonge, J., Comert, G., et al. (2023). Road Condition Monitoring Using Vehicle Built-in Cameras and GPS Sensors: A Deep Learning Approach. Vehicles, 5(3), 931–948. https://doi.org/10.3390/vehicles5030051

Shan, J., Li, Z., Lercel, D., et al. (2023). Democratizing photogrammetry: an accuracy perspective. Geo-Spatial Information Science, 26(2), 175–188. https://doi.org/10.1080/10095020.2023.2178336

Song, W., Jia, G., Zhu, H., et al. (2020). Automated pavement crack damage detection using deep multiscale convolutional features. Journal of Advanced Transportation, 2020, 1–11. https://doi.org/10.1155/2020/6412562

Tang, Y., Li, K., & Wang, K. (2022). Research on intelligent detection of pavement damage based on CNN. Mathematical Models in Engineering, 8(4), 98–107. https://doi.org/10.21595/mme.2022.22918

Thuyet, D. Q., Jomoto, M., Hirakawa, K., & Lei Swe, Y. L. (2022). Development of an Autonomous Road Surface Damage Inspection Program Using Deep Convolutional Neural Network. Journal of Japan Society of Civil Engineers, 10(1), 235–246. https://doi.org/10.2208/journalofjsce.10.1_235

Tsuboki, Y., Kawakami, T., Matsumoto, S., et al. (2023). A Real-time Background Replacement System Based on Estimated Depth for AR Applications. Journal of Information Processing, 31, 758–765. https://doi.org/10.2197/ipsjjip.31.758

Utaminingrum, F., Alqadri, A. M., Somawirata, I. K., et al. (2023). Feature selection of gray-level Cooccurrence matrix using genetic algorithm with Extreme learning machine classification for early detection of Pole roads. Results in Engineering, 20, 101437. https://doi.org/10.1016/j.rineng.2023.101437

Vogt, J., Ilic, M., & Bogenberger, K. (2023). A mobile mapping solution for VRU Infrastructure monitoring via low-cost LiDAR-sensors. Journal of Location Based Services, 17(4), 389–411. https://doi.org/10.1080/17489725.2023.2238660

Waliulu, Y. E. P. R., Suprobo, P., & Adi, T. J. W. (2023). Volume Calculation Accuracy and 3D Visualization of Flexible Pavement Damage Based on Low-cost LiDAR. In: Proceedings of the 2023 IEEE Asia-Pacific Conference on Geoscience, Electronics and Remote Sensing Technology (AGERS). pp. 109–113. https://doi.org/10.1109/AGERS61027.2023.10490615

Wan, F., Sun, C., He, H., et al. (2022). YOLO-LRDD: a lightweight method for road damage detection based on improved YOLOv5s. Eurasip Journal on Advances in Signal Processing, 2022(1). https://doi.org/10.1186/s13634-022-00931-x

Wang, N., Shang, L., & Song, X. (2023). A Transformer-Optimized Deep Learning Network for Road Damage Detection and Tracking. Sensors, 23(17), 1–18. https://doi.org/10.3390/s23177395

Wang, P., Wang, C., Liu, H., et al. (2023). Research on Automatic Pavement Crack Recognition Based on the Mask R-CNN Model. Coatings, 13(2). https://doi.org/10.3390/coatings13020430

Xhimitiku, I., Pascoletti, G., Zanetti, E. M., & Rossi, G. (2022). 3D shape measurement techniques for human body reconstruction. Acta IMEKO, 11(2), 1–8. https://doi.org/10.21014/acta_imeko.v11i2.1219

Xin, H., Ye, Y., Na, X., et al. (2023). Sustainable Road Pothole Detection: A Crowdsourcing Based Multi-Sensors Fusion Approach. Sustainability (Switzerland), 15(8), 1–23. https://doi.org/10.3390/su15086610

Yan, X., Liu, Z., Zhuang, Z., & Miao, Y. (2022). Defect Point Location Method of Civil Bridge Based on Internet of Things Wireless Communication. Journal of Electrical and Computer Engineering, 2022, 1–12. https://doi.org/10.1155/2022/8728397

Yang, T., Liu, Z., Chen, Y., & Yu, Y. (2020). Real-time, Inexpensive, and Portable Measurement of Water Surface Velocity through Smartphone. Water, 12(12), 3358. https://doi.org/10.3390/w12123358

Zhang, H., Wu, Z., Qiu, Y., et al. (2022). A New Road Damage Detection Baseline with Attention Learning. Applied Sciences (Switzerland), 12(15), 7549. https://doi.org/10.3390/app12157594

Zhao, R., Huang, Y., Luo, H., et al. (2023). A Framework for Using UAVs to Detect Pavement Damage Based on Optimal Path Planning and Image Splicing. Sustainability, 15(3), 2182. https://doi.org/10.3390/su15032182

Zimbelman, E. G., & Keefe, R. F. (2022). Lost in the woods: Forest vegetation, and not topography, most affects the connectivity of mesh radio networks for public safety. PLoS ONE, 17(12), e0278645. https://doi.org/10.1371/journal.pone.0278645




DOI: https://doi.org/10.24294/jipd.v8i11.6162

Refbacks

  • There are currently no refbacks.


Copyright (c) 2024 Tri Joko Wahyu Adi, Priyo Suprobo, Yusroniya Eka Putri Rachman Waliulu

License URL: https://creativecommons.org/licenses/by/4.0/

This site is licensed under a Creative Commons Attribution 4.0 International License.