{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T16:39:04Z","timestamp":1775147944996,"version":"3.50.1"},"reference-count":44,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2023,3,8]],"date-time":"2023-03-08T00:00:00Z","timestamp":1678233600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Norwegian University of Science and Technology (NTNU)"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Industry 4.0 has revolutionized the use of physical and digital systems while playing a vital role in the digitalization of maintenance plans for physical assets in an optimal way. Road network conditions and timely maintenance plans are essential in the predictive maintenance (PdM) of a road. We developed a PdM-based approach that uses pre-trained deep learning models to recognize and detect the road crack types effectively and efficiently. We, in this work, explore the use of deep neural networks to classify roads based on the amount of deterioration. This is done by training the network to identify various types of cracks, corrugation, upheaval, potholes, and other types of road damage. Based on the amount and severity of the damage, we can determine the degradation percentage and have a PdM framework where we can identify the intensity of damage occurrence and, thus, prioritize the maintenance decisions. The inspection authorities and stakeholders can make maintenance decisions for certain types of damages using our deep learning-based road predictive maintenance framework. We evaluated our approach using precision, recall, F1-score, intersection-over-union, structural similarity index, and mean average precision measures, and found that our proposed framework achieved significant performance.<\/jats:p>","DOI":"10.3390\/s23062935","type":"journal-article","created":{"date-parts":[[2023,3,9]],"date-time":"2023-03-09T02:01:47Z","timestamp":1678327307000},"page":"2935","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Predictive Maintenance of Norwegian Road Network Using Deep Learning Models"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7607-5154","authenticated-orcid":false,"given":"Muhammad Umair","family":"Hassan","sequence":"first","affiliation":[{"name":"Department of ICT and Natural Sciences, Norwegian University of Science and Technology (NTNU), 6009 \u00c5lesund, Norway"}]},{"given":"Ole-Martin Hagen","family":"Steinnes","sequence":"additional","affiliation":[{"name":"Department of ICT and Natural Sciences, Norwegian University of Science and Technology (NTNU), 6009 \u00c5lesund, Norway"}]},{"given":"Eirik Gribbestad","family":"Gustafsson","sequence":"additional","affiliation":[{"name":"Department of ICT and Natural Sciences, Norwegian University of Science and Technology (NTNU), 6009 \u00c5lesund, Norway"}]},{"given":"Sivert","family":"L\u00f8ken","sequence":"additional","affiliation":[{"name":"Department of ICT and Natural Sciences, Norwegian University of Science and Technology (NTNU), 6009 \u00c5lesund, Norway"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1252-260X","authenticated-orcid":false,"given":"Ibrahim A.","family":"Hameed","sequence":"additional","affiliation":[{"name":"Department of ICT and Natural Sciences, Norwegian University of Science and Technology (NTNU), 6009 \u00c5lesund, Norway"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2267","DOI":"10.1080\/14680629.2020.1753098","article-title":"A machine learning methodology to predict alerts and maintenance interventions in roads","volume":"22","author":"Morales","year":"2021","journal-title":"Road Mater. Pavement Des."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"10934","DOI":"10.1007\/s10489-021-03004-y","article-title":"Deep learning models for predictive maintenance: A survey, comparison, challenges and prospects","volume":"52","author":"Serradilla","year":"2022","journal-title":"Appl. Intell."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"103087","DOI":"10.1016\/j.autcon.2020.103087","article-title":"Data-driven predictive maintenance planning framework for MEP components based on BIM and IoT using machine learning algorithms","volume":"112","author":"Cheng","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2107","DOI":"10.1109\/TITS.2016.2520499","article-title":"Integration of structural health monitoring and intelligent transportation systems for bridge condition assessment: Current status and future direction","volume":"17","author":"Khan","year":"2016","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"845","DOI":"10.1016\/j.eng.2020.07.030","article-title":"The state-of-the-art review on applications of intrusive sensing, image processing techniques, and machine learning methods in pavement monitoring and analysis","volume":"7","author":"Hou","year":"2021","journal-title":"Engineering"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"106889","DOI":"10.1016\/j.cie.2020.106889","article-title":"Predictive maintenance in the Industry 4.0: A systematic literature review","volume":"150","author":"Zonta","year":"2020","journal-title":"Comput. Ind. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Shah, S.H.H., Han, K., and Lee, J.W. (2020). Real-Time Application for Generating Multiple Experiences from 360\u00b0 Panoramic Video by Tracking Arbitrary Objects and Viewer\u2019s Orientations. Appl. Sci., 10.","DOI":"10.3390\/app10072248"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"104111","DOI":"10.1016\/j.autcon.2021.104111","article-title":"Automated decision making in highway pavement preventive maintenance based on deep learning","volume":"135","author":"Li","year":"2022","journal-title":"Autom. Constr."},{"key":"ref_9","first-page":"91","article-title":"Faster r-cnn: Towards real-time object detection with region proposal networks","volume":"28","author":"Ren","year":"2015","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014, January 6\u201312). Microsoft coco: Common objects in context. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"115738","DOI":"10.1016\/j.eswa.2021.115738","article-title":"TrafficBERT: Pre-trained model with large-scale data for long-range traffic flow forecasting","volume":"186","author":"Jin","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Dalsasso, E., Yang, X., Denis, L., Tupin, F., and Yang, W. (2020). SAR image despeckling by deep neural networks: From a pre-trained model to an end-to-end training strategy. Remote Sens., 12.","DOI":"10.3390\/rs12162636"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Jiang, H., He, P., Chen, W., Liu, X., Gao, J., and Zhao, T. (2019). Smart: Robust and efficient fine-tuning for pre-trained natural language models through principled regularized optimization. arXiv.","DOI":"10.18653\/v1\/2020.acl-main.197"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Lin, J., Liu, Y., Zeng, Q., Jiang, M., and Cleland-Huang, J. (2021, January 22\u201330). Traceability transformed: Generating more accurate links with pre-trained bert models. Proceedings of the 2021 IEEE\/ACM 43rd International Conference on Software Engineering (ICSE), Madrid, Spain.","DOI":"10.1109\/ICSE43902.2021.00040"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"101525","DOI":"10.1016\/j.aei.2022.101525","article-title":"Intelligent decision-making model in preventive maintenance of asphalt pavement based on PSO-GRU neural network","volume":"51","author":"Li","year":"2022","journal-title":"Adv. Eng. Inform."},{"key":"ref_16","first-page":"I_1","article-title":"Asphalt pavement crack detection using image processing and naive bayes based machine learning approach","volume":"70","author":"Chun","year":"2015","journal-title":"J. Jpn. Soc. Civ. Eng. Ser. E1 Pavement Eng."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1111\/mice.12042","article-title":"Road crack detection using visual features extracted by Gabor filters","volume":"29","author":"Zalama","year":"2014","journal-title":"Comput.-Aided Civ. Infrastruct. Eng."},{"key":"ref_18","first-page":"1","article-title":"Efficient pavement crack detection and classification","volume":"2017","author":"Villatoro","year":"2017","journal-title":"EURASIP J. Image Video Process."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"04018037","DOI":"10.1061\/(ASCE)CP.1943-5487.0000781","article-title":"Image processing\u2013based classification of asphalt pavement cracks using support vector machine optimized by artificial bee colony","volume":"32","author":"Hoang","year":"2018","journal-title":"J. Comput. Civ. Eng."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"130032","DOI":"10.1109\/ACCESS.2019.2940767","article-title":"Sample and structure-guided network for road crack detection","volume":"7","author":"Wu","year":"2019","journal-title":"IEEE Access"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"54564","DOI":"10.1109\/ACCESS.2020.2981561","article-title":"Crack detection of concrete pavement with cross-entropy loss function and improved VGG16 network model","volume":"8","author":"Qu","year":"2020","journal-title":"IEEE Access"},{"key":"ref_23","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1051","DOI":"10.1109\/TCYB.2021.3103885","article-title":"Fast and Accurate Road Crack Detection Based on Adaptive Cost-Sensitive Loss Function","volume":"53","author":"Li","year":"2021","journal-title":"IEEE Trans. Cybern."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Djenouri, Y., Belhadi, A., Houssein, E.H., Srivastava, G., and Lin, J.C.W. (IEEE Trans. Intell. Transp. Syst., 2022). Intelligent Graph Convolutional Neural Network for Road Crack Detection, IEEE Trans. Intell. Transp. Syst., early access.","DOI":"10.1109\/TITS.2022.3215538"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"332","DOI":"10.1049\/itr2.12146","article-title":"RAO-UNet: A residual attention and octave UNet for road crack detection via balance loss","volume":"16","author":"Fan","year":"2022","journal-title":"IET Intell. Transp. Syst."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"111119","DOI":"10.1016\/j.measurement.2022.111119","article-title":"A new mobile convolutional neural network-based approach for pixel-wise road surface crack detection","volume":"195","author":"Ergen","year":"2022","journal-title":"Measurement"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1525","DOI":"10.1109\/TITS.2019.2910595","article-title":"Feature pyramid and hierarchical boosting network for pavement crack detection","volume":"21","author":"Yang","year":"2019","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Xu, X., Zhao, M., Shi, P., Ren, R., He, X., Wei, X., and Yang, H. (2022). Crack detection and comparison study based on faster R-CNN and mask R-CNN. Sensors, 22.","DOI":"10.3390\/s22031215"},{"key":"ref_30","first-page":"102825","article-title":"Pavement crack detection from CCD images with a locally enhanced transformer network","volume":"110","author":"Xu","year":"2022","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"19054","DOI":"10.1109\/TITS.2022.3154407","article-title":"External attention based TransUNet and label expansion strategy for crack detection","volume":"23","author":"Fang","year":"2022","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"809","DOI":"10.1049\/ipr2.12388","article-title":"Road crack detection network under noise based on feature pyramid structure with feature enhancement (road crack detection under noise)","volume":"16","author":"Sun","year":"2022","journal-title":"IET Image Process."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1016\/j.neucom.2019.12.057","article-title":"Distribution equalization learning mechanism for road crack detection","volume":"424","author":"Fang","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"398","DOI":"10.1049\/iet-its.2018.5280","article-title":"Multi-scale classification network for road crack detection","volume":"13","author":"Feng","year":"2019","journal-title":"IET Intell. Transp. Syst."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"7343","DOI":"10.1109\/TITS.2021.3069135","article-title":"BARNet: Boundary aware refinement network for crack detection","volume":"23","author":"Guo","year":"2021","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.autcon.2018.11.028","article-title":"Autonomous concrete crack detection using deep fully convolutional neural network","volume":"99","author":"Dung","year":"2019","journal-title":"Autom. Constr."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 11\u201314). Ssd: Single shot multibox detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Huang, J., Rathod, V., Sun, C., Zhu, M., Korattikara, A., Fathi, A., Fischer, I., Wojna, Z., Song, Y., and Guadarrama, S. (2017, January 21\u201326). Speed\/accuracy trade-offs for modern convolutional object detectors. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.351"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image Quality Assessment: From Error Visibility to Structural Similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"35501","DOI":"10.1117\/1.JMI.4.3.035501","article-title":"Structural similarity index family for image quality assessment in radiological images","volume":"4","author":"Prieto","year":"2017","journal-title":"J. Med. Imag"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Geiger, A., Lenz, P., and Urtasun, R. (2012, January 16\u201321). Are we ready for autonomous driving? the kitti vision benchmark suite. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6248074"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1956","DOI":"10.1007\/s11263-020-01316-z","article-title":"The open images dataset v4: Unified image classification, object detection, and visual relationship detection at scale","volume":"128","author":"Kuznetsova","year":"2020","journal-title":"Int. J. Comput. Vis."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1111\/mice.12263","article-title":"Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks","volume":"32","author":"Cha","year":"2017","journal-title":"Comput.-Aided Civ. Infrastruct. Eng."},{"key":"ref_44","unstructured":"Maeda, H., Sekimoto, Y., Seto, T., Kashiyama, T., and Omata, H. (2018). Road Damage Detection Using Deep Neural Networks with Images Captured Through a Smartphone. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/6\/2935\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:51:07Z","timestamp":1760122267000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/6\/2935"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,8]]},"references-count":44,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["s23062935"],"URL":"https:\/\/doi.org\/10.3390\/s23062935","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,8]]}}}