An evaluation methodology for cement concrete lining crack segmentation deep learning model

Sangwoo Ham; Soohyeon Bae; Impyeong Lee; Gyu-Phil Lee; Donggyou Kim

doi:10.9711/KTAJ.2022.24.6.513

All Issue

2022 Vol.24, Issue 6 Preview Page Next Page

Research Paper

An evaluation methodology for cement concrete lining crack segmentation deep learning model 콘크리트 라이닝 균열 분할 딥러닝 모델 평가 방법

30 November 2022. pp. 513-524

PDF XML

Abstract

Recently, detecting damages of civil infrastructures from digital images using deep learning technology became a very popular research topic. In order to adapt those methodologies to the field, it is essential to explain robustness of deep learning models. Our research points out that the existing pixel-based deep learning model evaluation metrics are not sufficient for detecting cracks since cracks have linear appearance, and proposes a new evaluation methodology to explain crack segmentation deep learning model more rationally. Specifically, we design, implement and validate a methodology to generate tolerance buffer alongside skeletonized ground truth data and prediction results to consider overall similarity of topology of the ground truth and the prediction rather than pixel-wise accuracy. We could overcome over-estimation or under-estimation problem of crack segmentation model evaluation through using our methodology, and we expect that our methodology can explain crack segmentation deep learning models better.

Keywords

Deep learning

Semantic segmentation

Performance evaluation

터널을 비롯한 여러 가지 기반시설물에 발생한 콘크리트 균열을 영상과 딥러닝 기반으로 자동 탐지하는 연구가 최근 활발히 이루어지고 있다. 이러한 연구성과를 실제 현장에 적용하려면 딥러닝 모델의 신뢰성을 설명할 수 있어야한다. 본 연구에서는 선형성이 강한 균열의 기하적인 특성을 고려했을 때 화소 기반으로 계산하는 기존 평가지표가 충분치 않다는 점을 지적하며, 균열 분할 딥러닝 모델의 성능을 더 합리적으로 설명할 수 있는 다른 평가지표를 제시하고 비교 분석한다. 먼저 선형 객체의 유사성을 측정할 수 평가방법을 제시한다. 구체적으로는 기준 데이터에 허용 버퍼(tolerance buffer)를 부여하여 평가하는 방법을 설계, 구현, 검증한다. 실험 결과 본 연구에서 제안하는 방법은 균열 분할 딥러닝 모델 평가시 기존 대비 과대평가 또는 과소평가 문제를 해결할 수 있었으며, 화소 기반 성능 평가 지표에 비해 균열 분할 딥러닝 모델의 성능을 더 잘 설명할 것으로 기대한다.

키워드

딥러닝

의미론적 분할

성능평가

References

Bianchi, E., Abbott, A.L., Tokekar, P., Hebdon, M. (2021), "COCO-Bridge: structural detail data set for bridge inspections", Journal of Computing in Civil Engineering, Vol. 35, No. 3, 04021003. 10.1061/(ASCE)CP.1943-5487.0000949

Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., Adam, H. (2018), "Encoder-decoder with atrous separable convolution for semantic image segmentation", arXiv:1802:02611, pp. 1-23. 10.1007/978-3-030-01234-2_49

Garcia-Garcia, A., Orts-Escolano, S., Oprea, S.O., Villena-Martinez, V., Garcia-Rodriguez, J. (2017), "A review on deep learning techniques applied to semantic segmentation", arXiv:1704:06857, pp. 1-22.

Ham, S., Bae, S., Kim, H., Lee, I., Lee, G.P., Kim, D. (2021), "Training a semantic segmentation model for cracks in the concrete lining of tunnel", Journal of Korean Tunnelling and Underground Space Association, Vol. 23, No. 6, pp. 549-558. 10.9711/KTAJ.2021.23.6.549

Hsieh, Y.A., Tsai, Y.J. (2020), "Machine learning for crack detection: review and model performance comparison", Journal of Computing in Civil Engineering, Vol. 34, No. 5, 04020038. 10.1061/(ASCE)CP.1943-5487.0000918

Kim, A.R., Kim, D., Byun, Y.S., Lee, S.W. (2018), "Crack detection of concrete structure using deep learning and image processing method in geotechnical engineering", Journal of the Korean Geotechnical Society, Vol. 34, No. 12, pp. 145-154. 10.7843/kgs.2018.34.12.145

Liu, Y., Yao, J., Lu, X., Xie, R., Li, L. (2019), "DeepCrack: A deep hierarchical feature learning architecture for crack segmentation", Neurocomputing, Vol. 338, pp. 139-153. 10.1016/j.neucom.2019.01.036

Middha, L. (2020), "Crack segmentation dataset", https://www.kaggle.com/lakshaymiddha/crack-segmentation-dataset (September 20, 2022).

MMSegmentation Contributors (2020), "OpenMMLab semantic segmentation toolbox and benchmark", https://github.com/open-mmlab/mmsegmentation (September 20, 2022).

Mundt, M., Majumder, S., Murali, S., Panetsos, P., Ramesh, V. (2019), "Meta-learning convolutional neural architectures for multi-target concrete defect classification with the concrate defect bridge image dataset", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, California, pp. 11196-11205. 10.1109/CVPR.2019.01145

OurBrain (2022), "Big Eye System", OurBrain, http://ourbrain.co.kr/ (September 20, 2022).

Paik, S.H., Choi, D.Y., Kim, Y.K., Jung, S.W., Kim, D.N. (2021), "Implementation of the drones with deep-learning crack detection analysis for inspection of bridge", The Journal of Korean Institute of Information Technology, Vol. 19, No. 3, pp. 45-52. 10.14801/jkiit.2021.19.3.45

Park, G. (2022), "Building crack detection images", AI Hub, https://aihub.or.kr/aihubdata/data/view.do?currMenu=115&topMenu=100&aihubDataSe=realm&dataSetSn=162 (September 20, 2022).

Scikit-image contributors (2022), "Morphological filtering", Scikit-image, https://scikit-image.org/docs/stable/auto_examples/applications/plot_morphology.html (September 20, 2022).

Tsai, Y.C., Chatterjee, A. (2017), "Comprehensive, quantitative crack detection algorithm performance evaluation system", Journal of Computing in Civil Engineering, Vol. 31, No. 5, 04017047. 10.1061/(ASCE)CP.1943-5487.0000696

Zhang, T.Y., Suen, C.Y. (1984), "A fast parallel algorithm for thinning digital patterns", Communications of the ACM, Vol. 27, No. 3, pp.236-239. 10.1145/357994.358023

Information

Publisher :Korean Tunneling and Underground Space Association
Publisher(Ko) :한국터널지하공간학회
Journal Title :Journal of Korean Tunnelling and Underground Space Association
Journal Title(Ko) :한국터널지하공간학회 논문집
Volume : 24
No :6
Pages :513-524
Received Date : 2022-09-26
Revised Date : 2022-10-18
Accepted Date : 2022-10-18
DOI :https://doi.org/10.9711/KTAJ.2022.24.6.513

Journal of Korean Tunnelling and Underground Space Association ISSN:2233-8292(Print) 2287-4747(Online) 한국터널지하공간학회 논문집

All Issue