A study for improvement of far-distance performance of a tunnel accident detection system by using an inverse perspective transformation

Kyu Beom Lee; Hyu-Soung Shin

doi:10.9711/KTAJ.2022.24.3.247

All Issue

2022 Vol.24, Issue 3 Preview Page Next Page

Research Paper

A study for improvement of far-distance performance of a tunnel accident detection system by using an inverse perspective transformation 역 원근변환 기법을 이용한 터널 영상유고시스템의 원거리 감지 성능 향상에 관한 연구

31 May 2022. pp. 247-262

PDF XML

Abstract

In domestic tunnels, it is mandatory to install CCTVs in tunnels longer than 200 m which are also recommended by installation of a CCTV-based automatic accident detection system. In general, the CCTVs in the tunnel are installed at a low height as well as near by the moving vehicles due to the spatial limitation of tunnel structure, so a severe perspective effect takes place in the distance of installed CCTV and moving vehicles. Because of this effect, conventional CCTV-based accident detection systems in tunnel are known in general to be very hard to achieve the performance in detection of unexpected accidents such as stop or reversely moving vehicles, person on the road and fires, especially far from 100 m. Therefore, in this study, the region of interest is set up and a new concept of inverse perspective transformation technique is introduced. Since moving vehicles in the transformed image is enlarged proportionally to the distance from CCTV, it is possible to achieve consistency in object detection and identification of actual speed of moving vehicles in distance. To show this aspect, two datasets in the same conditions are composed with the original and the transformed images of CCTV in tunnel, respectively. A comparison of variation of appearance speed and size of moving vehicles in distance are made. Then, the performances of the object detection in distance are compared with respect to the both trained deep-learning models. As a result, the model case with the transformed images are able to achieve consistent performance in object and accident detections in distance even by 200 m.

Keywords

Tunnel CCTV-based accident detection system

Inverse perspective transform

Perspective

Transformed image

Deep learning

국내 200 m 이상 연장의 터널에서는 CCTV 설치가 의무화되어 있으며, 터널 내 돌발 상황을 자동으로 인지한 다음 터널 관리자에게 알릴 수 있는 터널 영상유고시스템의 운영이 권고된다. 여기서 터널 내 설치된 CCTV는 터널 구조물의 공간적인 한계로 인해 낮은 높이로 설치된다. 이에 따라 이동차량과 매우 인접하므로, 이동차량과 CCTV와의 거리에 따른 원근현상이 매우 심하다. 이로 인해, 기존 터널 영상유고시스템은 터널 CCTV로부터 멀리 떨어질수록 차량의 정차 및 역주행, 보행자 출현 및 화재 발생과 같은 터널 내 유고상황을 인지하기 매우 어려우며, 100 m 이상의 거리에서는 높은 유고상황 인지 성능을 기대하기 어려운 것으로 알려져 있다. 이 문제를 해결하기 위해 관심영역 설정 및 역 원근변환(Inverse perspective transform)을 도입하였으며, 이 과정을 통해 얻은 변환영상은 먼 거리에 있는 객체의 크기가 확대된다. 이에 따라 거리에 따라 객체의 크기가 비교적 일정하게 유지되므로, 거리에 따른 객체 인식 성능과 영상에서 보이는 차량의 이동속도 또한 일관성을 유지할 수 있다. 이를 증명하기 위해 본 논문에서는 터널 CCTV의 원본영상과 변환영상을 바탕으로 동일한 조건을 가지는 데이터셋을 각각 제작 및 구성하였으며, 영상 내 차량의 실제 위치의 변화에 따른 겉보기 속도와 객체 크기를 비교하였다. 그 다음 딥러닝 객체인식 모델의 학습 및 추론을 통해 각 영상 데이터셋에 대한 거리에 따른 객체인식 성능을 비교하였다. 결과적으로 변환영상을 사용한 모델은 200 m 이상의 거리에서도 객체인식 성능과 이동 차량의 유고상황 인지 성능을 확보할 수 있음을 보였다.

키워드

터널 영상유고시스템

역 원근변환

원근현상

변환영상

딥러닝

References

Bertozz, M., Broggi, A., Fascioli, A. (1998), “Stereo inverse perspective mapping: theory and applications”, Image and Vision Computing, Vol. 16, No. 8, pp. 585-590. 10.1016/S0262-8856(97)00093-0

Eggert, C., Brehm, S., Winschel, A., Zecha, D., Lienhart, R. (2017), “A closer look: small object detection in faster R-CNN”, Proceedings of the 2017 IEEE International Conference on Multimedia and Expo (ICME), Hong Kong, pp. 421-426. 10.1109/ICME.2017.8019550

Galeano, D.B., Devy, M., Boizard, J.L., Filali, W. (2011), “Real-time architecture on FPGA for obstacle detection using inverse perspective mapping”, Proceedings of the 2011 18th IEEE International Conference on Electronics, Circuits, and Systems, Beirut, pp. 788-791. 10.1109/ICECS.2011.6122392

Gyeonggi Province (2022), Road tunnel information status (open standard).

He, K., Zhang, X., Ren, S., Sun, J. (2016), “Deep residual learning for image recognition”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, pp. 770-778. 10.1109/CVPR.2016.90

Juliani, A., Berges, V.P., Teng, E., Cohen, A., Harper, J., Elion, C., Goy, C., Gao, Y., Henry, H., Mattar, M., Lange, D. (2018), “Unity: A general platform for intelligent agents”, arXiv preprint, arXiv:1809.02627.

LeCun, Y., Boser, B., Denker, J., Henderson, D., Howard, R., Hubbard, W., Jackel, L. (1990), “Handwritten digit recognition with a back-propagation network”, Advances in Neural Information Processing Systems, pp. 396-404.

LeCun, Y., Yoshua, B., Hinton, G. (2015), “Deep learning”, Nature, Vol. 521, pp. 436-444. 10.1038/nature1453926017442

Lee, E.S., Choi, W., Kum, D. (2019), “Bird’s eye view localization of surrounding vehicles: longitudinal and lateral distance estimation with partial appearance”, Robotics and Autonomous Systems, Vol. 112, pp. 178-189. 10.1016/j.robot.2018.11.008

Lee, H.S., Jeong, S.H., Lee, J.W. (2011), “Real-time lane violation detection system using feature tracking”, The KIPS Transactions: Part B, Vol. 18, No. 4, pp. 201-212. 10.3745/KIPSTB.2011.18B.4.201

Mallot, H.A., Bülthoff, H.H., Little, J.J., Bohrer, S. (1991), “Inverse perspective mapping simplifies optical flow computation and obstacle detection”, Biological Cybernetics, Vol. 64, No. 3, pp. 177-185. 10.1007/BF002019782004128

Min, Z., Ying, M., Dihua, S. (2019), “Tunnel pedestrian detection based on super resolution and convolutional neural network”, Proceedings of the 2019 Chinese Control and Decision Conference (CCDC), Nanchang, pp. 4635-4640. 10.1109/CCDC.2019.8833181

MOLIT (2010), ITS project implementation guidelines, Ministry of Land, Infrastructure and Transport.

MOLIT (2021), Guideline of installation and management of disaster prevention facilities on road tunnels, Ministry of Land, Infrastructure and Transport.

Padilla, R., Passos, W.L., Dias, T.L., Netto, S.L., da Silva, E.A. (2021), “A comparative analysis of object detection metrics with a companion open-source toolkit”, Electronics, Vol. 10, No. 3, 279. 10.3390/electronics10030279

Pflugfelder, R., Bischof, H., Dominguez, G.F., Nolle, M., Schwabach, H. (2005), “Influence of camera properties on image analysis in visual tunnel surveillance”, Proceedings of the 2005 IEEE Intelligent Transportation Systems, Vienna, pp. 868-873. 10.1109/ITSC.2005.1520164

Ren, S., He, K., Girshick, R., Sun, J. (2015), “Faster R-CNN: Towards real-time object detection with region proposal networks”, Advances in Neural Information Processing Systems, Montréal.

Shin, H.S., Kim, D.G., Yim, M.J., Lee, K.B., Oh, Y.S. (2017a), “A preliminary study for development of an automatic incident detection system on CCTV in tunnels based on a machine learning algorithm”, Journal of Korean Tunnelling and Underground Space Association, Vol. 19, No. 1, pp. 95-107. 10.9711/KTAJ.2017.19.1.095

Shin, H.S., Lee, K.B., Yim, M.J., Kim, D.G. (2017b), “Development of a deep-learning based tunnel incident detection system on CCTVs”, Journal of Korean Tunnelling and Underground Space Association, Vol. 19, No. 6, pp. 915-936. 10.9711/KTAJ.2017.19.1.095

Tong, K., Wu, Y., Zhou, F. (2020), “Recent advances in small object detection based on deep learning: a review”, Image and Vision Computing, Vol. 97, 103910. 10.1016/j.imavis.2020.103910

Tsai, C.M., Hsieh, J.W., Shih, F.Y. (2016), “Motion-based vehicle detection in Hsuehshan Tunnel”, Proceedings of the 2016 Eighth International Conference on Advanced Computational Intelligence (ICACI), Chiang Mai, pp. 385-389. 10.1109/ICACI.2016.7449856

Zhu, M. (2004), Recall, precision and average precision, Department of Statistics and Actuarial Science, University of Waterloo, Waterloo.

Zou, Z., Shi, Z., Guo, Y., Ye, J. (2019), “Object detection in 20 years: a survey”, arXiv preprint, arXiv:1905.05055.

Information

Publisher :Korean Tunneling and Underground Space Association
Publisher(Ko) :한국터널지하공간학회
Journal Title :Journal of Korean Tunnelling and Underground Space Association
Journal Title(Ko) :한국터널지하공간학회 논문집
Volume : 24
No :3
Pages :247-262
Received Date : 2022-03-10
Revised Date : 2022-05-12
Accepted Date : 2022-05-18
DOI :https://doi.org/10.9711/KTAJ.2022.24.3.247

Journal of Korean Tunnelling and Underground Space Association ISSN:2233-8292(Print) 2287-4747(Online) 한국터널지하공간학회 논문집

All Issue