TY - JOUR
T1 - Detection of zebra-crossing areas based on deep learning with combination of segnet and resnet
AU - Liang, Han
AU - Seo, Suyoung
N1 - Publisher Copyright:
© 2021 Korean Society of Surveying. All rights reserved.
PY - 2021
Y1 - 2021
N2 - This paper presents a method to detect zebra-crossing using deep learning which combines SegNet and ResNet. For the blind, a safe crossing system is important to know exactly where the zebra-crossings are. Zebracrossing detection by deep learning can be a good solution to this problem and robotic vision-based assistive technologies sprung up over the past few years, which focused on specific scene objects using monocular detectors. These traditional methods have achieved significant results with relatively long processing times, and enhanced the zebra-crossing perception to a large extent. However, running all detectors jointly incurs a long latency and becomes computationally prohibitive on wearable embedded systems. In this paper, we propose a model for fast and stable segmentation of zebra-crossing from captured images. The model is improved based on a combination of SegNet and ResNet and consists of three steps. First, the input image is subsampled to extract image features and the convolutional neural network of ResNet is modified to make it the new encoder. Second, through the SegNet original up-sampling network, the abstract features are restored to the original image size. Finally, the method classifies all pixels and calculates the accuracy of each pixel. The experimental results prove the efficiency of the modified semantic segmentation algorithm with a relatively high computing speed.
AB - This paper presents a method to detect zebra-crossing using deep learning which combines SegNet and ResNet. For the blind, a safe crossing system is important to know exactly where the zebra-crossings are. Zebracrossing detection by deep learning can be a good solution to this problem and robotic vision-based assistive technologies sprung up over the past few years, which focused on specific scene objects using monocular detectors. These traditional methods have achieved significant results with relatively long processing times, and enhanced the zebra-crossing perception to a large extent. However, running all detectors jointly incurs a long latency and becomes computationally prohibitive on wearable embedded systems. In this paper, we propose a model for fast and stable segmentation of zebra-crossing from captured images. The model is improved based on a combination of SegNet and ResNet and consists of three steps. First, the input image is subsampled to extract image features and the convolutional neural network of ResNet is modified to make it the new encoder. Second, through the SegNet original up-sampling network, the abstract features are restored to the original image size. Finally, the method classifies all pixels and calculates the accuracy of each pixel. The experimental results prove the efficiency of the modified semantic segmentation algorithm with a relatively high computing speed.
KW - Deep Learning
KW - Neural Network
KW - Semantic Segmentation
KW - Zebra-crossing Detection
UR - http://www.scopus.com/inward/record.url?scp=85110769241&partnerID=8YFLogxK
U2 - 10.7848/ksgpc.2021.39.3.141
DO - 10.7848/ksgpc.2021.39.3.141
M3 - Article
AN - SCOPUS:85110769241
SN - 1598-4850
VL - 39
SP - 141
EP - 148
JO - Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
JF - Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
IS - 3
ER -