Displacement Measurement and 3D Reconstruction of Segmental Retaining Wall Using Deep Convolutional Neural Networks and Binocular Stereovision
Minh-Vuong Pham, Yun-Tae Kim, Yong-Soo Ha
Abstract
Computer vision techniques were employed to monitor the displacement of retaining walls using artificial markers, traditional feature detection algorithms, and photogrammetry‐based point cloud reconstruction. However, the use of artificial markers often increases both installation time and costs, whereas the performance of traditional feature matching is affected by uneven illumination, and photogrammetry techniques require multiple images for point cloud reconstruction. To overcome these limitations, a nontarget‐based displacement monitoring method for segmental retaining walls (SRWs) using a combination of deep learning and stereovision was proposed. Binocular stereovision was employed to reconstruct the geometry and surface properties of the SRW in a digital three‐dimensional (3D) model. Deep learning models were then used to extract natural features from SRW blocks, enabling displacement calculation without using artificial targets. The performance was evaluated by monitoring the behaviors of SRW experiments at both laboratory and field scales. The deep learning–based image segmentation models identified SRW block features in the experiment and real case datasets with an average F1 score from 0.910 to 0.965 under various environmental conditions. The reconstructed results of point cloud coordinates demonstrated high accuracy, ranging from 95.2% to 98.6%. Furthermore, the calculated displacement exhibited a high degree of agreement with the measured displacement. The accuracy of the calculated displacements for the laboratory and field experiments ranged from 89.5% to 99.1%. The proposed method can be used for automatic SRW displacement monitoring.