U-Net feature fusion for multi-class semantic segmentation of urban fabrics from Sentinel-2 imagery: an application on Grand Est Region, France
Romain Wenger, Anne Puissant, Jonathan Weber, Lhassane Idoumghar, Germain Forestier
Abstract
Urban areas are increasing since several years as a result of development of built-up areas, network infrastructure, industrial areas or other built-up areas. This urban sprawl has a considerable impact on natural areas by changing the functioning of ecosystems. Mapping and monitoring Urban Fabrics (UF) is therefore relevant for urban planning and management, risk analysis, human health or biodiversity. For this research, Sentinel-2 (level 2A) single-date images of the East of France, with a high spatial resolution (10 m), are used to assess two semantic segmentation networks (U-Net) that we combined using feature fusion between a from scratch network and a pre-trained network on ImageNet. Moreover three spectral or textural indices have been added to the both networks in order to improve the classification results. The results showed a performance gain for the fusion methods in classifying several UF. However, there is a difference in performance depending on the urbanization gradient; highly urbanized areas provide a better distinction of some UF’s classes than rural areas.