Improving soil organic matter estimation accuracy by combining optimal spectral preprocessing and feature selection methods based on pXRF and vis-NIR data fusion
Xiaoyan Shi, Jianghui Song, Haijiang Wang, Xin Lv, Yongqi Zhu, Wenxu Zhang, Wenqi Bu, Lingyun Zeng
Abstract
Rapid and accurate estimation of soil organic matter (SOM) content is of great significance for agricultural production and carbon stock estimation. Visible-near-infrared spectroscopy (Vis-NIR) and portable X-ray fluorescence spectroscopy (pXRF), with the fast, low-cost, and environmental friendly characteristics, can realize the rapid large-scale detection of SOM. However, due to the heterogeneity and complexity of soil, estimation of SOM using a single sensor often leads to high uncertainty in result. Multi-sensor data fusion is one of the approaches to solve this problem, but suitable spectral preprocessing methods and data fusion methods still need further research. In this study, 500 soil samples were collected from two watersheds with large differences in soil parent material, soil type, and climate in the Xinjiang Uygur Autonomous Region of China. The effects of different spectral preprocessing methods for vis-NIR and pXRF spectra on SOM estimation were compared, and the effects of five feature selection methods on single sensor estimation and three different multi-sensor fusion estimations were evaluated. The results showed that vis-NIR spectrum was better than pXRF spectrum for SOM estimation, and the 1.6th-order derivative and baseline correction were the optimal preprocessing method for vis-NIR and pXRF spectra (Beam 3), respectively. Feature selection could improve the accuracy of the single sensor and multi-sensor fusion estimations. The competitive adaptive reweighted sampling (CARS) method was the optimal feature selection method for single sensor estimation and Granger–Ramanathan averaging (GRA) fusion estimation, and the variable importance in projection (VIP) was the optimal feature selection method for direct concatenation and outer-product analysis fusion estimation. In general, the optimal SOM estimation (RMSEp = 3.59 g kg−1, LCCCp = 0.84, RPIQp = 2.67) could be achieved based on CARS feature selection method and GRA fusion. This study proves that the combination of spectral preprocessing and feature selection can effectively improve the accuracy of the single sensor and multi-sensor fusion estimations. Especially, the multi-sensor fusion estimation has higher accuracy than the single sensor estimation. This study will provide a reference for the application of proximal soil sensing.