Litcius/Paper detail

Semisupervised Feature Selection via Generalized Uncorrelated Constraint and Manifold Embedding

Xuelong Li, Yunxing Zhang, Rui Zhang

2021IEEE Transactions on Neural Networks and Learning Systems25 citationsDOI

Abstract

Ridge regression is frequently utilized by both supervised learning and semisupervised learning. However, the results cannot obtain the closed-form solution and perform manifold structure when ridge regression is directly applied to semisupervised learning. To address this issue, we propose a novel semisupervised feature selection method under generalized uncorrelated constraint, namely SFS. The generalized uncorrelated constraint equips the framework with the elegant closed-form solution and is introduced to the ridge regression with embedding the manifold structure. The manifold structure and closed-form solution can better save data's topology information compared to the deep network with gradient descent. Furthermore, the full rank constraint of the projection matrix also avoids the occurrence of excessive row sparsity. The scale factor of the constraint that can be adaptively obtained also provides the subspace constraint more flexibility. Experimental results on data sets validate the superiority of our method to the state-of-the-art semisupervised feature selection methods.

Topics & Concepts

Constraint (computer-aided design)Subspace topologyEmbeddingMathematicsArtificial intelligenceFeature (linguistics)Pattern recognition (psychology)Feature selectionRank (graph theory)Manifold (fluid mechanics)Projection (relational algebra)Nonlinear dimensionality reductionMetric (unit)RidgeLasso (programming language)RegressionDimensionality reductionComputer scienceAlgorithmStatisticsOperations managementMechanical engineeringBiologyWorld Wide WebEngineeringCombinatoricsLinguisticsPhilosophyPaleontologyGeometryEconomicsFace and Expression RecognitionImage Retrieval and Classification TechniquesDomain Adaptation and Few-Shot Learning