Litcius/Paper detail

Learning Robust Discriminant Subspace Based on Joint L₂,<i>ₚ</i>- and L₂,<i>ₛ</i>-Norm Distance Metrics

Liyong Fu, Zechao Li, Qiaolin Ye, Hang Yin, Qingwang Liu, Xiaobo Chen, Xijian Fan, Wankou Yang, Guowei Yang

2020IEEE Transactions on Neural Networks and Learning Systems112 citationsDOI

Abstract

-norm as the distance metric. However, both of their robustness and discriminant power are limited. In this article, we present a new robust discriminant subspace (RDS) learning method for feature extraction, with an objective function formulated in a different form. To guarantee the subspace to be robust and discriminative, we measure the within-class distances based on [Formula: see text]-norm and use [Formula: see text]-norm to measure the between-class distances. This also makes our method include rotational invariance. Since the proposed model involves both [Formula: see text]-norm maximization and [Formula: see text]-norm minimization, it is very challenging to solve. To address this problem, we present an efficient nongreedy iterative algorithm. Besides, motivated by trace ratio criterion, a mechanism of automatically balancing the contributions of different terms in our objective is found. RDS is very flexible, as it can be extended to other existing feature extraction techniques. An in-depth theoretical analysis of the algorithm's convergence is presented in this article. Experiments are conducted on several typical databases for image classification, and the promising results indicate the effectiveness of RDS.

Topics & Concepts

Robustness (evolution)Subspace topologyPattern recognition (psychology)OutlierDiscriminantLinear discriminant analysisArtificial intelligenceComputer scienceMaximizationFeature extractionMeasure (data warehouse)Iterative methodMathematicsFeature (linguistics)Robust statisticsOptimal discriminant analysisData miningConvergence (economics)Image (mathematics)Machine learningJoint (building)TRACE (psycholinguistics)Dimensionality reductionExpectation–maximization algorithmRobust regressionMinificationFunction (biology)AlgorithmDiscriminative modelDimension (graph theory)Face and Expression RecognitionAdvanced Statistical Methods and ModelsAnomaly Detection Techniques and Applications
Learning Robust Discriminant Subspace Based on Joint L₂,<i>ₚ</i>- and L₂,<i>ₛ</i>-Norm Distance Metrics | Litcius