Feature selection based on weighted conditional mutual information
Hongfang Zhou, Xiqian Wang, Yao Zhang
Abstract
Feature selection is an essential step in data mining. The core of it is to analyze and quantize the relevancy and redundancy between the features and the classes. In CFR feature selection method, they rarely consider which feature to choose if two or more features have the same value using evaluation criterion. In order to address this problem, the standard deviation is employed to adjust the importance between relevancy and redundancy. Based on this idea, a novel feature selection method named as Feature Selection Based on Weighted Conditional Mutual Information (WCFR) is introduced. Experimental results on ten datasets show that our proposed method has higher classification accuracy.
Topics & Concepts
Feature selectionComputer scienceMutual informationRedundancy (engineering)Minimum redundancy feature selectionData miningPattern recognition (psychology)Feature (linguistics)Artificial intelligenceInformation gainSelection (genetic algorithm)LinguisticsPhilosophyOperating systemFace and Expression RecognitionRough Sets and Fuzzy LogicNeural Networks and Applications