Improving KNN Algorithm Based on Weighted Attributes by Pearson Correlation Coefficient and PSO Fine Tuning
Wanarase Sinhashthita, Kietikul Jearanaitanakij
Abstract
Assigning proper weights to attributes in some datasets according to their importances can significantly improve the classification accuracy. Weighted attributes can support the classification methods effectively if their weights truly represent by their importances. In this research, we improve the K - Nearest Neighbors (KNN) algorithm by using Pearson correlation coefficient along with Particle Swarm Optimization (PSO) to find the optimal set of weights for attributes in the dataset. The experimental results show that the proposed method can significantly improve the classification accuracy when compared to the traditional KNN algorithm.
Topics & Concepts
Pearson product-moment correlation coefficientParticle swarm optimizationCorrelation coefficientComputer scienceCorrelationk-nearest neighbors algorithmPattern recognition (psychology)AlgorithmArtificial intelligenceSet (abstract data type)Data miningMathematicsMachine learningStatisticsGeometryProgramming languageData Mining Algorithms and ApplicationsFace and Expression RecognitionRough Sets and Fuzzy Logic