An outlier detection framework for Air Quality Index prediction using linear and ensemble models
Pradeep Kumar Dongre, Viral Patel, Upendra Bhoi, Nilesh Maltare
Abstract
The Air Quality Index (AQI) is a key indicator for assessing air quality and its associated health impacts. Accurate AQI calculations are crucial for reliable air quality assessments, but outliers in air quality data can distort these calculations, leading to inaccurate predictions. This paper presents a comprehensive framework for air quality prediction that integrates multiple outlier detection methods with machine learning models, focusing on enhancing the accuracy and robustness of predictions. The study investigates various outlier detection techniques, including the Interquartile Range (IQR), robust Z-score, and Mahalanobis distance, and evaluates their impact when integrated into machine learning models. Unlike traditional approaches that remove outliers without considering seasonal effects, this research proposes retaining extreme data points after seasonal validation to improve model generalization and prediction accuracy for unseen data. The framework is evaluated using a dataset from Jaipur city, testing multiple machine learning models, including linear regression, ensemble methods, and K-Nearest Neighbor (KNN) regression. Results show that the integrated framework significantly improves model performance, with the Extra Trees Regressor achieving the best results (MAE = 11.9161, RMSE = 16.1660, and R 2 = 0.8884) after refinement, compared to baseline performance (MAE = 12.6765, RMSE = 17.8452, and R 2 = 0.8737). This study demonstrates the empirical effectiveness of the proposed framework and provides practical guidelines for air quality prediction in real-world applications. • Applied several data pre-processing methods on air quality dataset. • Conducted outlier analysis using statistical techniques. • Seasonal analysis is recommended to identify and validate the outliers. • Used various linear models such as linear regression, lasso, and ridge regression. • The Extra Tree Regressor outperforms alternative models. • Show ensemble methods’ robustness in the presence of outliers over linear models.