Urgent issues regarding real-time air quality monitoring data in India: Unveiling solutions and implications for policy and health
K.G. Vohra, S. Madhumitha, Abhishek Chakraborty, Hitansh Shah, Bharrathi AS., Jayaraju Pakki
Abstract
Deteriorating air quality in India has heightened the emphasis on air quality monitoring. This has resulted in a 16-fold increase in the number of Continuous Ambient Air Quality Monitoring Sites (CAAQMS) across the country over the last decade. The CAAQMS datasets are used globally, but concerns about data quality have also been raised. Missing is a comprehensive assessment quantifying the scale of these air quality data issues and the impact these have on policy- and health-relevant metrics. So, we develop the first open-source automated tool to identify and address data issues and apply it to six pollutants (PM 2.5 , PM 10 , NO, NO 2 , NO x , and O 3 ) from 213 CAAQMS in 2019–2023. Typical issues in CAAQMS datasets include similar values that repeat continuously for durations exceeding 24 h and outliers that occur at almost the same time every day. We also reveal hidden issues for nitrogen oxides (NO x ≈ NO + NO 2 ) that include (1) reporting of NO and NO 2 in units not compliant with the Central Pollution Control Board parameter reporting protocol and (2) inconsistency in data reporting when either NO or NO 2 is recorded as “Not Available” but valid NO x data is reported. The proportion of data influenced by consecutively similar observations and outliers has remained fairly consistent but sites affected by unit inconsistency issues have grown between 2019 and 2023. No significant difference in data quality issues was observed between CAAQMS maintained by central and state pollution control boards illustrating the country-wide extent of these issues. We find that removing consecutively similar observations and outliers changes annual mean pollutant concentrations by only <5% but correcting for the yet unaddressed issue of unit inconsistency increases annual mean NO 2 concentrations by a dramatic >80% for sites affected by it. We conducted a separate analysis to confirm that the unit inconsistency issue was not identified and addressed in multiple peer-reviewed studies examining the impact of the COVID-19 lockdown, and this is likely to have resulted in reporting of inaccurate absolute air quality improvements. A substantial impact of data cleaning on air quality-derived metrics is observed for nitrogen oxides. The impact is marginal for other pollutants. We find that after data cleaning, 23 sites in 2019 became non-compliant with national ambient air quality standards for NO 2 . Worsening of NO 2 data quality over the years increased the number of non-compliant sites to 45 in 2023 after using our tool. For PM 2.5 and PM 10 , fewer than 5 sites changed compliance post-data cleaning. Given marginal changes in concentrations of PM 2.5 and O 3 , premature mortality attributable to exposure to these in Delhi, Mumbai, and Kolkata changed only by <10% after data cleaning. The impact on premature mortality was substantial for exposure to NO 2, with NO 2 -related premature deaths increasing by 8–67% in the three megacities. These findings have implications for the global research community and policy formulation and underscore the urgent need for ratified CAAQMS data. • Typical issues include similar values that repeat continuously for durations exceeding 24 h and outliers that occur at almost the same time every day. • Novel issues of reporting of nitrogen dioxide (NO 2 ) in units not compliant with the parameter reporting protocol. • Addressing consecutively similar observations and outliers changes annual mean pollutant concentrations by only <5% but correcting for the yet unaddressed issue of unit inconsistency increases annual mean NO 2 concentrations by a dramatic >80%. • After data cleaning, 23 sites in 2019 and 45 in 2023 became non-compliant with NO 2 national ambient air quality standards. • It is likely that the unit inconsistency issue influenced the multiple assessments examining impact of the COVID-19 lockdown on NO 2 leading to reporting of inaccurate absolute air quality improvements.