Litcius/Paper detail

The application of positive matrix factorization with diagnostics to BIG DATA

Philip K. Hopke, Yunle Chen, David Q. Rich, Dennis Mooibroek, Uwayemi M. Sofowote

2023Chemometrics and Intelligent Laboratory Systems33 citationsDOIOpen Access PDF

Abstract

Over the past decade, Positive Matrix Factorization (PMF) has become the most commonly used tool for source apportionment of air pollutants with a large fraction of those studies using the implementation developed by the U.S. Environmental Protection Agency (EPA-PMF) and its very useful diagnostic tools. During the same period, more studies are utilizing monitoring tools that provide hourly or even higher time resolution data leading to large data sets (millions of data points). Because of the nature of the graphic user interface in EPA-PMF, it cannot handle data sets more than approximately half a million data points. Thus, alternative approaches are needed to permit these larger data sets to be analyzed and still be able to provide the diagnostic outputs that permit better interpretations of the results. We have developed a protocol to use the multilinear engine (ME-2) that is the solver used in EPA-PMF to make such analyses. Here we report how to use this approach and present results for a representative data set of particle size distributions obtained in Rochester, New York between 2008 and 2019.

Topics & Concepts

Multilinear mapComputer scienceData setData miningMatrix decompositionSet (abstract data type)FactorizationBig dataSolverDatabaseStatisticsMathematicsAlgorithmArtificial intelligencePhysicsQuantum mechanicsEigenvalues and eigenvectorsPure mathematicsProgramming languageAir Quality Monitoring and ForecastingAtmospheric chemistry and aerosolsAir Quality and Health Impacts
The application of positive matrix factorization with diagnostics to BIG DATA | Litcius