Domain knowledge-assisted materials data anomaly detection towards constructing high-performance machine learning models
Yue Liu, Shuchang Ma, Zhengwei Yang, Duo Wu, Yali Zhao, Maxim Avdeev, Siqi Shi
Abstract
Machine learning (ML) is widely applied to accelerate materials design and discovery due to its outperforming capability of data analysis and information extraction. However, experimental and computational errors typically lead to emerging data anomalies, harming the performance of ML models. Most currently used anomaly detection methods are purely data-driven, which has limited capability of learning complicated factors in materials data. Here, we propose a domain knowledge-assisted data anomaly detection (DKA-DAD) workflow, where materials domain knowledge is encoded as symbolic rules. Three detection models are designed for evaluating the correctness of individual descriptor value, correlation between descriptors, and similarity between samples, respectively, and one modification model is constructed for comprehensive governance. We construct 180 synthetic datasets by injecting noise into 60 structured materials datasets collected from materials ML studies, to validate its potential utility and applications. DKA-DAD achieves a 12% F1-score improvement in anomaly detection accuracy on synthetic datasets compared to purely data-driven approach and the ML models trained on materials datasets processed through DKA exhibit an average 9.6% improvement in R 2 for the property prediction. Our work provides a data anomaly detecting approach under the guidance of materials domain knowledge towards accelerating materials design and discovery based on ML. • A domain knowledge-assisted data anomaly detection (DKA-DAD) workflow is first proposed. • Domain knowledge is symbolized and embedded into the 3 designed detection models for evaluation from different dimensions. • DKA-DAD governs 60 collected materials datasets with an average 9 % insight improvement, outperforming existing methods.