Early Exploration of Using ChatGPT for Log-based Anomaly Detection on Parallel File Systems Logs
Chris Egersdoerfer, Di Zhang, Dong Dai
Abstract
Log-based anomaly detection has been extensively studied to help detect complex runtime anomalies in production systems. However, existing techniques exhibit several common issues. First, they rely heavily on expert-labeled logs to discern anomalous behavior patterns. But labelling enough log data manually to effectively train deep neural networks may take too long. Second, they rely on numeric model prediction based on numeric vector input which causes model decisions to be largely non-interpretable by humans which further rules out targeted error correction.
Topics & Concepts
Computer scienceAnomaly detectionAnomaly (physics)Data miningArtificial neural networkSupport vector machineArtificial intelligencePhysicsCondensed matter physicsSoftware System Performance and ReliabilityNetwork Security and Intrusion DetectionSoftware Reliability and Analysis Research