Context-Free Word Importance Scores for Attacking Neural Networks
Nimrah Shakeel, Saifullah Shakeel
Abstract
Leave-One-Out (LOO) scores provide estimates of feature importance in neural networks, for adversarial attacks. In this work, we present context-free word scores as a query-efficient alternative. Experiments show that these approximations are quite effective for black box attacks on neural networks trained for text classification, particularly for CNNs. The model query count for this method scales as 0(vocan_size * model_input_length). It is independent of the number of examples and features to be perturbed. Received: 13 July 2022 | Revised: 18 July 2022 | Accepted: 24 August 2022 Conflicts of Interest The authors declare that they have no conflicts of interest to this work.
Topics & Concepts
Word (group theory)Context (archaeology)Artificial neural networkComputer scienceFeature (linguistics)Artificial intelligenceDeep neural networksMachine learningBlack boxPattern recognition (psychology)MathematicsLinguisticsPaleontologyBiologyGeometryPhilosophyAdversarial Robustness in Machine LearningAnomaly Detection Techniques and ApplicationsTopic Modeling