Deep Autoencoder Neural Networks: A Comprehensive Review and New Perspectives

Ibomoiye Domor Mienye, Theo G. Swart

2025Archives of Computational Methods in Engineering65 citationsDOI Open Access PDF

Abstract

Abstract Autoencoders have become a fundamental technique in deep learning (DL), significantly enhancing representation learning across various domains, including image processing, anomaly detection, and generative modelling. This paper provides a comprehensive review of autoencoder architectures, from their inception and fundamental concepts to advanced implementations such as adversarial autoencoders, convolutional autoencoders, and variational autoencoders, examining their operational mechanisms, mathematical foundations, typical applications, and their role in generative modelling. The study contributes to the field by synthesizing existing knowledge, discussing recent advancements, new perspectives, and the practical implications of autoencoders in tackling modern machine learning (ML) challenges.

Topics & Concepts

AutoencoderDeep neural networksArtificial neural networkComputer scienceArtificial intelligenceGenerative Adversarial Networks and Image SynthesisAnomaly Detection Techniques and ApplicationsDomain Adaptation and Few-Shot Learning