Litcius/Paper detail

Fully Complex-Valued Dendritic Neuron Model

Shangce Gao, MengChu Zhou, Ziqian Wang, Daiki Sugiyama, Jiujun Cheng, Jiahai Wang, Yuki Todo

2021IEEE Transactions on Neural Networks and Learning Systems94 citationsDOI

Abstract

A single dendritic neuron model (DNM) that owns the nonlinear information processing ability of dendrites has been widely used for classification and prediction. Complex-valued neural networks that consist of a number of multiple/deep-layer McCulloch-Pitts neurons have achieved great successes so far since neural computing was utilized for signal processing. Yet no complex value representations appear in single neuron architectures. In this article, we first extend DNM from a real-value domain to a complex-valued one. Performance of complex-valued DNM (CDNM) is evaluated through a complex XOR problem, a non-minimum phase equalization problem, and a real-world wind prediction task. Also, a comparative analysis on a set of elementary transcendental functions as an activation function is implemented and preparatory experiments are carried out for determining hyperparameters. The experimental results indicate that the proposed CDNM significantly outperforms real-valued DNM, complex-valued multi-layer perceptron, and other complex-valued neuron models.

Topics & Concepts

Computer scienceBiological neuron modelArtificial neural networkPerceptronArtificial intelligenceActivation functionSet (abstract data type)Multilayer perceptronValue (mathematics)AlgorithmMachine learningProgramming languageNeural Networks and ApplicationsNeural Networks and Reservoir ComputingAdvanced Memory and Neural Computing
Fully Complex-Valued Dendritic Neuron Model | Litcius