Towards Understanding the Mixture-Of-Experts Layer in Deep Learning
Zixiang Chen, Yihe Deng, Quanquan Gu, Yuanzhi Li, Yue Wu
Topics & Concepts
Deep learningLayer (electronics)Artificial intelligenceComputer scienceFeature (linguistics)Focus (optics)Key (lock)Perspective (graphical)Set (abstract data type)Artificial neural networkDomain Adaptation and Few-Shot LearningGenerative Adversarial Networks and Image SynthesisGaussian Processes and Bayesian Inference