Emotion-Prior Awareness Network for Emotional Video Captioning
Peipei Song, Dan Guo, Xun Yang, Shengeng Tang, Erkun Yang, Meng Wang
Abstract
Emotional video captioning (EVC) is an emerging task to describe the factual content with the inherent emotion expressed in a video. It is crucial for the EVC task to effectively perceive subtle and ambiguous visual emotion cues in the stage of caption generation. However, existing captioning methods usually overlooked the learning of emotions in user-generated videos, thus making the generated sentence a bit boring and soulless.
Topics & Concepts
Closed captioningComputer scienceTask (project management)SentenceEmotion recognitionTask analysisMultimediaHuman–computer interactionNatural language processingArtificial intelligenceImage (mathematics)EngineeringSystems engineeringMultimodal Machine Learning ApplicationsVideo Analysis and SummarizationHuman Pose and Action Recognition