Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation
Andrew Rouditchenko, Yuan Gong, Samuel Thomas, Leonid Karlinsky, Hilde Kuehne, Rogério Feris, James Glass
Topics & Concepts
Computer scienceAudio visualSpeech recognitionSpeech translationTranslation (biology)Natural language processingArtificial intelligenceMachine translationHuman–computer interactionMultimediaMessenger RNAChemistryGeneBiochemistryMusic and Audio Processing