Learning Audio-Video Modalities from Image Captions
Arsha Nagrani, Paul Hongsuck Seo, Bryan Seybold, Anja Hauth, Santiago Manén, Chen Sun, Cordelia Schmid
Topics & Concepts
Closed captioningComputer scienceCLIPSPipeline (software)TransformerArtificial intelligenceSpeech recognitionMatching (statistics)Image (mathematics)PhysicsVoltageProgramming languageMathematicsQuantum mechanicsStatisticsMultimodal Machine Learning ApplicationsMusic and Audio ProcessingVideo Analysis and Summarization