Litcius/Paper detail

Prompt learning in computer vision: a survey

Yiming Lei, Jingqi Li, Zilong Li, Yuan Cao, Hongming Shan

2024Frontiers of Information Technology & Electronic Engineering22 citationsDOI

Abstract

Prompt learning has attracted broad attention in computer vision since the large pre-trained vision-language models (VLMs) exploded. Based on the close relationship between vision and language information built by VLM, prompt learning becomes a crucial technique in many important applications such as artificial intelligence generated content (AIGC). In this survey, we provide a progressive and comprehensive review of visual prompt learning as related to AIGC. We begin by introducing VLM, the foundation of visual prompt learning. Then, we review the vision prompt learning methods and prompt-guided generative models, and discuss how to improve the efficiency of adapting AIGC models to specific downstream tasks. Finally, we provide some promising research directions concerning prompt learning.

Topics & Concepts

Computer scienceArtificial intelligenceDeep learningVisual learningHuman–computer interactionPsychologyMathematics educationMultimodal Machine Learning ApplicationsDomain Adaptation and Few-Shot LearningAdvanced Image and Video Retrieval Techniques