Litcius/Paper detail

PhotoHelper: Portrait Photographing Guidance Via Deep Feature Retrieval and Fusion

Nan Jiang, Bin Sheng, Ping Li, Tong‐Yee Lee

2022IEEE Transactions on Multimedia173 citationsDOI

Abstract

We introduce a new photographing guidance (PhotoHelper) for amateur photographers to enhance their portrait photo quality using deep feature retrieval and fusion. In our model, we comprehensively integrate empirical aesthetic rules, traditional machine learning algorithms and deep neural networks to extract different kinds of features in both color and space aspects. With these features, we build a modified random forest with a structured photograph collection to identify types of photos. We also define the composition matching score to measure the similarity between the given photo and the reference photo. By combining all of the above processes, a one-stop deep portrait photographing guidance is constructed to provide users with professional reference photographs that are similar to the current scene and automatically generate spatial composition guidance according to the user-selected reference photo. Experiments and evaluations show that the aesthetic quality of portrait photos can be significantly improved via the composition guidance of our photographing guidance approach.

Topics & Concepts

Computer scienceArtificial intelligenceComputer visionFeature (linguistics)Feature extractionPattern recognition (psychology)PortraitInformation retrievalArt historyPhilosophyArtLinguisticsAdvanced Image and Video Retrieval TechniquesVisual Attention and Saliency DetectionImage Retrieval and Classification Techniques