Litcius/Paper detail

An architecture for non-linear discovery of aggregated multimedia document web search results

Abdur Rehman Khan, Umer Rashid, Khalid Saleem, Adeel Ahmed

2021PeerJ Computer Science17 citationsDOIOpen Access PDF

Abstract

The recent proliferation of multimedia information on the web enhances user information need from simple textual lookup to multi-modal exploration activities. The current search engines act as major gateways to access the immense amount of multimedia data. However, access to the multimedia content is provided by aggregating disjoint multimedia search verticals. The aggregation of the multimedia search results cannot consider relationships in them and are partially blended. Additionally, the search results' presentation is via linear lists, which cannot support the users' non-linear navigation patterns to explore the multimedia search results. Contrarily, users' are demanding more services from search engines. It includes adequate access to navigate, explore, and discover multimedia information. Our discovery approach allow users to explore and discover multimedia information by semantically aggregating disjoint verticals using sentence embeddings and transforming snippets into conceptually similar multimedia document groups. The proposed aggregation approach retains the relationship in the retrieved multimedia search results. A non-linear graph is instantiated to augment the users' non-linear information navigation and exploration patterns, which leads to discovering new and interesting search results at various aggregated granularity levels. Our method's empirical evaluation results achieve 99% accuracy in the aggregation of disjoint search results at different aggregated search granularity levels. Our approach provides a standard baseline for the exploration of multimedia aggregation search results.

Topics & Concepts

Computer scienceInformation retrievalSearch engineMultimediaWorld Wide WebGraphDisjoint setsTheoretical computer scienceMathematicsCombinatoricsAdvanced Image and Video Retrieval TechniquesImage Retrieval and Classification TechniquesVideo Analysis and Summarization
An architecture for non-linear discovery of aggregated multimedia document web search results | Litcius