Evaluating Real-Time Search over Tweets
Dean McCullough, Jimmy Lin, Craig Macdonald, Iadh Ounis, Richard McCreadie
2021Proceedings of the International AAAI Conference on Web and Social Media36 citationsDOIOpen Access PDF
Abstract
Twitter offers a phenomenal platform for the social sharing of information. We describe new resources that have been created in the context of the Text Retrieval Conference (TREC) to support the academic study of Twitter as a real-time information source. We formalize an information seeking task — real-time search — and offer a methodology for measuring system effectiveness. At the TREC 2011 Microblog Track, 58 research groups participated in the first ever evaluation of this task. We present data from the effort to illustrate and support our methodology.
Topics & Concepts
MicrobloggingComputer scienceTask (project management)Social mediaInformation retrievalContext (archaeology)World Wide WebData scienceTrack (disk drive)Information sharingPaleontologyEconomicsManagementBiologyOperating systemExpert finding and Q&A systemsWeb Data Mining and AnalysisInformation Retrieval and Search Behavior