Litcius/Paper detail

The effectiveness of moderating harmful online content

P. Schneider, Marian-Andrei Rizoiu

2023Proceedings of the National Academy of Sciences21 citationsDOIOpen Access PDF

Abstract

In 2022, the European Union introduced the Digital Services Act (DSA), a new legislation to report and moderate harmful content from online social networks. Trusted flaggers are mandated to identify harmful content, which platforms must remove within a set delay (currently 24 h). Here, we analyze the likely effectiveness of EU-mandated mechanisms for regulating highly viral online content with short half-lives. We deploy self-exciting point processes to determine the relationship between the regulated moderation delay and the likely harm reduction achieved. We find that harm reduction is achievable for the most harmful content, even for fast-paced platforms such as Twitter. Our method estimates moderation effectiveness for a given platform and provides a rule of thumb for selecting content for investigation and flagging, managing flaggers' workload.

Topics & Concepts

FlaggingInternet privacyModerationHarmDigital contentComputer scienceEuropean unionLegislationWorkloadSet (abstract data type)Point (geometry)BusinessComputer securityWorld Wide WebPsychologyPolitical scienceLawSocial psychologyInternational tradeHistoryGeometryOperating systemArchaeologyProgramming languageMachine learningMathematicsHate Speech and Cyberbullying DetectionMisinformation and Its ImpactsSocial Media and Politics