Neural Machine Translation with BERT for Post-OCR Error Detection and Correction
Thi Tuyet Haï Nguyen, Adam Jatowt, Nhu-Van Nguyen, Mickaël Coustaty, Antoine Doucet
Abstract
The quality of OCR has a direct impact on information access, and an indirect impact on the performance of natural language processing applications, making fine-grained (e.g., semantic) information access even harder. This work proposes a novel post-OCR approach based on a contextual language model and neural machine translation, aiming to improve the quality of OCRed text by detecting and rectifying erroneous tokens. This new technique obtains results comparable to the best-performing approaches on English datasets of the competition on post-OCR text correction in ICDAR 2017/2019.
Topics & Concepts
Computer scienceMachine translationArtificial intelligenceNatural language processingTranslation (biology)Optical character recognitionSpeech recognitionError detection and correctionQuality (philosophy)Pattern recognition (psychology)Image (mathematics)AlgorithmEpistemologyGeneBiochemistryMessenger RNAChemistryPhilosophyNatural Language Processing TechniquesTopic ModelingHandwritten Text Recognition Techniques