DiffusionSTR: Diffusion Model for Scene Text Recognition
Masato Fujitake
Abstract
This paper presents Diffusion Model for Scene Text Recognition (DiffusionSTR), an end-to-end text recognition framework using diffusion models for recognizing text in the wild. While existing studies have viewed the scene text recognition task as an image-to-text transformation, we rethought it as a text-text one under images in a diffusion model. We show for the first time that the diffusion model can be applied to text recognition. Furthermore, experimental results on publicly available datasets show that the proposed method achieves competitive accuracy compared to state-of-the-art methods.
Topics & Concepts
Text recognitionComputer scienceDiffusionArtificial intelligenceTask (project management)Transformation (genetics)Image (mathematics)Pattern recognition (psychology)Speech recognitionNatural language processingEngineeringGeneSystems engineeringBiochemistryChemistryPhysicsThermodynamicsHandwritten Text Recognition TechniquesImage Retrieval and Classification TechniquesMusic and Audio Processing