Litcius/Paper detail

Text and Style Conditioned GAN for the Generation of Offline-Handwriting Lines

Brian L. Davis, Bryan S. Morse, Brian Price, Chris Tensmeyer, Curtis Wigington, Rajiv Jain

202017 citationsDOI

Abstract

This paper presents a GAN for generating images of handwritten lines conditioned on arbitrary text and latent style vectors. Unlike prior work, which produce stroke points or single-word images, this model generates entire lines of offline handwriting. The model produces variable-sized images by using style vectors to determine character widths. A generator network is trained with GAN and autoencoder techniques to learn style, and uses a pre-trained handwriting recognition network to induce legibility. A study using human evaluators demonstrates that the model produces images that appear to be written by a human. After training, the encoder network can extract a style vector from an image, allowing images in a similar style to be generated, but with arbitrary text.

Topics & Concepts

HandwritingComputer scienceAutoencoderArtificial intelligenceStyle (visual arts)Generator (circuit theory)Speech recognitionEncoderWriting styleIntelligent character recognitionArtificial neural networkHandwriting recognitionPattern recognition (psychology)Natural language processingComputer visionImage (mathematics)Feature extractionCharacter recognitionLinguisticsPower (physics)HistoryArchaeologyPhilosophyQuantum mechanicsPhysicsOperating systemHandwritten Text Recognition TechniquesGenerative Adversarial Networks and Image SynthesisImage Processing and 3D Reconstruction
Text and Style Conditioned GAN for the Generation of Offline-Handwriting Lines | Litcius