Unconstrained On-line Handwriting Recognition with Recurrent Neural Networks

Neural Information Processing Systems

On-line handwriting recognition is unusual among sequence labelling tasks in that the underlying generator of the observed data, i.e. the movement of the pen, is recorded directly. However, the raw data can be difficult to interpret because each letter is spread over many pen locations. As a consequence, sophisticated pre-processing is required to obtain inputs suitable for conventional sequence labelling algorithms, such as HMMs. In this paper we describe a system capable of directly transcribing raw on-line handwriting data. The system consists of a recurrent neural network trained for sequence labelling, combined with a probabilistic language model. In experiments on an unconstrained on-line database, we record excellent results using either raw or pre-processed data, well outperforming a benchmark HMM in both cases.

AllAnalytics - James M. Connolly - Handwriting Recognition Meets Machine Learning


There are places in the tech space where we cease to stare in amazement about what the tech can do. Instead we whine that the tech can't do more. Take the case of handwriting recognition, whether it's what we scribble notes onto a tablet or when we scan handwritten text into a PC. We wish that it was smarter, that it recognized more characters and that the text was searchable and shareable. To be honest, I shouldn't say "we".

LSTM-based Handwriting Recognition by Google


Handwriting is a one of the challenge in NLP task. It is because it can be various among different people. Sometimes, "O" can be written as "0" while human begin has the capability to distinguish whether it is "O" or "0" from contextualize information. For example, "0" will be used in phone number while "O" will be used as part of English word. Another skill is lexicon searching.

Recognition-based Segmentation of On-Line Cursive Handwriting

Neural Information Processing Systems

This paper introduces a new recognition-based segmentation approach torecognizing online cursive handwriting from a database of 10,000 English words. The original input stream of z, y pen coordinates isencoded as a sequence of uniform stroke descriptions that are processed by six feed-forward neural-networks, each designed to recognize letters of different sizes. Words are then recognized by performing best-first search over the space of all possible segmentations. Resultsdemonstrate that the method is effective at both writer dependent recognition (1.7% to 15.5% error rate) and writer independent recognition (5.2% to 31.1% error rate). 1 Introduction With the advent of pen-based computers, the problem of automatically recognizing handwriting from the motions of a pen has gained much significance. Progress has been made in reading disjoint block letters [Weissman et.

Handwriting-Based Gender Classification Using End-to-End Deep Neural Networks

arXiv.org Machine Learning

Handwriting-based gender classification is a well-researched problem that has been approached mainly by traditional machine learning techniques. In this paper, we propose a novel deep learning-based approach for this task. Specifically, we present a convolutional neural network (CNN), which performs automatic feature extraction from a given handwritten image, followed by classification of the writer's gender. Also, we introduce a new dataset of labeled handwritten samples, in Hebrew and English, of 405 participants. Comparing the gender classification accuracy on this dataset against human examiners, our results show that the proposed deep learning-based approach is substantially more accurate than that of humans.