OnLine Handwriting Recognition

Size: px
Start display at page:

Download "OnLine Handwriting Recognition"

Transcription

1 OnLine Handwriting Recognition (Master Course of HTR) Alejandro H. Toselli Departamento de Sistemas Informáticos y Computación Universidad Politécnica de Valencia February 26, 2008 A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 1 / 34

2 Outline 1 Introduction 2 Feature Extraction for On-Line HTR 3 DFT - Data Global Modelling 4 DFT - Data Local Modelling 5 Experimental Results A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 2 / 34

3 Introduction On-Line Handwriting Recognition Context Acquisition types: Video 01 Escáner Tabla Digitalizadora ON LINE OFF LINE Cámara Usual applications: Sign recognition and verification. Recognition of postal codes. Recognition of courtesy amount in bank checks. Transcription of ancient documents. A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 3 / 34

4 Motivations Introduction Time-based Feature Extraction adequate for using with HMM. Because of the similarity existing between the nature of on-line HTR and Speech recognition. Tamil HCR Competition. A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 4 / 34

5 Introduction Tamil HCR Competition - Motivation Isolated character samples of 156 Tamil characters. Written by native Tamil writers. Off-Line and On-Line corpus version. Some examples of Tamil s symbols: User 54 User 111 Evaluation criterion is the highest top-choice accuracy at zero reject rate labelled samples available for training purposes unlabelled samples available for testing purposes. A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 5 / 34

6 Introduction On-Line Recognition Representation On-Line handwriting is represented by a points sequence in R 2 space ordered in time. Parametric curve. A isolated handwritten character/word: A series of consecutive pen-downs and pen-up strokes. Each stroke is a sequence of coordinates (x t, y t ) t = 0..N 1. Some on-line devices included the pressure made on each point. A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 6 / 34

7 Feature Extraction for On-Line HTR Our Traditional Feature Extraction Seven Feature Extractions in function of the time: x t and y t coordinates normalized between 0 and. x t and y t first derivatives normalized between 0 and 1. x t and y t second derivatives. All derivatives are calculated using: curvature: f t = C c=1 (r t+c r t c ) 2 r C t {x t, y t,x c=1 c2 t, y t } k t = x t y t x t y t ( ) x t 2 + y t 3/2 2 A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 7 / 34

8 Feature Extraction for On-Line HTR DFT representation On-Line handwriting can be represented by a sequence of coordinates (x t, y t ) t = 0..N 1. also as a function f t : t (x t + iy t ) C, or f t : t (x t, y t ) R 2. Pair of Discrete Fourier Transforms: N 1 Direct Transform F n = f t e 2πi tn N Inverse Transform f t = 1 N t=0 N 1 n=0 F n e 2πi tn N A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 8 / 34

9 Feature Extraction for On-Line HTR Global/Local Data Modelling DFT Feature Extraction can be applied to: the whole character stroke - Global Data Modelling local stroke segments - Local Data Modelling We use two different classifiers: K-NN classifier for global data modelling. Continuous density HMMs for local data modelling. A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 9 / 34

10 DFT - Data Global Modelling Introduction - DFT Modelling Example Time Coord X Coord Y Time Amplitude 0 Frequency A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 10 / 34

11 DFT - Data Global Modelling Data Global Modelling - Direct DFT DFT feature extraction examples using the first 40 coefficients: Amplitude Amplitude 0 Amplitude 0 Amplitude 0 Amplitude 0 Frequency Frequency Frequency Frequency Frequency Amplitude Amplitude 0 Amplitude 0 Amplitude 0 Amplitude 10 Frequency Frequency Frequency Frequency Frequency A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 11 / 34

12 DFT - Data Global Modelling Data Global Modelling - Inverse DFT Examples of reconstructed samples considering different number of Fourier-Coefficients. Original 2 FC 4 FC 6 FC 12 FC 20 FC 30 FC 60 FC A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 12 / 34

13 DFT - Data Local Modelling Local Data Modelling Local DFT Features Extraction: Sliding-Window running through the whole stroke. Window size: 40 points. Moving step: 1 points. Hamming windows. A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 13 / 34

14 Demo 1 DFT - Data Local Modelling Exit from the Demo A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 14 / 34

15 Demo 1 DFT - Data Local Modelling Exit from the Demo A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 15 / 34

16 Demo 1 DFT - Data Local Modelling Exit from the Demo A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 16 / 34

17 Demo 1 DFT - Data Local Modelling Exit from the Demo A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 17 / 34

18 Demo 1 DFT - Data Local Modelling Exit from the Demo A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 18 / 34

19 Demo 1 DFT - Data Local Modelling Exit from the Demo A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 19 / 34

20 Demo 1 DFT - Data Local Modelling Exit from the Demo A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 20 / 34

21 Demo 1 DFT - Data Local Modelling Exit from the Demo A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 21 / 34

22 Demo 1 DFT - Data Local Modelling Exit from the Demo A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 22 / 34

23 Demo 1 DFT - Data Local Modelling Exit from the Demo A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 23 / 34

24 DFT - Data Local Modelling Sliding-Window Segments Org-Sign Spectrum Rbt-Sign 0 Org-Sign Spectrum Rbt-Sign A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 24 / 34

25 DFT - Data Local Modelling Assembling of Regenerated Stroke Segments Original Signal Reconstructed from 4 Fourier-Coefficients Sliding-Window, 40 points windows-size and 20 points moving-step. A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 25 / 34

26 Experimental Results Tamil Corpus Partition Isolated character samples of 156 Tamil characters. Written by native Tamil writers. Experiments carried out with 2 different versions of the corpus. Full version: Reduced version: Training Test Total #Writers #Samples Training Test Total #Writers #Samples A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 26 / 34

27 Experimental Results Classification Results with K-NN - Global Modelling Used feature extraction: First 20 Fourier coefficients. Coefficient are represented by real and imaginary parts. Experiments carried our with the full version of the corpus. K-NN WER(%) A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 27 / 34

28 Experimental Results HMM Classifier - Local Modelling HMM classifier specification: Left-to-Right topology. Number of states as a function of average class length. Mixture of Gaussian densities as probability emission per HMM state. Baum-Welch re-estimation algorithm for training process. Viterbi algorithm for test recognition for process. A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 28 / 34

29 Experimental Results DFT Application Problems Inconvenient: DFT applied to a complex function modulated by a Hamming filter. As alternatives, DFT was applied: on the angle function, defined as: a t = arctan y t. x t on x t and on y t in an independent way. Original Angle-Based Reconstruction A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 29 / 34

30 Experimental Results Results with Different DFT Application Schemes Experiments carried out with the reduced version of the corpus and using only DFT coefficients as features. #Gauss DFT-Complex DFT-Ang DFT-XYind A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 30 / 34

31 Experimental Results Experimental Validation of the Hamming Filter Experiments carried out with the reduced version of the corpus and using only DFT coefficients as features. #Gauss Hamming Rectangular A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 31 / 34

32 Experimental Results Classification Results with HMMs - Full Version Feature extraction: TFE: x and y normalized coordinates, their first and second derivatives, and curvature. FFC: First 4 Fourier transform coefficients (real and imaginary parts). #Gauss TFE FFC TFE+FFC A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 32 / 34

33 Experimental Results Tamil HCR Competition - Ranked List of Results Rank Recognition Accuracy Data-Entry on on on on on on on on off off off on off off off on on A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 33 / 34

34 Experimental Results Conclusions and Future Work DFT feature extraction complements time-based feature extraction. Experiments applying DFT on x t and on y t in an independent way. Test the feature extraction with the On-Line UNIPEN corpus. A.H. Toselli (ITI - UPV) OnLine Handwriting Recognition 34 / 34

Handwritten Text Recognition

Handwritten Text Recognition Handwritten Text Recognition M.J. Castro-Bleda, Joan Pasto Universidad Politécnica de Valencia Spain Zaragoza, March 2012 Text recognition () TRABHCI Zaragoza, March 2012 1 / 1 The problem: Handwriting

More information

Handwritten Text Recognition

Handwritten Text Recognition Handwritten Text Recognition M.J. Castro-Bleda, S. España-Boquera, F. Zamora-Martínez Universidad Politécnica de Valencia Spain Avignon, 9 December 2010 Text recognition () Avignon Avignon, 9 December

More information

Natural Language Inspired Approach for Handwritten Text Line Detection in Legacy Documents

Natural Language Inspired Approach for Handwritten Text Line Detection in Legacy Documents Natural Language Inspired Approach for Handwritten Text Line Detection in Legacy Documents Vicente Bosch vbosch@iti.upv.es Alejandro Hector Toselli ahector@iti.upv.es Enrique Vidal evidal@iti.upv.es Pattern

More information

A Visualization Tool to Improve the Performance of a Classifier Based on Hidden Markov Models

A Visualization Tool to Improve the Performance of a Classifier Based on Hidden Markov Models A Visualization Tool to Improve the Performance of a Classifier Based on Hidden Markov Models Gleidson Pegoretti da Silva, Masaki Nakagawa Department of Computer and Information Sciences Tokyo University

More information

Evaluation of Brute-Force Attack to Dynamic Signature Verification Using Synthetic Samples

Evaluation of Brute-Force Attack to Dynamic Signature Verification Using Synthetic Samples 29 th International Conference on Document Analysis and Recognition Evaluation of Brute-Force Attack to Dynamic Signature Verification Using Synthetic Samples Javier Galbally, Julian Fierrez, Marcos Martinez-Diaz,

More information

HMM-Based Handwritten Amharic Word Recognition with Feature Concatenation

HMM-Based Handwritten Amharic Word Recognition with Feature Concatenation 009 10th International Conference on Document Analysis and Recognition HMM-Based Handwritten Amharic Word Recognition with Feature Concatenation Yaregal Assabie and Josef Bigun School of Information Science,

More information

Comparison of Bernoulli and Gaussian HMMs using a vertical repositioning technique for off-line handwriting recognition

Comparison of Bernoulli and Gaussian HMMs using a vertical repositioning technique for off-line handwriting recognition 2012 International Conference on Frontiers in Handwriting Recognition Comparison of Bernoulli and Gaussian HMMs using a vertical repositioning technique for off-line handwriting recognition Patrick Doetsch,

More information

Recognition of online captured, handwritten Tamil words on Android

Recognition of online captured, handwritten Tamil words on Android Recognition of online captured, handwritten Tamil words on Android A G Ramakrishnan and Bhargava Urala K Medical Intelligence and Language Engineering (MILE) Laboratory, Dept. of Electrical Engineering,

More information

Interactive Handwritten Text Recognition and Indexing of Historical Documents: the transcriptorum Project

Interactive Handwritten Text Recognition and Indexing of Historical Documents: the transcriptorum Project Interactive Handwritten Text Recognition and ing of Historical Documents: the transcriptorum Project Alejandro H. Toselli ahector@prhlt.upv.es Pattern Recognition and Human Language Technology Reseach

More information

Invariant Recognition of Hand-Drawn Pictograms Using HMMs with a Rotating Feature Extraction

Invariant Recognition of Hand-Drawn Pictograms Using HMMs with a Rotating Feature Extraction Invariant Recognition of Hand-Drawn Pictograms Using HMMs with a Rotating Feature Extraction Stefan Müller, Gerhard Rigoll, Andreas Kosmala and Denis Mazurenok Department of Computer Science, Faculty of

More information

Contents. Resumen. List of Acronyms. List of Mathematical Symbols. List of Figures. List of Tables. I Introduction 1

Contents. Resumen. List of Acronyms. List of Mathematical Symbols. List of Figures. List of Tables. I Introduction 1 Contents Agraïments Resum Resumen Abstract List of Acronyms List of Mathematical Symbols List of Figures List of Tables VII IX XI XIII XVIII XIX XXII XXIV I Introduction 1 1 Introduction 3 1.1 Motivation...

More information

HTR Part II: Handwritten Text Recognition

HTR Part II: Handwritten Text Recognition HTR Part II: Handwritten Text Recognition Preprocessing and Feature Extraction for Off-Line Continuous HTR Alejandro H. Toselli & PRHLT-Group Departamento de Sistemas Informáticos y Computación Universidad

More information

TRAINING ON-LINE HANDWRITING RECOGNIZERS USING SYNTHETICALLY GENERATED TEXT

TRAINING ON-LINE HANDWRITING RECOGNIZERS USING SYNTHETICALLY GENERATED TEXT TRAINING ON-LINE HANDWRITING RECOGNIZERS USING SYNTHETICALLY GENERATED TEXT Daniel Martín-Albo, Réjean Plamondon * and Enrique Vidal PRHLT Research Center Universitat Politècnica de València * Laboratoire

More information

Isolated Curved Gurmukhi Character Recognition Using Projection of Gradient

Isolated Curved Gurmukhi Character Recognition Using Projection of Gradient International Journal of Computational Intelligence Research ISSN 0973-1873 Volume 13, Number 6 (2017), pp. 1387-1396 Research India Publications http://www.ripublication.com Isolated Curved Gurmukhi Character

More information

A Feature based on Encoding the Relative Position of a Point in the Character for Online Handwritten Character Recognition

A Feature based on Encoding the Relative Position of a Point in the Character for Online Handwritten Character Recognition A Feature based on Encoding the Relative Position of a Point in the Character for Online Handwritten Character Recognition Dinesh Mandalapu, Sridhar Murali Krishna HP Laboratories India HPL-2007-109 July

More information

Modeling time series with hidden Markov models

Modeling time series with hidden Markov models Modeling time series with hidden Markov models Advanced Machine learning 2017 Nadia Figueroa, Jose Medina and Aude Billard Time series data Barometric pressure Temperature Data Humidity Time What s going

More information

Segmentation of Kannada Handwritten Characters and Recognition Using Twelve Directional Feature Extraction Techniques

Segmentation of Kannada Handwritten Characters and Recognition Using Twelve Directional Feature Extraction Techniques Segmentation of Kannada Handwritten Characters and Recognition Using Twelve Directional Feature Extraction Techniques 1 Lohitha B.J, 2 Y.C Kiran 1 M.Tech. Student Dept. of ISE, Dayananda Sagar College

More information

Lecture 8 Object Descriptors

Lecture 8 Object Descriptors Lecture 8 Object Descriptors Azadeh Fakhrzadeh Centre for Image Analysis Swedish University of Agricultural Sciences Uppsala University 2 Reading instructions Chapter 11.1 11.4 in G-W Azadeh Fakhrzadeh

More information

VIRTUAL SHAPE RECOGNITION USING LEAP MOTION. David Lavy and Dung Pham

VIRTUAL SHAPE RECOGNITION USING LEAP MOTION. David Lavy and Dung Pham VIRTUAL SHAPE RECOGNITION USING LEAP MOTION David Lavy and Dung Pham Boston University Department of Electrical and Computer Engineering 8 Saint Mary s Street Boston, MA 02215 www.bu.edu/ece May. 03, 2015

More information

A Comparison of Sequence-Trained Deep Neural Networks and Recurrent Neural Networks Optical Modeling For Handwriting Recognition

A Comparison of Sequence-Trained Deep Neural Networks and Recurrent Neural Networks Optical Modeling For Handwriting Recognition A Comparison of Sequence-Trained Deep Neural Networks and Recurrent Neural Networks Optical Modeling For Handwriting Recognition Théodore Bluche, Hermann Ney, Christopher Kermorvant SLSP 14, Grenoble October

More information

Online Mathematical Symbol Recognition using SVMs with Features from Functional Approximation

Online Mathematical Symbol Recognition using SVMs with Features from Functional Approximation Online Mathematical Symbol Recognition using SVMs with Features from Functional Approximation Birendra Keshari and Stephen M. Watt Ontario Research Centre for Computer Algebra Department of Computer Science

More information

IDIAP. Martigny - Valais - Suisse IDIAP

IDIAP. Martigny - Valais - Suisse IDIAP R E S E A R C H R E P O R T IDIAP Martigny - Valais - Suisse Off-Line Cursive Script Recognition Based on Continuous Density HMM Alessandro Vinciarelli a IDIAP RR 99-25 Juergen Luettin a IDIAP December

More information

Natural Language Inspired Approach for Handwritten Text Line Detection in Legacy Documents

Natural Language Inspired Approach for Handwritten Text Line Detection in Legacy Documents Natural Language Inspired Approach for Handwritten Text Line Detection in Legacy Documents Vicente Bosch Campos vbosch@iti.upv.es Alejandro Héctor Toselli ahector@iti.upv.es Enrique Vidal evidal@iti.upv.es

More information

Handwritten word verification by SVM-based hypotheses re-scoring and multiple thresholds rejection

Handwritten word verification by SVM-based hypotheses re-scoring and multiple thresholds rejection Author manuscript, published in "International Conference on Frontiers in Handwriting Recognition (2010)" Handwritten word verification by SVM-based hypotheses re-scoring and multiple thresholds rejection

More information

Chapter Review of HCR

Chapter Review of HCR Chapter 3 [3]Literature Review The survey of literature on character recognition showed that some of the researchers have worked based on application requirements like postal code identification [118],

More information

ECE521: Week 11, Lecture March 2017: HMM learning/inference. With thanks to Russ Salakhutdinov

ECE521: Week 11, Lecture March 2017: HMM learning/inference. With thanks to Russ Salakhutdinov ECE521: Week 11, Lecture 20 27 March 2017: HMM learning/inference With thanks to Russ Salakhutdinov Examples of other perspectives Murphy 17.4 End of Russell & Norvig 15.2 (Artificial Intelligence: A Modern

More information

Hidden Markov Models. Slides adapted from Joyce Ho, David Sontag, Geoffrey Hinton, Eric Xing, and Nicholas Ruozzi

Hidden Markov Models. Slides adapted from Joyce Ho, David Sontag, Geoffrey Hinton, Eric Xing, and Nicholas Ruozzi Hidden Markov Models Slides adapted from Joyce Ho, David Sontag, Geoffrey Hinton, Eric Xing, and Nicholas Ruozzi Sequential Data Time-series: Stock market, weather, speech, video Ordered: Text, genes Sequential

More information

A Fast Approximated k Median Algorithm

A Fast Approximated k Median Algorithm A Fast Approximated k Median Algorithm Eva Gómez Ballester, Luisa Micó, Jose Oncina Universidad de Alicante, Departamento de Lenguajes y Sistemas Informáticos {eva, mico,oncina}@dlsi.ua.es Abstract. The

More information

Mono-font Cursive Arabic Text Recognition Using Speech Recognition System

Mono-font Cursive Arabic Text Recognition Using Speech Recognition System Mono-font Cursive Arabic Text Recognition Using Speech Recognition System M.S. Khorsheed Computer & Electronics Research Institute, King AbdulAziz City for Science and Technology (KACST) PO Box 6086, Riyadh

More information

HANDWRITTEN GURMUKHI CHARACTER RECOGNITION USING WAVELET TRANSFORMS

HANDWRITTEN GURMUKHI CHARACTER RECOGNITION USING WAVELET TRANSFORMS International Journal of Electronics, Communication & Instrumentation Engineering Research and Development (IJECIERD) ISSN 2249-684X Vol.2, Issue 3 Sep 2012 27-37 TJPRC Pvt. Ltd., HANDWRITTEN GURMUKHI

More information

Segmentation free Bangla OCR using HMM: Training and Recognition

Segmentation free Bangla OCR using HMM: Training and Recognition Segmentation free Bangla OCR using HMM: Training and Recognition Md. Abul Hasnat, S.M. Murtoza Habib, Mumit Khan BRAC University, Bangladesh mhasnat@gmail.com, murtoza@gmail.com, mumit@bracuniversity.ac.bd

More information

Pit Pattern Classification of Zoom-Endoscopic Colon Images using D

Pit Pattern Classification of Zoom-Endoscopic Colon Images using D Pit Pattern Classification of Zoom-Endoscopic Colon Images using DCT and FFT Leonhard Brunauer Hannes Payer Robert Resch Department of Computer Science University of Salzburg February 1, 2007 Outline 1

More information

Hidden Markov Model for Sequential Data

Hidden Markov Model for Sequential Data Hidden Markov Model for Sequential Data Dr.-Ing. Michelle Karg mekarg@uwaterloo.ca Electrical and Computer Engineering Cheriton School of Computer Science Sequential Data Measurement of time series: Example:

More information

Viterbi Based Alignment between Text Images and their Transcripts

Viterbi Based Alignment between Text Images and their Transcripts Viteri Based Alignment etween Text Images and their Transcripts Alejandro H. Toselli, Verónica Romero and Enrique Vidal Institut Tecnològic d Informàtica Universitat Politècnica de València Camí de Vera

More information

Implicit segmentation of Kannada characters in offline handwriting recognition using hidden Markov models

Implicit segmentation of Kannada characters in offline handwriting recognition using hidden Markov models 1 Implicit segmentation of Kannada characters in offline handwriting recognition using hidden Markov models Manasij Venkatesh, Vikas Majjagi, and Deepu Vijayasenan arxiv:1410.4341v1 [cs.lg] 16 Oct 2014

More information

Hierarchical Shape Primitive Features for Online Text-independent Writer Identification

Hierarchical Shape Primitive Features for Online Text-independent Writer Identification 2009 10th International Conference on Document Analysis and Recognition Hierarchical Shape Primitive Features for Online Text-independent Writer Identification Bangy Li, Zhenan Sun and Tieniu Tan Center

More information

Individuality of Handwritten Characters

Individuality of Handwritten Characters Accepted by the 7th International Conference on Document Analysis and Recognition, Edinburgh, Scotland, August 3-6, 2003. (Paper ID: 527) Individuality of Handwritten s Bin Zhang Sargur N. Srihari Sangjik

More information

Robust Optical Character Recognition under Geometrical Transformations

Robust Optical Character Recognition under Geometrical Transformations www.ijocit.org & www.ijocit.ir ISSN = 2345-3877 Robust Optical Character Recognition under Geometrical Transformations Mohammad Sadegh Aliakbarian 1, Fatemeh Sadat Saleh 2, Fahimeh Sadat Saleh 3, Fatemeh

More information

HMM-Based On-Line Recognition of Handwritten Whiteboard Notes

HMM-Based On-Line Recognition of Handwritten Whiteboard Notes HMM-Based On-Line Recognition of Handwritten Whiteboard Notes Marcus Liwicki and Horst Bunke Institute of Computer Science and Applied Mathematics University of Bern, Neubrückstrasse 10, CH-3012 Bern,

More information

An Efficient on-line Signature Verification System Using Histogram Features

An Efficient on-line Signature Verification System Using Histogram Features RESEARCH ARTICLE OPEN ACCESS An Efficient on-line Signature Verification System Using Histogram Features Mr.Abilash S 1, Mrs.M.Janani, M.E 2 ME Computer Science and Engineering,Department of CSE, Annai

More information

ModelStructureSelection&TrainingAlgorithmsfor an HMMGesture Recognition System

ModelStructureSelection&TrainingAlgorithmsfor an HMMGesture Recognition System ModelStructureSelection&TrainingAlgorithmsfor an HMMGesture Recognition System Nianjun Liu, Brian C. Lovell, Peter J. Kootsookos, and Richard I.A. Davis Intelligent Real-Time Imaging and Sensing (IRIS)

More information

PCA-based Offline Handwritten Character Recognition System

PCA-based Offline Handwritten Character Recognition System Smart Computing Review, vol. 3, no. 5, October 2013 346 Smart Computing Review PCA-based Offline Handwritten Character Recognition System Munish Kumar 1, M. K. Jindal 2, and R. K. Sharma 3 1 Computer Science

More information

ONLINE SIGNATURE VERIFICATION TECHNIQUES

ONLINE SIGNATURE VERIFICATION TECHNIQUES ONLINE SIGNATURE VERIFICATION TECHNIQUES A THESIS SUBMITTED IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF Master of Technology In Telematics and Signal Processing By KIRAN KUMAR GURRALA

More information

The Interpersonal and Intrapersonal Variability Influences on Off- Line Signature Verification Using HMM

The Interpersonal and Intrapersonal Variability Influences on Off- Line Signature Verification Using HMM The Interpersonal and Intrapersonal Variability Influences on Off- Line Signature Verification Using HMM EDSON J. R. JUSTINO 1 FLÁVIO BORTOLOZZI 1 ROBERT SABOURIN 2 1 PUCPR - Pontifícia Universidade Católica

More information

The UJIpenchars Database: A Pen-Based Database of Isolated Handwritten Characters

The UJIpenchars Database: A Pen-Based Database of Isolated Handwritten Characters The UJIpenchars Database: A Pen-Based Database of Isolated Handwritten Characters D. Llorens, F. Prat, A. Marzal, J. M. Vilar, M. J. Castro, J. C. Amengual, S. Barrachina, A. Castellanos, S. España, J.

More information

Writer Authentication Based on the Analysis of Strokes

Writer Authentication Based on the Analysis of Strokes Writer Authentication Based on the Analysis of Strokes Kun Yu, Yunhong Wang, Tieniu Tan * NLPR, Institute of Automation, Chinese Academy of Sciences, Beijing, 00080 P.R.China ABSTRACT This paper presents

More information

Implementing a Speech Recognition System on a GPU using CUDA. Presented by Omid Talakoub Astrid Yi

Implementing a Speech Recognition System on a GPU using CUDA. Presented by Omid Talakoub Astrid Yi Implementing a Speech Recognition System on a GPU using CUDA Presented by Omid Talakoub Astrid Yi Outline Background Motivation Speech recognition algorithm Implementation steps GPU implementation strategies

More information

RECOGNITION FOR LARGE SETS OF HANDWRITTEN MATHEMATICAL SYMBOLS. Stephen M. Watt and Xiaofang Xie

RECOGNITION FOR LARGE SETS OF HANDWRITTEN MATHEMATICAL SYMBOLS. Stephen M. Watt and Xiaofang Xie RECOGNITION FOR LARGE SETS OF HANDWRITTEN MATHEMATICAL SYMBOLS Stephen M. Watt and Xiaofang Xie Dept. of Computer Science University of Western Ontario London Ontario, Canada N6A 5B7 {watt,maggie}@csd.uwo.ca

More information

Introduction to HTK Toolkit

Introduction to HTK Toolkit Introduction to HTK Toolkit Berlin Chen 2003 Reference: - The HTK Book, Version 3.2 Outline An Overview of HTK HTK Processing Stages Data Preparation Tools Training Tools Testing Tools Analysis Tools Homework:

More information

LECTURE 6 TEXT PROCESSING

LECTURE 6 TEXT PROCESSING SCIENTIFIC DATA COMPUTING 1 MTAT.08.042 LECTURE 6 TEXT PROCESSING Prepared by: Amnir Hadachi Institute of Computer Science, University of Tartu amnir.hadachi@ut.ee OUTLINE Aims Character Typology OCR systems

More information

Dietrich Paulus Joachim Hornegger. Pattern Recognition of Images and Speech in C++

Dietrich Paulus Joachim Hornegger. Pattern Recognition of Images and Speech in C++ Dietrich Paulus Joachim Hornegger Pattern Recognition of Images and Speech in C++ To Dorothea, Belinda, and Dominik In the text we use the following names which are protected, trademarks owned by a company

More information

Lecture 5: Frequency Domain Transformations

Lecture 5: Frequency Domain Transformations #1 Lecture 5: Frequency Domain Transformations Saad J Bedros sbedros@umn.edu From Last Lecture Spatial Domain Transformation Point Processing for Enhancement Area/Mask Processing Transformations Image

More information

Biology 644: Bioinformatics

Biology 644: Bioinformatics A statistical Markov model in which the system being modeled is assumed to be a Markov process with unobserved (hidden) states in the training data. First used in speech and handwriting recognition In

More information

Comparing Natural and Synthetic Training Data for Off-line Cursive Handwriting Recognition

Comparing Natural and Synthetic Training Data for Off-line Cursive Handwriting Recognition Comparing Natural and Synthetic Training Data for Off-line Cursive Handwriting Recognition Tamás Varga and Horst Bunke Institut für Informatik und angewandte Mathematik, Universität Bern Neubrückstrasse

More information

A Simplistic Way of Feature Extraction Directed towards a Better Recognition Accuracy

A Simplistic Way of Feature Extraction Directed towards a Better Recognition Accuracy International Journal of Engineering Research and Development e-issn: 2278-067X, p-issn: 2278-800X, www.ijerd.com Volume 3, Issue 7 (September 2012), PP. 43-49 A Simplistic Way of Feature Extraction Directed

More information

On-line One Stroke Character Recognition Using Directional Features

On-line One Stroke Character Recognition Using Directional Features On-line One Stroke Character Recognition Using Directional Features Blind for review process 1 1 Blind for review process Abstract. This paper presents a method based on directional features for recognizing

More information

A reevaluation and benchmark of hidden Markov Models

A reevaluation and benchmark of hidden Markov Models 04-09-2014 1 A reevaluation and benchmark of hidden Markov Models Jean-Paul van Oosten Prof. Lambert Schomaker 04-09-2014 2 Hidden Markov model fields & variants Automatic speech recognition Gene sequence

More information

A Combined Method for On-Line Signature Verification

A Combined Method for On-Line Signature Verification BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 14, No 2 Sofia 2014 Print ISSN: 1311-9702; Online ISSN: 1314-4081 DOI: 10.2478/cait-2014-0022 A Combined Method for On-Line

More information

Off-line signature verification: a comparison between human and machine performance

Off-line signature verification: a comparison between human and machine performance Off-line signature verification: a comparison between human and machine performance J. Coetzer B.M. Herbst J.A. du Preez Mathematical Sciences, jcoetzer@sun.ac.za Mathematical Sciences, herbst@dip.sun.ac.za

More information

7.1 INTRODUCTION Wavelet Transform is a popular multiresolution analysis tool in image processing and

7.1 INTRODUCTION Wavelet Transform is a popular multiresolution analysis tool in image processing and Chapter 7 FACE RECOGNITION USING CURVELET 7.1 INTRODUCTION Wavelet Transform is a popular multiresolution analysis tool in image processing and computer vision, because of its ability to capture localized

More information

Online Signature Verification Technique

Online Signature Verification Technique Volume 3, Issue 1 ISSN: 2320-5288 International Journal of Engineering Technology & Management Research Journal homepage: www.ijetmr.org Online Signature Verification Technique Ankit Soni M Tech Student,

More information

Latent Variable Models for Structured Prediction and Content-Based Retrieval

Latent Variable Models for Structured Prediction and Content-Based Retrieval Latent Variable Models for Structured Prediction and Content-Based Retrieval Ariadna Quattoni Universitat Politècnica de Catalunya Joint work with Borja Balle, Xavier Carreras, Adrià Recasens, Antonio

More information

An Introduction to Pattern Recognition

An Introduction to Pattern Recognition An Introduction to Pattern Recognition Speaker : Wei lun Chao Advisor : Prof. Jian-jiun Ding DISP Lab Graduate Institute of Communication Engineering 1 Abstract Not a new research field Wide range included

More information

Recognition of Unconstrained Malayalam Handwritten Numeral

Recognition of Unconstrained Malayalam Handwritten Numeral Recognition of Unconstrained Malayalam Handwritten Numeral U. Pal, S. Kundu, Y. Ali, H. Islam and N. Tripathy C VPR Unit, Indian Statistical Institute, Kolkata-108, India Email: umapada@isical.ac.in Abstract

More information

Bag-of-Features Representations for Offline Handwriting Recognition Applied to Arabic Script

Bag-of-Features Representations for Offline Handwriting Recognition Applied to Arabic Script 2012 International Conference on Frontiers in Handwriting Recognition Bag-of-Features Representations for Offline Handwriting Recognition Applied to Arabic Script Leonard Rothacker, Szilárd Vajda, Gernot

More information

CHAPTER 1 INTRODUCTION

CHAPTER 1 INTRODUCTION CHAPTER 1 INTRODUCTION 1.1 Introduction Pattern recognition is a set of mathematical, statistical and heuristic techniques used in executing `man-like' tasks on computers. Pattern recognition plays an

More information

Handwritten Gurumukhi Character Recognition by using Recurrent Neural Network

Handwritten Gurumukhi Character Recognition by using Recurrent Neural Network 139 Handwritten Gurumukhi Character Recognition by using Recurrent Neural Network Harmit Kaur 1, Simpel Rani 2 1 M. Tech. Research Scholar (Department of Computer Science & Engineering), Yadavindra College

More information

On Adaptive Confidences for Critic-Driven Classifier Combining

On Adaptive Confidences for Critic-Driven Classifier Combining On Adaptive Confidences for Critic-Driven Classifier Combining Matti Aksela and Jorma Laaksonen Neural Networks Research Centre Laboratory of Computer and Information Science P.O.Box 5400, Fin-02015 HUT,

More information

A Deep Learning primer

A Deep Learning primer A Deep Learning primer Riccardo Zanella r.zanella@cineca.it SuperComputing Applications and Innovation Department 1/21 Table of Contents Deep Learning: a review Representation Learning methods DL Applications

More information

Research Report on Bangla OCR Training and Testing Methods

Research Report on Bangla OCR Training and Testing Methods Research Report on Bangla OCR Training and Testing Methods Md. Abul Hasnat BRAC University, Dhaka, Bangladesh. hasnat@bracu.ac.bd Abstract In this paper we present the training and recognition mechanism

More information

Digital Image Processing

Digital Image Processing Digital Image Processing Part 9: Representation and Description AASS Learning Systems Lab, Dep. Teknik Room T1209 (Fr, 11-12 o'clock) achim.lilienthal@oru.se Course Book Chapter 11 2011-05-17 Contents

More information

SIMPLE AND EFFECTIVE FEATURE EXTRACTION FOR OPTICAL CHARACTER RECOGNITION *

SIMPLE AND EFFECTIVE FEATURE EXTRACTION FOR OPTICAL CHARACTER RECOGNITION * SIMPLE AND EFFECTIVE FEATURE EXTRACTION FOR OPTICAL CHARACTER RECOGNITION * JUAN-CARLOS PEREZ Departamento de Sistemas Informáticos y Computación. Universidad Politécnica de Valencia. 46071 Valencia, SPAIN.

More information

An Introduction to Hidden Markov Models

An Introduction to Hidden Markov Models An Introduction to Hidden Markov Models Max Heimel Fachgebiet Datenbanksysteme und Informationsmanagement Technische Universität Berlin http://www.dima.tu-berlin.de/ 07.10.2010 DIMA TU Berlin 1 Agenda

More information

On-Line Handwriting Recognition Using. Hidden Markov Models

On-Line Handwriting Recognition Using. Hidden Markov Models On-Line Handwriting Recognition Using Hidden Markov Models by Han Shu S. B., Electrical Engineering and Computer Science Massachusetts Institute of Technology (1996) Submitted to the Department of Electrical

More information

Tutorial of Origin 7.0. Chuang Tan, Zheyun Liu

Tutorial of Origin 7.0. Chuang Tan, Zheyun Liu Tutorial of Origin 7.0 Chuang Tan, Zheyun Liu Origin is a kind of powerful software for numerical manipulation and data analysis. Here is a brief tutorial that explains how to do the numerical Fourier

More information

Voice Command Based Computer Application Control Using MFCC

Voice Command Based Computer Application Control Using MFCC Voice Command Based Computer Application Control Using MFCC Abinayaa B., Arun D., Darshini B., Nataraj C Department of Embedded Systems Technologies, Sri Ramakrishna College of Engineering, Coimbatore,

More information

9. Lecture Neural Networks

9. Lecture Neural Networks Soft Control (AT 3, RMA) 9. Lecture Neural Networks Application in Automation Engineering Outline of the lecture 1. Introduction to Soft Control: definition and limitations, basics of "smart" systems 2.

More information

Writer Identification In Music Score Documents Without Staff-Line Removal

Writer Identification In Music Score Documents Without Staff-Line Removal Writer Identification In Music Score Documents Without Staff-Line Removal Anirban Hati, Partha P. Roy and Umapada Pal Computer Vision and Pattern Recognition Unit Indian Statistical Institute Kolkata,

More information

A Performance Evaluation of HMM and DTW for Gesture Recognition

A Performance Evaluation of HMM and DTW for Gesture Recognition A Performance Evaluation of HMM and DTW for Gesture Recognition Josep Maria Carmona and Joan Climent Barcelona Tech (UPC), Spain Abstract. It is unclear whether Hidden Markov Models (HMMs) or Dynamic Time

More information

Digital Image Processing

Digital Image Processing Digital Image Processing Third Edition Rafael C. Gonzalez University of Tennessee Richard E. Woods MedData Interactive PEARSON Prentice Hall Pearson Education International Contents Preface xv Acknowledgments

More information

Effect of Initial HMM Choices in Multiple Sequence Training for Gesture Recognition

Effect of Initial HMM Choices in Multiple Sequence Training for Gesture Recognition Effect of Initial HMM Choices in Multiple Sequence Training for Gesture Recognition Nianjun Liu, Richard I.A. Davis, Brian C. Lovell and Peter J. Kootsookos Intelligent Real-Time Imaging and Sensing (IRIS)

More information

Outline. Visualization Discretization Sampling Quantization Representation Continuous Discrete. Noise

Outline. Visualization Discretization Sampling Quantization Representation Continuous Discrete. Noise Fundamentals Data Outline Visualization Discretization Sampling Quantization Representation Continuous Discrete Noise 2 Data Data : Function dependent on one or more variables. Example Audio (1D) - depends

More information

GYROPHONE RECOGNIZING SPEECH FROM GYROSCOPE SIGNALS. Yan Michalevsky (1), Gabi Nakibly (2) and Dan Boneh (1)

GYROPHONE RECOGNIZING SPEECH FROM GYROSCOPE SIGNALS. Yan Michalevsky (1), Gabi Nakibly (2) and Dan Boneh (1) GYROPHONE RECOGNIZING SPEECH FROM GYROSCOPE SIGNALS Yan Michalevsky (1), Gabi Nakibly (2) and Dan Boneh (1) (1) Stanford University (2) National Research and Simulation Center, Rafael Ltd. 0 MICROPHONE

More information

Online Text-independent Writer Identification Based on Temporal Sequence and Shape Codes

Online Text-independent Writer Identification Based on Temporal Sequence and Shape Codes 2009 10th International Conference on Document Analysis and Recognition Online Text-independent Writer Identification Based on Temporal Sequence and Shape Codes Bangy Li and Tieniu Tan Center for Biometrics

More information

Page 1. Interface Input Modalities. Lecture 5a: Advanced Input. Keyboard input. Keyboard input

Page 1. Interface Input Modalities. Lecture 5a: Advanced Input. Keyboard input. Keyboard input Interface Input Modalities Lecture 5a: Advanced Input How can a user give input to an interface? keyboard mouse, touch pad joystick touch screen pen / stylus speech other more error! harder! (?) CS 530:

More information

EM Algorithm with Split and Merge in Trajectory Clustering for Automatic Speech Recognition

EM Algorithm with Split and Merge in Trajectory Clustering for Automatic Speech Recognition EM Algorithm with Split and Merge in Trajectory Clustering for Automatic Speech Recognition Yan Han and Lou Boves Department of Language and Speech, Radboud University Nijmegen, The Netherlands {Y.Han,

More information

HMM Classifier for Human Activity Recognition

HMM Classifier for Human Activity Recognition HMM Classifier for Human Activity Recognition MS. Kanchan Gaikwad Department of Computer, MGM College of Engineering, Kamothe, Panvel. kanchan.gawande@gmail.com Mr.Vaibhav Narawade (ME IT) vnarawade@gmail.com

More information

Confidence Measures: how much we can trust our speech recognizers

Confidence Measures: how much we can trust our speech recognizers Confidence Measures: how much we can trust our speech recognizers Prof. Hui Jiang Department of Computer Science York University, Toronto, Ontario, Canada Email: hj@cs.yorku.ca Outline Speech recognition

More information

Writer Identification for Smart Meeting Room Systems

Writer Identification for Smart Meeting Room Systems Writer Identification for Smart Meeting Room Systems Marcus Liwicki 1, Andreas Schlapbach 1, Horst Bunke 1, Samy Bengio 2, Johnny Mariéthoz 2, and Jonas Richiardi 3 1 Department of Computer Science, University

More information

Ground-Truth Production in the transcriptorium Project

Ground-Truth Production in the transcriptorium Project 2014 11th IAPR International Workshop on Document Analysis Systems Ground-Truth Production in the transcriptorium Project B. Gatos and G. Louloudis Inst. of Inf. and Telecommunications National Centre

More information

An Offline Cursive Handwritten Word Recognition System

An Offline Cursive Handwritten Word Recognition System An Offline Cursive Handwritten Word Recognition System Yong Haur Tay 1, Pierre-Michel Lallican 2, Marzuki Khalid 1, Christian Viard-Gaudin 3, Stefan Knerr 2 Abstract--This paper describes an offline cursive

More information

An educational software package for digital image processing

An educational software package for digital image processing An educational software package for digital image processing Juan Manuel ~amirez', Pilar Gomez-~il~, Luis G. Guerrero', David ~aez' & Ernesto ~orantes' '~e~artamento de Ingenieria Electrdnica, Universidad

More information

Classification of Mental Task for Brain Computer Interface Using Artificial Neural Network

Classification of Mental Task for Brain Computer Interface Using Artificial Neural Network Classification of Mental Task for Brain Computer Interface Using Artificial Neural Network Mohammad Naushad 1, Mohammad Waseem Khanooni 2, Nicky Ballani 3 1,2,3 Department of Electronics and Telecommunication

More information

A Survey of Problems of Overlapped Handwritten Characters in Recognition process for Gurmukhi Script

A Survey of Problems of Overlapped Handwritten Characters in Recognition process for Gurmukhi Script A Survey of Problems of Overlapped Handwritten Characters in Recognition process for Gurmukhi Script Arwinder Kaur 1, Ashok Kumar Bathla 2 1 M. Tech. Student, CE Dept., 2 Assistant Professor, CE Dept.,

More information

An evaluation of HMM-based Techniques for the Recognition of Screen Rendered Text

An evaluation of HMM-based Techniques for the Recognition of Screen Rendered Text An evaluation of HMM-based Techniques for the Recognition of Screen Rendered Text Sheikh Faisal Rashid 1, Faisal Shafait 2, and Thomas M. Breuel 1 1 Technical University of Kaiserslautern, Kaiserslautern,

More information

Context-dependent HMM modeling using tree-based clustering for the recognition of handwritten words

Context-dependent HMM modeling using tree-based clustering for the recognition of handwritten words Context-dependent HMM modeling using tree-based clustering for the recognition of handwritten words Anne-Laure Bianne a,b, Christopher Kermorvant a, Laurence Likforman-Sulem b a A2iA SA, Artificial Intelligence

More information

Algorithms for Recognition of Low Quality Iris Images. Li Peng Xie University of Ottawa

Algorithms for Recognition of Low Quality Iris Images. Li Peng Xie University of Ottawa Algorithms for Recognition of Low Quality Iris Images Li Peng Xie University of Ottawa Overview Iris Recognition Eyelash detection Accurate circular localization Covariance feature with LDA Fourier magnitude

More information

Synthetic Generation of Handwritten Signatures Based on Spectral Analysis

Synthetic Generation of Handwritten Signatures Based on Spectral Analysis Synthetic Generation of Handwritten Signatures Based on Spectral Analysis Javier Galbally, Julian Fierrez, Marcos Martinez-Diaz, and Javier Ortega-Garcia Biometric Recognition Group ATVS, ES, Universidad

More information

c 2014 Mohammad Mahdi Amanzadeh

c 2014 Mohammad Mahdi Amanzadeh c 2014 Mohammad Mahdi Amanzadeh RECOGNIZING EXPRESSIVE MOVEMENT IN ARM GESTURES USING HIDDEN MARKOV MODELS BY MOHAMMAD MAHDI AMANZADEH THESIS Submitted in partial fulfillment of the requirements for the

More information

Combining HMMs for the recognition of noisy printed characters

Combining HMMs for the recognition of noisy printed characters Combining HMMs for the recognition of noisy printed characters A. J. Elms and J. Illingworth Department of Electronic and Electrical Engineering University of Surrey Guildford, GU2 5XH, U.K. Abstract In

More information