Local Binary Pattern (LBP) methods in motion and activity analysis
|
|
- Randell Davidson
- 6 years ago
- Views:
Transcription
1 Local Binary Pattern (LBP) methods in motion and activity analysis Matti Pietikäinen University of Oulu, Finland Texture is everywhere: from skin to scene images
2 Starting point 2-D surface texture is a two dimensional phenomenon characterized by: spatial structure (pattern) contrast ( amount of texture) Transformation Gray scale Rotation Zoom in/out Property Pattern Contrast no effect affects affects no effect affects? Thus, 1) contrast is of no interest in gray scale invariant analysis 2) often we need a gray scale and rotation invariant pattern measure Local Binary Pattern and Contrast operators Ojala T, Pietikäinen M & Harwood D (1996) A comparative study of texture measures with classification based on feature distributions. Pattern Recognition 29: An example of computing LBP and C in a 3x3 neighborhood: example thresholded weights Pattern = LBP = = 241 C = ( )/5 - (5+2+1)/3 = 4.7 Important properties: LBP is invariant to any monotonic gray level change computational simplicity
3 Multiresolution LBP Ojala T, Pietikäinen M & Mäenpää T (2002) Multiresolution gray-scale and rotation invariant texture classification with Local Binary Patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(7): arbitrary circular neighborhoods - uniform patterns - multiple resolutions - rotation invariance - gray scale variance as contrast measure Uniform patterns U=0 Uniform patterns (P=8) U=2 Examples of nonuniform patterns (P=8) U=4 U=6 U=8
4 Texture primitives detected by the LBP Spot Spot/flat Line end Edge Corner Estimation of empirical feature distributions Input image (region) is scanned with the chosen operator(s), pixel by pixel, and operator outputs are accumulated into a discrete histogram LBP P,R riu2 LBP P,R riu2 / VAR P,R LBP P,R riu2 P+1 VAR P,R Joint histogram of two operators VAR P,R B-1 VAR P,R LBP P,R riu2 LBP P,R riu2 / VAR P,R
5 LBP has been highly successful LBP has become widely used in various applications due to its high discriminative power, tolerance against illumination changes and computational simplicity. Among the applications are: Visual inspection Image and video retrieval Biomedical image analysis Aerial image analysis, remote sensing Facial image analysis Etc. For a bibliography of LBP-related research, see Examples of using LBP in other groups - Object detection: Zhang et al., On-line boosting: Grabner & Bishof, Object classification: Lisin et al., 2005; Autio Color-texture based indexing: Yao & Chen, 2003; Connah & Finlayson, Inspection of ceramic tiles: Lopes, 2005; Novak & Hocenski, Classification of underwater images: Marcos et al., 2005; Clement et al., 2005; Blaschko et al., Aerial image segmentation: Urdiales et al., Segmentation of multispectral remote sensing images: Lucieer et al., Intravascular tissue characterization: Pujol & Radeva, Mobile robot navigation: Hong et al., 2002; Davidson & Hutchinson, Steganalysis for stenography: Lafferty & Ahmed, Designing aesthetically interesting and informative displays: Fogarty et al., Ovehead view person recognition: Cohen et al., Face recognition: G. Zhang et al., 2004; W. Zhang et al. 2005; Li et al., 2006; Rodriguez & Marcel, Face detection: Jin et al., Facial expression recognition: Shan et al ; Liao et al., Gender classification: Sun et al., 2006; Lian & Lu, 2006
6 Face analysis using local binary patterns Face recognition is one of the major challenges in computer vision We proposed (ECCV 2004, PAMI 2006) a face descriptor based on LBP s Our method has already been adopted by many leading scientists - e.g. T.S. Huang, J. Kittler, S.Z. Li, W. Gao, H. Ai, B. Triggs, S. Gong, S. Marcel Outstanding results in face recognition and authentication, face detection, facial expression recognition, gender classification Our approach will have a significant role in a new EU project Mobile Biometry ( ) coordinated by IDIAP (Switzerland) Face description with LBP Ahonen T, Hadid A & Pietikäinen M (2006) Face description with local binary patterns: application to face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(12): (an early version published at ECCV 2004) A facial description for face recognition:
7 LBP in AuthenMetric F1 Institute of Automation, Chinese Academy of Sciences FP7 project: Mobile Biometry (MOBIO) ( The aim of is to investigate multiple aspects of biometric authentication based on the face and voice in the context of mobile devices To increase security and user acceptance - using standard sensors already available on mobile phones Coordinator: IDIAP Research Institute (CH) Partners: University of Manchester (UK), University of Surrey (UK), Universite d Avignon (FR), Brno University of Technology (CZ), University of Oulu (FI), IdeArk (CH), eyep Media (CH) A technology transfer tool referred to as MOBIO Community of Interest will be formed
8 Subtracting the background and detecting moving objects Heikkilä M & Pietikäinen M (2006) A texture-based method for modeling the background and detecting moving objects. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(4): (an early version published at BMVC 2004) Overview of the Approach We use an LBP histogram computed over a circular region around the pixel as the feature vector. The history of each pixel over time is modeled as a group of K weighted LBP histograms: {x 1,x 2,,x K }. The background model is updated with the information of each new video frame, which makes the algorithm adaptive. The update procedure is identical for each pixel.
9 Detection of moving objects A texture based method for modeling the background and detecting moving objects Dynamic texture descriptors for motion analysis Dynamic (or temporal) textures are textures in motion We proposed (PAMI 2007) simple spatiotemporal LBP descriptors for dynamic texture recognition outperforming the state-of-the-art This approach has been applied to facial expression regonition (PAMI 2007), face and gender recognition from video sequences (AMFG 2007, ICPR 2008), visual speech recognition (HCM2007), and recognition of actions (BMVC 2008) - with excellent results Our approach has potential for significant contributions in many applications and fundamental problems of motion and activity analysis
10 Dynamic texture recognition Zhao G & Pietikäinen M (2007) Dynamic texture recognition using local binary Determine the emotional state patterns with ofthean face application to facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(6): (parts of this were earlier presented at ECCV 2006 Workshop on Dynamical Vision and ICPR 2006) Dynamic texture Motivation Dynamic textures or temporal textures are textures with motion. There are lots of DTs in real world, including sea-waves, smoke, foliage, fire, shower and whirlwind, etc. Click the figure
11 Volume Local Binary Patterns (VLBP) Sampling in volume Thresholding Multiply Pattern LBP from Three Orthogonal Planes (LBP-TOP)
12 DynTex database Our methods outperformed the state-of-the-art in experiments with DynTex and MIT dynamic texture databases
13 Facial expression recognition Zhao G & Pietikäinen M (2007) Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(6): Determine the emotional state of the face Regardless of the identity of the face
14 (a) Non-overlapping blocks(9 x 8) (b) Overlapping blocks (4 x 3, overlap size = 10) (a) Block volumes (b) LBP features from three orthogonal planes (c) Concatenated features for one block volume with the appearance and motion Database Cohn-Kanade database : 97 subjects 374 sequences Age from 18 to 30 years Sixty-five percent were female, 15 percent were African-American, and three percent were Asian or Latino.
15 Happiness Angry Disgust Sadness Fear Surprise Comparison with different approaches [Shan,2005] People Num 96 Sequence Num 320 Clas s Num 7(6) Dynamic N Measure 10 fold Recognition Rate (%) 88.4(92.1) [Bartlett, 2003] N 10 fold 86.9 [Littlewort, 2004] N leave-onesubject-out 93.8 [Tian, 2004] N [Yeasin, 2004] Y five fold 90.9 [Cohen, 2003] Y Ours Y two fold Ours Y 10 fold 96.26
16 Demo For Facial Expression Recognition Low resolution No eye detection Translation, in-plane and out-ofplane rotation, scale Illumination change Robust with respect to errors in face alignment Visual Speech Recognition Zhao G, Pietikäinen M & Hadid A (2007) Local spatiotemporal descriptors for visual speech recognition. Proc. 2nd International Workshop on Human- Centered Multimedia (HCM2007), Augsburg, Germany, Visual speech information plays an important role in speech recognition under noisy conditions or for listeners with hearing impairment. A human listener can use visual cues, such as lip and tongue movements, to enhance the level of speech understanding. The process of using visual modality is often referred to as lipreading which is to make sense of what someone is saying by watching the movement of his lips. McGurk effect [McGurk and MacDonald 1976] demonstrates that inconsistency between audio and visual information can result in perceptual confusion.
17 Appearance Features-Local Spatiotemporal Descriptors For Visual Information Mouth region images (a) Volume of utterance sequence (b) Image in XY plane (147x81) (c) Image in XT plane (147x38) in y =40 (d) Image in TY plane (38x81) in x = 70 LBP-XY images LBP-XT images Overlapping blocks (1 x 3, overlap size = 10). LBP-YT images Features in each block volume. Mouth movement representation.
18 Experiments Two databases: 1) Our own visual speech database: 20 persons; each uttering ten everyday s greetings one to five times. Totally, 817 sequences from 20 speakers were used in the experiments. C1 C2 C3 C4 C5 Phrases included in the dataset. Excuse me C6 See you Good bye C7 I am sorry Hello C8 Thank you How are you C9 Have a good time Nice to meet you C10 You are welcome 2) Tulips1 audio-visual database 12 subjects, pronouncing the first four digits in English two times in repetition. Totally 96 sequences. Experimental Results-Own database Speaker-independent: Mouth regions from the dataset. Recognition results (%) x5x3 block volumes 1x5x3 block volumes (features just from XY plane) 1x5x1 block volumes 0 C1 C2 C3 C4 C5 C6 C7 C8 C9 C10 Phrases index Results of speaker-independent experiments. Eye detection Blocks (1x5x3) Blocks (1x5x3+1x5x2) Manual % Automati c %
19 Experimental Results-Tulips1 audio-visual database Mouth images with translation, scaling and rotation from Tulips1 database. Comparison to other methods on Tulips1 audio-visual database (speaker independent). [Arsic 2006] [Arsic 2006] [Gurban 2005] Features MRPCA MI MRPCA Temporal Derivatives Features Normalization Y Y Y Results (%) Ours LBP TOP 8,8,8,1,1,1 Blocks: 3x6x2 N Demo for visual speech recognition
20 Recognition of actions 2D texture based approach w 1 w 2 w 3 w 4 V Kellokumpu, G Zhao & M Pietikäinen, "Texture Based Description of Movements for Activity Analysis". In Proc. VISAPP 2008 Demonstration
21 Dynamic texture based approach yt xt Dynamic texture based approach Feature histogram of a bounding volume V Kellokumpu, G Zhao & M Pietikäinen, Human Activity Recognition using a Dynamic Texture Based Approach". BMVC 2008.
22 Dynamic texture based approach KTH - dataset Box Clap Wave Jog Run Walk Box Clap Wave Jog.860, Run Walk SVM - 93,8% DT segmentation Chen J, Zhao G & Pietikäinen M (2008) Unsupervised dynamic texture segmentation using local spatiotemporal descriptors, ICPR 2008, in press.
23 A demo show Segmentation of a dynamic texture Input Output Experimental results Results on sequences ocean-fire-small (a) Frame 8 (b) Frame 21 (c) Frame 40 (d) Frame 60 (e) Frame 80 (f) Frame 100
24 Experimental results Results on a real challenging sequence (a) Frame 5 (b) Frame 10 Summary LBP and its spatiotemporal extensions are very effective methods for motion and activity analysis Our recent reseach has foced on applications in detection and tracking of moving objects, face, facial expression and gender recognition from videos, visual speech recognition, recognition of human actions, gait recognition The methods should be powerful in various industrial problems - computationally simple - robust to illumination variations - robust to localization errors
Texture Features in Facial Image Analysis
Texture Features in Facial Image Analysis Matti Pietikäinen and Abdenour Hadid Machine Vision Group Infotech Oulu and Department of Electrical and Information Engineering P.O. Box 4500, FI-90014 University
More informationTUTORIAL. Local Texture Descriptors in Computer Vision. Prof. Matti Pietikäinen, Dr. Guoying Zhao
Texture is everywhere: from skin to scene images TUTORIAL ICCV 29 September 27, 29 Local Texture Descriptors in Computer Vision Prof. Matti Pietikäinen, Dr. Guoying Zhao {mkp,gyzhao}@ee.oulu.fi Machine
More informationChapter 12. Face Analysis Using Local Binary Patterns
Chapter 12 Face Analysis Using Local Binary Patterns A. Hadid, G. Zhao, T. Ahonen, and M. Pietikäinen Machine Vision Group Infotech Oulu, P.O. Box 4500 FI-90014, University of Oulu, Finland http://www.ee.oulu.fi/mvg
More informationA Real Time Facial Expression Classification System Using Local Binary Patterns
A Real Time Facial Expression Classification System Using Local Binary Patterns S L Happy, Anjith George, and Aurobinda Routray Department of Electrical Engineering, IIT Kharagpur, India Abstract Facial
More informationHuman Activity Recognition Using a Dynamic Texture Based Method
Human Activity Recognition Using a Dynamic Texture Based Method Vili Kellokumpu, Guoying Zhao and Matti Pietikäinen Machine Vision Group University of Oulu, P.O. Box 4500, Finland {kello,gyzhao,mkp}@ee.oulu.fi
More informationBoosting Coded Dynamic Features for Facial Action Units and Facial Expression Recognition
Boosting Coded Dynamic Features for Facial Action Units and Facial Expression Recognition Peng Yang Qingshan Liu,2 Dimitris N. Metaxas Computer Science Department, Rutgers University Frelinghuysen Road,
More informationFacial expression recognition based on two-step feature histogram optimization Ling Gana, Sisi Sib
3rd International Conference on Materials Engineering, Manufacturing Technology and Control (ICMEMTC 201) Facial expression recognition based on two-step feature histogram optimization Ling Gana, Sisi
More informationFacial-component-based Bag of Words and PHOG Descriptor for Facial Expression Recognition
Proceedings of the 2009 IEEE International Conference on Systems, Man, and Cybernetics San Antonio, TX, USA - October 2009 Facial-component-based Bag of Words and PHOG Descriptor for Facial Expression
More informationLBP with Six Intersection Points: Reducing Redundant Information in LBP-TOP for Micro-expression Recognition
LBP with Six Intersection Points: Reducing Redundant Information in LBP-TOP for Micro-expression Recognition Yandan Wang 1, John See 2, Raphael C.-W. Phan 1, Yee-Hui Oh 1 1 Faculty of Engineering, Multimedia
More informationPerson-Independent Facial Expression Recognition Based on Compound Local Binary Pattern (CLBP)
The International Arab Journal of Information Technology, Vol. 11, No. 2, March 2014 195 Person-Independent Facial Expression Recognition Based on Compound Local Binary Pattern (CLBP) Faisal Ahmed 1, Hossain
More informationImplementation of a Face Recognition System for Interactive TV Control System
Implementation of a Face Recognition System for Interactive TV Control System Sang-Heon Lee 1, Myoung-Kyu Sohn 1, Dong-Ju Kim 1, Byungmin Kim 1, Hyunduk Kim 1, and Chul-Ho Won 2 1 Dept. IT convergence,
More informationAn Adaptive Threshold LBP Algorithm for Face Recognition
An Adaptive Threshold LBP Algorithm for Face Recognition Xiaoping Jiang 1, Chuyu Guo 1,*, Hua Zhang 1, and Chenghua Li 1 1 College of Electronics and Information Engineering, Hubei Key Laboratory of Intelligent
More informationInternational Journal of Computer Techniques Volume 4 Issue 1, Jan Feb 2017
RESEARCH ARTICLE OPEN ACCESS Facial expression recognition based on completed LBP Zicheng Lin 1, Yuanliang Huang 2 1 (College of Science and Engineering, Jinan University, Guangzhou, PR China) 2 (Institute
More informationTexture Classification using a Linear Configuration Model based Descriptor
STUDENT, PROF, COLLABORATOR: BMVC AUTHOR GUIDELINES 1 Texture Classification using a Linear Configuration Model based Descriptor Yimo Guo guoyimo@ee.oulu.fi Guoying Zhao gyzhao@ee.oulu.fi Matti Pietikäinen
More informationA FRAMEWORK FOR ANALYZING TEXTURE DESCRIPTORS
A FRAMEWORK FOR ANALYZING TEXTURE DESCRIPTORS Timo Ahonen and Matti Pietikäinen Machine Vision Group, University of Oulu, PL 4500, FI-90014 Oulun yliopisto, Finland tahonen@ee.oulu.fi, mkp@ee.oulu.fi Keywords:
More informationRobust Facial Expression Classification Using Shape and Appearance Features
Robust Facial Expression Classification Using Shape and Appearance Features S L Happy and Aurobinda Routray Department of Electrical Engineering, Indian Institute of Technology Kharagpur, India Abstract
More informationCountermeasure for the Protection of Face Recognition Systems Against Mask Attacks
Countermeasure for the Protection of Face Recognition Systems Against Mask Attacks Neslihan Kose, Jean-Luc Dugelay Multimedia Department EURECOM Sophia-Antipolis, France {neslihan.kose, jean-luc.dugelay}@eurecom.fr
More informationLOCAL FEATURE EXTRACTION METHODS FOR FACIAL EXPRESSION RECOGNITION
17th European Signal Processing Conference (EUSIPCO 2009) Glasgow, Scotland, August 24-28, 2009 LOCAL FEATURE EXTRACTION METHODS FOR FACIAL EXPRESSION RECOGNITION Seyed Mehdi Lajevardi, Zahir M. Hussain
More informationComplete Local Binary Pattern for Representation of Facial Expression Based on Curvelet Transform
Proc. of Int. Conf. on Multimedia Processing, Communication& Info. Tech., MPCIT Complete Local Binary Pattern for Representation of Facial Expression Based on Curvelet Transform Nagaraja S., Prabhakar
More informationCombining Dynamic Texture and Structural Features for Speaker Identification
Combining Dynamic Texture and Structural Features for Speaker Identification Guoying Zhao Machine Vision Group Infotech Oulu and Department of Electrical and Information Engineering P. O. Box 4500 FI-90014
More informationColor Local Texture Features Based Face Recognition
Color Local Texture Features Based Face Recognition Priyanka V. Bankar Department of Electronics and Communication Engineering SKN Sinhgad College of Engineering, Korti, Pandharpur, Maharashtra, India
More informationarxiv: v1 [cs.cv] 19 May 2017
Affine-Gradient Based Local Binary Pattern Descriptor for Texture Classification You Hao 1,2, Shirui Li 1,2, Hanlin Mo 1,2, and Hua Li 1,2 arxiv:1705.06871v1 [cs.cv] 19 May 2017 1 Key Laboratory of Intelligent
More informationCOMPOUND LOCAL BINARY PATTERN (CLBP) FOR PERSON-INDEPENDENT FACIAL EXPRESSION RECOGNITION
COMPOUND LOCAL BINARY PATTERN (CLBP) FOR PERSON-INDEPENDENT FACIAL EXPRESSION RECOGNITION Priyanka Rani 1, Dr. Deepak Garg 2 1,2 Department of Electronics and Communication, ABES Engineering College, Ghaziabad
More informationPattern Recognition Letters
Pattern Recognition Letters 30 (2009) 1117 1127 Contents lists available at ScienceDirect Pattern Recognition Letters journal homepage: www.elsevier.com/locate/patrec Boosted multi-resolution spatiotemporal
More informationTexture Classification by Combining Local Binary Pattern Features and a Self-Organizing Map
Texture Classification by Combining Local Binary Pattern Features and a Self-Organizing Map Markus Turtinen, Topi Mäenpää, and Matti Pietikäinen Machine Vision Group, P.O.Box 4500, FIN-90014 University
More informationBRIEF Features for Texture Segmentation
BRIEF Features for Texture Segmentation Suraya Mohammad 1, Tim Morris 2 1 Communication Technology Section, Universiti Kuala Lumpur - British Malaysian Institute, Gombak, Selangor, Malaysia 2 School of
More informationPalm Vein Recognition with Local Binary Patterns and Local Derivative Patterns
Palm Vein Recognition with Local Binary Patterns and Local Derivative Patterns Leila Mirmohamadsadeghi and Andrzej Drygajlo Swiss Federal Institude of Technology Lausanne (EPFL) CH-1015 Lausanne, Switzerland
More informationFacial Expression Recognition with Emotion-Based Feature Fusion
Facial Expression Recognition with Emotion-Based Feature Fusion Cigdem Turan 1, Kin-Man Lam 1, Xiangjian He 2 1 The Hong Kong Polytechnic University, Hong Kong, SAR, 2 University of Technology Sydney,
More informationDynamic Facial Expression Recognition Using A Bayesian Temporal Manifold Model
Dynamic Facial Expression Recognition Using A Bayesian Temporal Manifold Model Caifeng Shan, Shaogang Gong, and Peter W. McOwan Department of Computer Science Queen Mary University of London Mile End Road,
More informationGabor Volume based Local Binary Pattern for Face Representation and Recognition
Gabor Volume based Local Binary Pattern for Face Representation and Recognition Zhen Lei 1 Shengcai Liao 1 Ran He 1 Matti Pietikäinen 2 Stan Z. Li 1 1 Center for Biometrics and Security Research & National
More informationRecognizing Micro-Expressions & Spontaneous Expressions
Recognizing Micro-Expressions & Spontaneous Expressions Presentation by Matthias Sperber KIT University of the State of Baden-Wuerttemberg and National Research Center of the Helmholtz Association www.kit.edu
More informationHUMAN S FACIAL PARTS EXTRACTION TO RECOGNIZE FACIAL EXPRESSION
HUMAN S FACIAL PARTS EXTRACTION TO RECOGNIZE FACIAL EXPRESSION Dipankar Das Department of Information and Communication Engineering, University of Rajshahi, Rajshahi-6205, Bangladesh ABSTRACT Real-time
More informationExtracting Local Binary Patterns from Image Key Points: Application to Automatic Facial Expression Recognition
Extracting Local Binary Patterns from Image Key Points: Application to Automatic Facial Expression Recognition Xiaoyi Feng 1, Yangming Lai 1, Xiaofei Mao 1,JinyePeng 1, Xiaoyue Jiang 1, and Abdenour Hadid
More informationA NOVEL APPROACH TO ACCESS CONTROL BASED ON FACE RECOGNITION
A NOVEL APPROACH TO ACCESS CONTROL BASED ON FACE RECOGNITION A. Hadid, M. Heikkilä, T. Ahonen, and M. Pietikäinen Machine Vision Group Infotech Oulu and Department of Electrical and Information Engineering
More informationPart-based Face Recognition Using Near Infrared Images
Part-based Face Recognition Using Near Infrared Images Ke Pan Shengcai Liao Zhijian Zhang Stan Z. Li Peiren Zhang University of Science and Technology of China Hefei 230026, China Center for Biometrics
More informationAppearance Manifold of Facial Expression
Appearance Manifold of Facial Expression Caifeng Shan, Shaogang Gong and Peter W. McOwan Department of Computer Science Queen Mary, University of London, London E1 4NS, UK {cfshan, sgg, pmco}@dcs.qmul.ac.uk
More informationContent Based Image Retrieval Using Color Quantizes, EDBTC and LBP Features
Content Based Image Retrieval Using Color Quantizes, EDBTC and LBP Features 1 Kum Sharanamma, 2 Krishnapriya Sharma 1,2 SIR MVIT Abstract- To describe the image features the Local binary pattern (LBP)
More informationAn Efficient LBP-based Descriptor for Facial Depth Images applied to Gender Recognition using RGB-D Face Data
An Efficient LBP-based Descriptor for Facial Depth Images applied to Gender Recognition using RGB-D Face Data Tri Huynh, Rui Min, Jean-Luc Dugelay Department of Multimedia Communications, EURECOM, Sophia
More informationAdaptive Median Binary Patterns for Texture Classification
214 22nd International Conference on Pattern Recognition Adaptive Median Binary Patterns for Texture Classification Adel Hafiane INSA CVL, Univ. Orléans, PRISME, EA 4229 88 Boulvard Lahitolle F-122, Bourges,
More informationPart-based Face Recognition Using Near Infrared Images
Part-based Face Recognition Using Near Infrared Images Ke Pan Shengcai Liao Zhijian Zhang Stan Z. Li Peiren Zhang University of Science and Technology of China Hefei 230026, China Center for Biometrics
More informationFacial Expression Recognition Using Encoded Dynamic Features
Facial Expression Recognition Using Encoded Dynamic Features Peng Yang Qingshan Liu,2 Xinyi Cui Dimitris N.Metaxas Computer Science Department, Rutgers University Frelinghuysen Road Piscataway, NJ 8854
More informationExploring Bag of Words Architectures in the Facial Expression Domain
Exploring Bag of Words Architectures in the Facial Expression Domain Karan Sikka, Tingfan Wu, Josh Susskind, and Marian Bartlett Machine Perception Laboratory, University of California San Diego {ksikka,ting,josh,marni}@mplab.ucsd.edu
More informationLeveraging Textural Features for Recognizing Actions in Low Quality Videos
Leveraging Textural Features for Recognizing Actions in Low Quality Videos Saimunur Rahman 1, John See 2, and Chiung Ching Ho 3 Centre of Visual Computing, Faculty of Computing and Informatics Multimedia
More informationMultiple Kernel Learning for Emotion Recognition in the Wild
Multiple Kernel Learning for Emotion Recognition in the Wild Karan Sikka, Karmen Dykstra, Suchitra Sathyanarayana, Gwen Littlewort and Marian S. Bartlett Machine Perception Laboratory UCSD EmotiW Challenge,
More informationFace Description with Local Binary Patterns: Application to Face Recognition
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 28, NO. 12, DECEMBER 2006 2037 Face Description with Local Binary Patterns: Application to Face Recognition Timo Ahonen, Student Member,
More informationRadially Defined Local Binary Patterns for Hand Gesture Recognition
Radially Defined Local Binary Patterns for Hand Gesture Recognition J. V. Megha 1, J. S. Padmaja 2, D.D. Doye 3 1 SGGS Institute of Engineering and Technology, Nanded, M.S., India, meghavjon@gmail.com
More informationarxiv: v3 [cs.cv] 3 Oct 2012
Combined Descriptors in Spatial Pyramid Domain for Image Classification Junlin Hu and Ping Guo arxiv:1210.0386v3 [cs.cv] 3 Oct 2012 Image Processing and Pattern Recognition Laboratory Beijing Normal University,
More informationLocal mesh patterns for medical image segmentation
REVIEW ARTICLE e-issn: 2349-0659 p-issn: 2350-0964 doi: 10.21276/apjhs.2018.5.1.29 Local mesh patterns for medical image segmentation Nookala Venu, Asiya Sulthana Department of Electronics and Communication
More informationBoosting Facial Expression Recognition in a Noisy Environment Using LDSP-Local Distinctive Star Pattern
www.ijcsi.org 45 Boosting Facial Expression Recognition in a Noisy Environment Using LDSP-Local Distinctive Star Pattern Mohammad Shahidul Islam 1, Tarikuzzaman Emon 2 and Tarin Kazi 3 1 Department of
More informationA ROBUST DISCRIMINANT CLASSIFIER TO MAKE MATERIAL CLASSIFICATION MORE EFFICIENT
A ROBUST DISCRIMINANT CLASSIFIER TO MAKE MATERIAL CLASSIFICATION MORE EFFICIENT 1 G Shireesha, 2 Mrs.G.Satya Prabha 1 PG Scholar, Department of ECE, SLC's Institute of Engineering and Technology, Piglipur
More informationDealing with Inaccurate Face Detection for Automatic Gender Recognition with Partially Occluded Faces
Dealing with Inaccurate Face Detection for Automatic Gender Recognition with Partially Occluded Faces Yasmina Andreu, Pedro García-Sevilla, and Ramón A. Mollineda Dpto. Lenguajes y Sistemas Informáticos
More informationAn Algorithm based on SURF and LBP approach for Facial Expression Recognition
ISSN: 2454-2377, An Algorithm based on SURF and LBP approach for Facial Expression Recognition Neha Sahu 1*, Chhavi Sharma 2, Hitesh Yadav 3 1 Assistant Professor, CSE/IT, The North Cap University, Gurgaon,
More informationFacial Expression Analysis
Facial Expression Analysis Faces are special Face perception may be the most developed visual perceptual skill in humans. Infants prefer to look at faces from shortly after birth (Morton and Johnson 1991).
More informationLBP Based Facial Expression Recognition Using k-nn Classifier
ISSN 2395-1621 LBP Based Facial Expression Recognition Using k-nn Classifier #1 Chethan Singh. A, #2 Gowtham. N, #3 John Freddy. M, #4 Kashinath. N, #5 Mrs. Vijayalakshmi. G.V 1 chethan.singh1994@gmail.com
More informationExtended Local Binary Pattern Features for Improving Settlement Type Classification of QuickBird Images
Extended Local Binary Pattern Features for Improving Settlement Type Classification of QuickBird Images L. Mdakane and F. van den Bergh Remote Sensing Research Unit, Meraka Institute CSIR, PO Box 395,
More informationVolume Local Phase Quantization for Blur-Insensitive Dynamic Texture Classification
Volume Local Phase Quantization for Blur-Insensitive Dynamic Texture Classification Juhani Päivärinta, Esa Rahtu, and Janne Heikkilä Machine Vision Group, Department of Electrical and Information Engineering,
More informationA Texture-based Method for Detecting Moving Objects
A Texture-based Method for Detecting Moving Objects Marko Heikkilä University of Oulu Machine Vision Group FINLAND Introduction The moving object detection, also called as background subtraction, is one
More informationDecorrelated Local Binary Pattern for Robust Face Recognition
International Journal of Advanced Biotechnology and Research (IJBR) ISSN 0976-2612, Online ISSN 2278 599X, Vol-7, Special Issue-Number5-July, 2016, pp1283-1291 http://www.bipublication.com Research Article
More informationDYNAMIC BACKGROUND SUBTRACTION BASED ON SPATIAL EXTENDED CENTER-SYMMETRIC LOCAL BINARY PATTERN. Gengjian Xue, Jun Sun, Li Song
DYNAMIC BACKGROUND SUBTRACTION BASED ON SPATIAL EXTENDED CENTER-SYMMETRIC LOCAL BINARY PATTERN Gengjian Xue, Jun Sun, Li Song Institute of Image Communication and Information Processing, Shanghai Jiao
More informationImage and video analysis with local binary pattern variants
Image and video analysis with local binary pattern variants Matti Pietikäinen, Guoying Zhao Center for Machine Vision Research University of Oulu, Finland http://www.cse.oulu.fi/cmv Part 1: Introduction
More informationHYBRID CENTER-SYMMETRIC LOCAL PATTERN FOR DYNAMIC BACKGROUND SUBTRACTION. Gengjian Xue, Li Song, Jun Sun, Meng Wu
HYBRID CENTER-SYMMETRIC LOCAL PATTERN FOR DYNAMIC BACKGROUND SUBTRACTION Gengjian Xue, Li Song, Jun Sun, Meng Wu Institute of Image Communication and Information Processing, Shanghai Jiao Tong University,
More informationSKIN COLOUR INFORMATION AND MORPHOLOGY BASED FACE DETECTION TECHNIQUE
SKIN COLOUR INFORMATION AND MORPHOLOGY BASED FACE DETECTION TECHNIQUE M. Sharmila Kumari, Akshay Kumar, Rohan Joe D Souza, G K Manjunath and Nishan Kotian ABSTRACT Department of Computer Science and Engineering,
More informationRevisiting LBP-based Texture Models for Human Action Recognition
Revisiting LBP-based Texture Models for Human Action Recognition Thanh Phuong Nguyen 1, Antoine Manzanera 1, Ngoc-Son Vu 2, and Matthieu Garrigues 1 1 ENSTA-ParisTech, 828, Boulevard des Maréchaux, 91762
More informationA Texture-based Method for Detecting Moving Objects
A Texture-based Method for Detecting Moving Objects M. Heikkilä, M. Pietikäinen and J. Heikkilä Machine Vision Group Infotech Oulu and Department of Electrical and Information Engineering P.O. Box 4500
More informationAction Recognition in Low Quality Videos by Jointly Using Shape, Motion and Texture Features
Action Recognition in Low Quality Videos by Jointly Using Shape, Motion and Texture Features Saimunur Rahman, John See, Chiung Ching Ho Centre of Visual Computing, Faculty of Computing and Informatics
More informationFacial Expression Recognition Using Expression- Specific Local Binary Patterns and Layer Denoising Mechanism
Facial Expression Recognition Using Expression- Specific Local Binary Patterns and Layer Denoising Mechanism 1 2 Wei-Lun Chao, Jun-Zuo Liu, 3 Jian-Jiun Ding, 4 Po-Hung Wu 1, 2, 3, 4 Graduate Institute
More informationA STUDY FOR THE SELF SIMILARITY SMILE DETECTION
A STUDY FOR THE SELF SIMILARITY SMILE DETECTION D. Freire, L. Antón, M. Castrillón. SIANI, Universidad de Las Palmas de Gran Canaria, Spain dfreire@iusiani.ulpgc.es, lanton@iusiani.ulpgc.es,mcastrillon@iusiani.ulpgc.es
More informationFacial Expression Recognition Based on Local Directional Pattern Using SVM Decision-level Fusion
Facial Expression Recognition Based on Local Directional Pattern Using SVM Decision-level Fusion Juxiang Zhou 1, Tianwei Xu 2, Jianhou Gan 1 1. Key Laboratory of Education Informalization for Nationalities,
More informationMicro-expression Recognition Using Dynamic Textures on Tensor Independent Color Space
Micro-expression Recognition Using Dynamic Textures on Tensor Independent Color Space Su-Jing Wang 1,, Wen-Jing Yan 1, Xiaobai Li 2, Guoying Zhao 2 and Xiaolan Fu 1 1) State Key Laboratory of Brain and
More informationMETHODOLOGY AND EXTENSIONS OF LOCAL BINARY PATTERN: A SURVEY
METHODOLOGY AND EXTENSIONS OF LOCAL BINARY PATTERN: A SURVEY CHANDRAJA D Department of Electrical Engineering (UG Student), BITS Pilani Hyderabad E-mail: chandraja.dharmana@gmail.com Abstract- The Local
More informationURL: <
Citation: Cheheb, Ismahane, Al-Maadeed, Noor, Al-Madeed, Somaya, Bouridane, Ahmed and Jiang, Richard (2017) Random sampling for patch-based face recognition. In: IWBF 2017-5th International Workshop on
More informationSpatiotemporal Features for Effective Facial Expression Recognition
Spatiotemporal Features for Effective Facial Expression Recognition Hatice Çınar Akakın and Bülent Sankur Bogazici University, Electrical & Electronics Engineering Department, Bebek, Istanbul {hatice.cinar,bulent.sankur}@boun.edu.tr
More informationMulti-Modal Human- Computer Interaction
Multi-Modal Human- Computer Interaction Attila Fazekas University of Debrecen, Hungary Road Map Multi-modal interactions and systems (main categories, examples, benefits) Face detection, facial gestures
More informationExperimentation on the use of Chromaticity Features, Local Binary Pattern and Discrete Cosine Transform in Colour Texture Analysis
Experimentation on the use of Chromaticity Features, Local Binary Pattern and Discrete Cosine Transform in Colour Texture Analysis N.Padmapriya, Ovidiu Ghita, and Paul.F.Whelan Vision Systems Laboratory,
More informationWeighted Multi-scale Local Binary Pattern Histograms for Face Recognition
Weighted Multi-scale Local Binary Pattern Histograms for Face Recognition Olegs Nikisins Institute of Electronics and Computer Science 14 Dzerbenes Str., Riga, LV1006, Latvia Email: Olegs.Nikisins@edi.lv
More informationIncorporating two first order moments into LBP-based operator for texture categorization
Incorporating two first order moments into LBP-based operator for texture categorization Thanh Phuong Nguyen and Antoine Manzanera ENSTA-ParisTech, 828 Boulevard des Maréchaux, 91762 Palaiseau, France
More informationSparse Coding Based Lip Texture Representation For Visual Speaker Identification
Sparse Coding Based Lip Texture Representation For Visual Speaker Identification Author Lai, Jun-Yao, Wang, Shi-Lin, Shi, Xing-Jian, Liew, Alan Wee-Chung Published 2014 Conference Title Proceedings of
More informationA Novel Feature Extraction Technique for Facial Expression Recognition
www.ijcsi.org 9 A Novel Feature Extraction Technique for Facial Expression Recognition *Mohammad Shahidul Islam 1, Surapong Auwatanamongkol 2 1 Department of Computer Science, School of Applied Statistics,
More informationAn Efficient Texture Classification Technique Based on Semi Uniform LBP
IOSR Journal of Computer Engineering (IOSR-JCE) e-issn: 2278-0661,p-ISSN: 2278-8727, Volume 16, Issue 5, Ver. VI (Sep Oct. 2014), PP 36-42 An Efficient Texture Classification Technique Based on Semi Uniform
More informationLearning to Recognize Faces in Realistic Conditions
000 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050
More informationExploring Facial Expressions with Compositional Features
Exploring Facial Expressions with Compositional Features Peng Yang Qingshan Liu Dimitris N. Metaxas Computer Science Department, Rutgers University Frelinghuysen Road, Piscataway, NJ 88, USA peyang@cs.rutgers.edu,
More informationGraph Matching Iris Image Blocks with Local Binary Pattern
Graph Matching Iris Image Blocs with Local Binary Pattern Zhenan Sun, Tieniu Tan, and Xianchao Qiu Center for Biometrics and Security Research, National Laboratory of Pattern Recognition, Institute of
More informationFacial Feature Extraction Based On FPD and GLCM Algorithms
Facial Feature Extraction Based On FPD and GLCM Algorithms Dr. S. Vijayarani 1, S. Priyatharsini 2 Assistant Professor, Department of Computer Science, School of Computer Science and Engineering, Bharathiar
More informationFACE RECOGNITION BASED ON LOCAL DERIVATIVE TETRA PATTERN
ISSN: 976-92 (ONLINE) ICTACT JOURNAL ON IMAGE AND VIDEO PROCESSING, FEBRUARY 27, VOLUME: 7, ISSUE: 3 FACE RECOGNITION BASED ON LOCAL DERIVATIVE TETRA PATTERN A. Geetha, M. Mohamed Sathik 2 and Y. Jacob
More informationDA Progress report 2 Multi-view facial expression. classification Nikolas Hesse
DA Progress report 2 Multi-view facial expression classification 16.12.2010 Nikolas Hesse Motivation Facial expressions (FE) play an important role in interpersonal communication FE recognition can help
More informationMORPH-II: Feature Vector Documentation
MORPH-II: Feature Vector Documentation Troy P. Kling NSF-REU Site at UNC Wilmington, Summer 2017 1 MORPH-II Subsets Four different subsets of the MORPH-II database were selected for a wide range of purposes,
More informationA TEXTURE CLASSIFICATION TECHNIQUE USING LOCAL COMBINATION ADAPTIVE TERNARY PATTERN DESCRIPTOR. B. S. L TEJASWINI (M.Tech.) 1
A TEXTURE CLASSIFICATION TECHNIQUE USING LOCAL COMBINATION ADAPTIVE TERNARY PATTERN DESCRIPTOR B. S. L TEJASWINI (M.Tech.) 1 P. MADHAVI, M.Tech, (PH.D) 2 1 SRI VENKATESWARA College of Engineering Karakambadi
More informationFacial Expression Recognition with PCA and LBP Features Extracting from Active Facial Patches
Facial Expression Recognition with PCA and LBP Features Extracting from Active Facial Patches Yanpeng Liu a, Yuwen Cao a, Yibin Li a, Ming Liu, Rui Song a Yafang Wang, Zhigang Xu, Xin Ma a Abstract Facial
More informationA Texture-Based Method for Modeling the Background and Detecting Moving Objects
A Texture-Based Method for Modeling the Background and Detecting Moving Objects Marko Heikkilä and Matti Pietikäinen, Senior Member, IEEE 2 Abstract This paper presents a novel and efficient texture-based
More informationEvaluation of Texture Descriptors for Automated Gender Estimation from Fingerprints
Appeared in Proc. of ECCV Workshop on Soft Biometrics, (Zurich, Switzerland), September 2014 Evaluation of Texture Descriptors for Automated Gender Estimation from Fingerprints Ajita Rattani 1, Cunjian
More informationA New Feature Local Binary Patterns (FLBP) Method
A New Feature Local Binary Patterns (FLBP) Method Jiayu Gu and Chengjun Liu The Department of Computer Science, New Jersey Institute of Technology, Newark, NJ 07102, USA Abstract - This paper presents
More informationDynamic Local Ternary Pattern for Face Recognition and Verification
Dynamic Local Ternary Pattern for Face Recognition and Verification Mohammad Ibrahim, Md. Iftekharul Alam Efat, Humayun Kayesh Shamol, Shah Mostafa Khaled, Mohammad Shoyaib Institute of Information Technology
More informationROI sensitive analysis for real time gender classification
ROI sensitive analysis for real time gender classification RODRIGUES, Marcos , KORMANN, Mariza and TOMEK, Peter Available from Sheffield Hallam University Research
More informationMicro-Facial Movements: An Investigation on Spatio-Temporal Descriptors
Micro-Facial Movements: An Investigation on Spatio-Temporal Descriptors Adrian K. Davison 1, Moi Hoon Yap 1, Nicholas Costen 1, Kevin Tan 1, Cliff Lansley 2, and Daniel Leightley 1 1 Manchester Metropolitan
More informationObject detection using non-redundant local Binary Patterns
University of Wollongong Research Online Faculty of Informatics - Papers (Archive) Faculty of Engineering and Information Sciences 2010 Object detection using non-redundant local Binary Patterns Duc Thanh
More informationAn Acceleration Scheme to The Local Directional Pattern
An Acceleration Scheme to The Local Directional Pattern Y.M. Ayami Durban University of Technology Department of Information Technology, Ritson Campus, Durban, South Africa ayamlearning@gmail.com A. Shabat
More informationAPPLICATION OF LOCAL BINARY PATTERN AND PRINCIPAL COMPONENT ANALYSIS FOR FACE RECOGNITION
APPLICATION OF LOCAL BINARY PATTERN AND PRINCIPAL COMPONENT ANALYSIS FOR FACE RECOGNITION 1 CHETAN BALLUR, 2 SHYLAJA S S P.E.S.I.T, Bangalore Email: chetanballur7@gmail.com, shylaja.sharath@pes.edu Abstract
More informationLocal Binary Pattern Base Face Recognition System
Local Binary Pattern Base Face Recognition System PALLAVI B. PATINGE M.E. (Digital Electronics Part Time) III year Prof. Ram Meghe Institute of Technology & Research, Badnera-Amravati. Prof. C. N.DESHMUKH
More informationDirectional Binary Code for Content Based Image Retrieval
Directional Binary Code for Content Based Image Retrieval Priya.V Pursuing M.E C.S.E, W. T. Chembian M.I.ET.E, (Ph.D)., S.Aravindh M.Tech CSE, H.O.D, C.S.E Asst Prof, C.S.E Gojan School of Business Gojan
More informationGray Scale and Rotation Invariant Texture Classification with Local Binary Patterns
Gray Scale and Rotation Invariant Texture Classification with Local Binary Patterns Timo Ojala, Matti Pietikäinen and Topi Mäenpää Machine Vision and Media Processing Unit Infotech Oulu, University of
More information