A Bilinear Model for Sparse Coding
|
|
- Shanon Beasley
- 5 years ago
- Views:
Transcription
1 A Blnear Model for Sparse Codng Davd B. Grmes and Rajesh P. N. Rao Department of Computer Scence and Engneerng Unversty of Washngton Seattle, WA , U.S.A. Abstract Recent algorthms for sparse codng and ndependent component analyss (ICA) have demonstrated how localzed features can be learned from natural mages. However, these approaches do not take mage transformatons nto account. As a result, they produce mage codes that are redundant because the same feature s learned at multple locatons. We descrbe an algorthm for sparse codng based on a blnear generatve model of mages. By explctly modelng the nteracton between mage features and ther transformatons, the blnear approach helps reduce redundancy n the mage code and provdes a bass for transformatonnvarant vson. We present results demonstratng blnear sparse codng of natural mages. We also explore an extenson of the model that can capture spatal relatonshps between the ndependent features of an object, thereby provdng a new framework for parts-based object recognton. 1 Introducton Algorthms for redundancy reducton and effcent codng have been the subject of consderable attenton n recent years [6, 3, 4, 7, 9, 5, 11]. Although the basc deas can be traced to the early work of Attneave [1] and Barlow [2], recent technques such as ndependent component analyss (ICA) and sparse codng have helped formalze these deas and have demonstrated the feasblty of effcent codng through redundancy reducton. These technques produce an effcent code by attemptng to mnmze the dependences between elements of the code by usng approprate constrants. One of the most successful applcatons of ICA and sparse codng has been n the area of mage codng. Olshausen and Feld showed that sparse codng of natural mages produces localzed, orented bass flters that resemble the receptve felds of smple cells n prmary vsual cortex [6, 7]. Bell and Sejnowsk obtaned smlar results usng ther algorthm for ICA [3]. However, these approaches do not take mage transformatons nto account. As a result, the same orented feature s often learned at dfferent locatons, yeldng a redundant code. Moreover, the presence of the same feature at multple locatons prevents more complex features from beng learned and leads to a combnatoral exploson when one attempts to scale the approach to large mage patches or herarchcal networks. In ths paper, we propose an approach to sparse codng that explctly models the nterac-
2 ton between mage features and ther transformatons. A blnear generatve model s used to learn both the ndependent features n an mage as well as ther transformatons. Our approach extends Tenenbaum and Freeman s work on blnear models for learnng content and style [12] by castng the problem wthn probablstc sparse codng framework. Thus, whereas pror work on blnear models used global decomposton methods such as SVD, the approach presented here emphaszes the extracton of local features by removng hgher-order redundances through sparseness constrants. We show that for natural mages, ths approach produces localzed, orented flters that can be translated by dfferent amounts to account for mage features at arbtrary locatons. Our results demonstrate how an mage can be factored nto a set of basc local features and ther transformatons, provdng a bass for transformaton-nvarant vson. We conclude by dscussng how the approach can be extended to allow parts-based object recognton, wheren an object s modeled as a collecton of local features (or parts ) and ther relatve transformatons. 2 Blnear Generatve Models We begn by consderng the standard lnear generatve model used n algorthms for ICA and sparse codng [3, 7, 9]: where s a -dmensonal nput vector (e.g. an mage), and s a -dmensonal bass vector s ts scalar coeffcent. Gven the lnear generatve model above, the goal of ICA s to learn the bass vectors such that the are as ndependent as possble, whle the goal n sparse codng s to make the dstrbuton of hghly kurtotc gven Equaton 1. (2) The coeffcents and jontly modulate a set of bass vectors to produce an nput vector. For the present study, the coeffcent can be regarded as encodng the presence of object feature n the mage whle the values determne the transformaton present n the mage. In the termnology of Tenenbaum and Freeman [12], descrbes the content of the mage whle encodes ts style. The lnear generatve model n Equaton 1 can be extended to the blnear case by usng two ndependent sets of coeffcents and (or equvalently, two vectors and ) [12]: Equaton 2 can also be expressed as a lnear equaton n for a fxed :! "# $ &%' )( Lkewse, for a fxed, one obtans a lnear equaton n. Indeed ths s the defnton of blnear: gven one fxed factor, the model s lnear wth respect to the other factor. The power of blnear models stems from the rch non-lnear nteractons that can be represented by varyng both and smultaneously. 3 Learnng Sparse Blnear Models 3.1 Learnng Blnear Models Our goal s to learn from mage data an approprate set of bass vectors that effectvely descrbe the nteractons between the feature vector and the transformaton vector. (1) (3)
3 ( # A commonly used approach n unsupervsed learnng s to mnmze the sum of squared pxel-wse errors over all mages: (4) (5) where denotes the norm of a vector. A standard approach to mnmzng such a functon s to use gradent descent and alternate between mnmzaton wth respect to and mnmzaton wth respect to. Unfortunately, the optmzaton problem as stated s underconstraned. The functon has many local mnma and results from our smulatons ndcate that convergence s dffcult n many cases. There are many dfferent ways to represent an mage, makng t dffcult for the method to converge to a bass set that can generalze effectvely. A related approach s presented by Tenenbaum and Freeman [12]. Rather than usng gradent descent, ther method estmates the parameters drectly by computng the sngular value decomposton (SVD) of a matrx contanng nput data correspondng to each content class n every style. Ther approach can be regarded as an extenson of methods based on prncpal component analyss (PCA) appled to the blnear case. The SVD approach avods the dffcultes of convergence that plague the gradent descent method and s much faster n practce. Unfortunately, the learned features tend to be global and non-localzed smlar to those obtaned from PCA-based methods based on second-order statstcs. As a result, the method s unsutable for the problem of learnng local features of objects and ther transformatons. The underconstraned nature of the problem can be remeded by mposng constrants on and. In partcular, we could cast the problem wthn a probablstc framework and mpose specfc pror dstrbutons on and wth hgher probabltes for values that acheve certan desrable propertes. We focus here on the class of sparse pror dstrbutons for several reasons: (a) by forcng most of the coeffcents to be zero for any gven nput, sparse prors mnmze redundancy and encourage statstcal ndependence between the varous and between the varous [7], (b) there s growng evdence for sparse representatons n the bran the dstrbuton of neural responses n vsual cortcal areas s hghly kurtotc.e. the cell exhbts lttle actvty for most nputs but responds vgorously for a few nputs, causng a dstrbuton wth a hgh peak near zero and long tals, (c) prevous approaches based on sparseness constrants have obtaned encouragng results [7], and (d) enforcng sparseness on the encourages the parts and local features shared across objects to be learned whle mposng sparseness on the allows object transformatons to be explaned n terms of a small set of basc transformatons. 3.2 Blnear Sparse Codng We assume the followng prors for and : "! where and! are normalzaton constants, $ and % are parameters that control the degree of sparseness, and & s a sparseness functon. For ths study, we used ' & ()+* ',.! (6) (7)
4 & Wthn a probablstc framework, the squared error functon summed over all mages can be nterpreted as representng the negatve log lkelhood of the data gven the parameters: ()+*! (see, for example, [7]). The prors and can be used to margnalze ths lkelhood to obtan the new lkelhood functon:. The goal then s to fnd the that maxmze, or equvalently, mnmze the negatve log of. Under certan reasonable assumptons (dscussed n [7]), ths s equvalent to mnmzng the followng optmzaton functon over all nput mages:, $, % Gradent descent can be used to derve update rules for the components bass : $ & & (8) and of the feature vector and transformaton vector respectvely for any mage, assumng a fxed $, n batch mode accordng to:, (9) % & (10) Gven a tranng set of nputs, the values for and for each mage after convergence can be used to update the bass set $ (11) As suggested by Olshausen and Feld [7], n order to keep the bass vectors from growng wthout bound, we adapted the norm of each bass vector n such a way that the varances of the and were mantaned at a fxed desred level. 4 Results 4.1 Tranng Paradgm We tested the algorthms for blnear sparse codng on natural mage data. The natural mages we used are dstrbuted by Olshausen and Feld [7], along wth the code for ther algorthm. The tranng set of mages conssted of patches randomly extracted from ten source mages. The mages are pre-whtened to equalze large varances n frequency, and thus speed convergence. We choose to use a complete bass where and we let be at least as large as the number of transformatons (ncludng the notransformaton case). The sparseness parameters $ and % were set to and. In order to assst convergence all learnng occurs n batch mode, where the batch conssted of mage patches. The step sze for gradent descent usng Equaton 11 was set to. The transformatons were chosen to be 2D translatons n the range "!#$ pxels n both the axes. The style/content separaton was enforced by learnng a sngle vector to descrbe an mage patch regardless ts translaton, and lkewse a sngle vector to descrbe a partcular style gven any mage patch content. 4.2 Blnear Sparse Codng of Natural Images Fgure 1 shows the results of tranng on natural mage data. A comparson between the learned features for the lnear generatve model (Equaton 1) and the blnear model s
5 (a) Example of lnear bass Example of Blnear bass w w y( 3) w y( 2) w y( 1) w y(0) w y(1) w y(2) w y(3) = 1 = 2 (b) Estmated feature x vector = x y j 3 w j after learnng Canoncal patch Translated patch y y j = Estmated transformaton vectors Fgure 1: Representng natural mages and ther transformatons wth a sparse blnear model. (a) A comparson of learned features between a standard lnear model and a blnear model, both traned wth the same sparseness prors. The two rows for the blnear case depct the translated object features w (see Equaton 3) for translatons of ( pxels. (b) The representaton of an example natural mage patch, and of the same patch translated to the left. Note that the bar plot representng the vector s ndeed sparse, havng only three sgnfcant coeffcents. The code for the style vectors for both the canoncal patch, and the translated one s lkewse sparse. The bass mages are shown for those dmensons whch have non-zero coeffcents for or. provded n Fgure 1 (a). Although both show smple, localzed, and orented features, the blnear method s able to model the same features under dfferent transformatons. In ths case, the range $ horzontal translatons were used n the tranng of the blnear model. Fgure 1 (b) provdes an example of how the blnear sparse codng model encodes a natural mage patch and the same patch after t has been translated. Note that both the and vectors are sparse. Fgure 2 shows how the model can account for a gven localzed feature at dfferent locatons by varyng the y vector. As shown n the last column of the fgure, the translated local feature s generated by lnearly combnng a sparse set of bass vectors. 4.3 Towards Parts-Based Object Recognton The blnear generatve model n Equaton 2 uses the same set of transformaton values for all the features. Such a model s approprate for global transformatons
6 Feature 1 (x 57 ) y( 1,+2) Selected transformatons w j y(0,3) Feature 2 (x 32 ) y( 2,0) w j j = y(+1,0) j = Fgure 2: Translatng a learned feature to multple locatons. The two rows of eght mages represent the ndvdual bass vectors for two values of. The values for two selected transformatons for each are shown as bar plots. ' & denotes a translaton of ' pxels n the Cartesan plane. The last column shows the resultng bass vectors after translaton. that apply to an entre mage regon such as a shft of llumnaton change. pxels for an mage patch or a global Consder the problem of representng an object n terms of ts consttuent parts. In ths case, we would lke to be able to transform each part ndependently of other parts n order to account for the locaton, orentaton, and sze of each part n the object mage. The standard blnear model can be extended to address ths need as follows: Note that each object feature now has ts own set of transformaton values for all.. The double summaton s thus no longer symmetrc. Also note that the standard model (Equaton 2) s a specal case of Equaton 12 where We have conducted prelmnary experments to test the feasblty of Equaton 12 usng a set of object features learned for the standard blnear model. Fg. 3 shows the results. These results suggest that allowng ndependent transformatons for the dfferent features provdes a rch substrate for modelng mages and objects n terms of a set of local features (or parts) and ther ndvdual transformatons. 5 Summary and Concluson A fundamental problem n vson s to smultaneously recognze objects and ther transformatons [8, 10]. Blnear generatve models provde a tractable way of addressng ths problem by factorng an mage nto object features and transformatons usng a blnear equaton. Prevous approaches used unconstraned blnear models and produced global bass vectors for mage representaton [12]. In contrast, recent research on mage codng has stressed the mportance of localzed, ndependent features derved from metrcs that emphasze the hgher-order statstcs of nputs [6, 3, 7, 5]. Ths paper ntroduces a new probablstc framework for learnng blnear generatve models based on the dea of sparse codng. Our results demonstrate that blnear sparse codng of natural mages produces localzed orented bass vectors that can smultaneously represent features n an mage and ther transformaton. We showed how the learned generatve model can be used to translate a (12)
7 (a) w y 81 y(0,1) x 81 z x w y x 57 y(0,1) (b) w 81 j y 81 j y 81 y(0,1) y 57 y( 2,0) x 81 x 57 z y( 2,0) y(0,1) y(1,0) y(1,1) y(1,0) y(1,1) Fgure 3: Modelng ndependently transformed features. (a) shows the standard blnear method of generatng a translated feature by combnng bass vectors usng the same set of values for two dfferent features ( and ). (b) shows four examples of mages generated by allowng dfferent values of for the two dfferent features. Note the sgnfcant dfferences between the resultng mages, whch cannot be obtaned usng the standard blnear model. bass vector to dfferent locatons, thereby reducng the need to learn the same bass vector at multple locatons as n tradtonal sparse codng methods. We also proposed an extenson of the blnear model that allows each feature to be transformed ndependently of other features. Our prelmnary results suggest that such an approach could provde a flexble platform for adaptve parts-based object recognton, wheren objects are descrbed by a set of ndependent, shared parts and ther transformatons. The mportance of parts-based methods has long been recognzed n object recognton n vew of ther ablty to handle a combnatorally large number of objects by combnng parts and ther transformatons. Few methods, f any, exst for learnng representatons of object parts and ther transformatons drectly from mages. Our ongong efforts are therefore focused on dervng effcent algorthms for parts-based object recognton based on the combnaton of blnear models and sparse codng.
8 Acknowledgments Ths research s supported by NSF grant no and a Sloan Research Fellowshp to RPNR. References [1] F. Attneave. Some nformatonal aspects of vsual percepton. Psychologcal Revew, 61(3): , [2] H. B. Barlow. Possble prncples underlyng the transformaton of sensory messages. In W. A. Rosenblth, edtor, Sensory Communcaton, pages Cambrdge, MA: MIT Press, [3] A. J. Bell and T. J. Sejnowsk. The ndependent components of natural scenes are edge flters. Vson Research, 37(23): , [4] G. E. Hnton and Z. Ghahraman. Generatve models for dscoverng sparse dstrbuted representatons. Phlosophcal Transactons Royal Socety B, 352( ), [5] M. S. Lewck and T. J. Sejnowsk. Learnng overcomplete representatons. Neural Computaton, 12(2): , [6] B. A. Olshausen and D. J. Feld. Emergence of smple-cell receptve feld propertes by learnng a sparse code for natural mages. Nature, 381: , [7] B. A. Olshausen and D. J. Feld. Sparse codng wth an overcomplete bass set: A strategy employed by V1? Vson Research, 37: , [8] R. P. N. Rao and D. H. Ballard. Development of localzed orented receptve felds by learnng a translaton-nvarant code for natural mages. Network: Computaton n Neural Systems, 9(2): , [9] R. P. N. Rao and D. H. Ballard. Predctve codng n the vsual cortex: A functonal nterpretaton of some extra-classcal receptve feld effects. Nature Neuroscence, 2(1):79 87, [10] R. P. N. Rao and D. L. Ruderman. Learnng Le groups for nvarant vsual percepton. In Advances n Neural Informaton Processng Systems 11, pages Cambrdge, MA: MIT Press, [11] O. Schwartz and E. P. Smoncell. Natural sgnal statstcs and sensory gan control. Nature Neuroscence, 4(8): , August [12] J. B. Tenenbaum and W. T. Freeman. Separatng style and content wth blnear models. Neural Computaton, 12(6): , 2000.
Feature Reduction and Selection
Feature Reducton and Selecton Dr. Shuang LIANG School of Software Engneerng TongJ Unversty Fall, 2012 Today s Topcs Introducton Problems of Dmensonalty Feature Reducton Statstc methods Prncpal Components
More informationLecture 5: Multilayer Perceptrons
Lecture 5: Multlayer Perceptrons Roger Grosse 1 Introducton So far, we ve only talked about lnear models: lnear regresson and lnear bnary classfers. We noted that there are functons that can t be represented
More informationIMAGE FUSION TECHNIQUES
Int. J. Chem. Sc.: 14(S3), 2016, 812-816 ISSN 0972-768X www.sadgurupublcatons.com IMAGE FUSION TECHNIQUES A Short Note P. SUBRAMANIAN *, M. SOWNDARIYA, S. SWATHI and SAINTA MONICA ECE Department, Aarupada
More informationParallelism for Nested Loops with Non-uniform and Flow Dependences
Parallelsm for Nested Loops wth Non-unform and Flow Dependences Sam-Jn Jeong Dept. of Informaton & Communcaton Engneerng, Cheonan Unversty, 5, Anseo-dong, Cheonan, Chungnam, 330-80, Korea. seong@cheonan.ac.kr
More informationContent Based Image Retrieval Using 2-D Discrete Wavelet with Texture Feature with Different Classifiers
IOSR Journal of Electroncs and Communcaton Engneerng (IOSR-JECE) e-issn: 78-834,p- ISSN: 78-8735.Volume 9, Issue, Ver. IV (Mar - Apr. 04), PP 0-07 Content Based Image Retreval Usng -D Dscrete Wavelet wth
More informationSubspace clustering. Clustering. Fundamental to all clustering techniques is the choice of distance measure between data points;
Subspace clusterng Clusterng Fundamental to all clusterng technques s the choce of dstance measure between data ponts; D q ( ) ( ) 2 x x = x x, j k = 1 k jk Squared Eucldean dstance Assumpton: All features
More informationSupport Vector Machines
/9/207 MIST.6060 Busness Intellgence and Data Mnng What are Support Vector Machnes? Support Vector Machnes Support Vector Machnes (SVMs) are supervsed learnng technques that analyze data and recognze patterns.
More informationA Binarization Algorithm specialized on Document Images and Photos
A Bnarzaton Algorthm specalzed on Document mages and Photos Ergna Kavalleratou Dept. of nformaton and Communcaton Systems Engneerng Unversty of the Aegean kavalleratou@aegean.gr Abstract n ths paper, a
More informationFace Recognition University at Buffalo CSE666 Lecture Slides Resources:
Face Recognton Unversty at Buffalo CSE666 Lecture Sldes Resources: http://www.face-rec.org/algorthms/ Overvew of face recognton algorthms Correlaton - Pxel based correspondence between two face mages Structural
More informationCluster Analysis of Electrical Behavior
Journal of Computer and Communcatons, 205, 3, 88-93 Publshed Onlne May 205 n ScRes. http://www.scrp.org/ournal/cc http://dx.do.org/0.4236/cc.205.350 Cluster Analyss of Electrcal Behavor Ln Lu Ln Lu, School
More informationLECTURE : MANIFOLD LEARNING
LECTURE : MANIFOLD LEARNING Rta Osadchy Some sldes are due to L.Saul, V. C. Raykar, N. Verma Topcs PCA MDS IsoMap LLE EgenMaps Done! Dmensonalty Reducton Data representaton Inputs are real-valued vectors
More informationOutline. Discriminative classifiers for image recognition. Where in the World? A nearest neighbor recognition example 4/14/2011. CS 376 Lecture 22 1
4/14/011 Outlne Dscrmnatve classfers for mage recognton Wednesday, Aprl 13 Krsten Grauman UT-Austn Last tme: wndow-based generc obect detecton basc ppelne face detecton wth boostng as case study Today:
More informationSmoothing Spline ANOVA for variable screening
Smoothng Splne ANOVA for varable screenng a useful tool for metamodels tranng and mult-objectve optmzaton L. Rcco, E. Rgon, A. Turco Outlne RSM Introducton Possble couplng Test case MOO MOO wth Game Theory
More informationEdge Detection in Noisy Images Using the Support Vector Machines
Edge Detecton n Nosy Images Usng the Support Vector Machnes Hlaro Gómez-Moreno, Saturnno Maldonado-Bascón, Francsco López-Ferreras Sgnal Theory and Communcatons Department. Unversty of Alcalá Crta. Madrd-Barcelona
More informationRecognizing Faces. Outline
Recognzng Faces Drk Colbry Outlne Introducton and Motvaton Defnng a feature vector Prncpal Component Analyss Lnear Dscrmnate Analyss !"" #$""% http://www.nfotech.oulu.f/annual/2004 + &'()*) '+)* 2 ! &
More informationDiscriminative Dictionary Learning with Pairwise Constraints
Dscrmnatve Dctonary Learnng wth Parwse Constrants Humn Guo Zhuoln Jang LARRY S. DAVIS UNIVERSITY OF MARYLAND Nov. 6 th, Outlne Introducton/motvaton Dctonary Learnng Dscrmnatve Dctonary Learnng wth Parwse
More informationOutline. Self-Organizing Maps (SOM) US Hebbian Learning, Cntd. The learning rule is Hebbian like:
Self-Organzng Maps (SOM) Turgay İBRİKÇİ, PhD. Outlne Introducton Structures of SOM SOM Archtecture Neghborhoods SOM Algorthm Examples Summary 1 2 Unsupervsed Hebban Learnng US Hebban Learnng, Cntd 3 A
More informationFEATURE EXTRACTION. Dr. K.Vijayarekha. Associate Dean School of Electrical and Electronics Engineering SASTRA University, Thanjavur
FEATURE EXTRACTION Dr. K.Vjayarekha Assocate Dean School of Electrcal and Electroncs Engneerng SASTRA Unversty, Thanjavur613 41 Jont Intatve of IITs and IISc Funded by MHRD Page 1 of 8 Table of Contents
More informationThe Research of Support Vector Machine in Agricultural Data Classification
The Research of Support Vector Machne n Agrcultural Data Classfcaton Le Sh, Qguo Duan, Xnmng Ma, Me Weng College of Informaton and Management Scence, HeNan Agrcultural Unversty, Zhengzhou 45000 Chna Zhengzhou
More informationAn Application of the Dulmage-Mendelsohn Decomposition to Sparse Null Space Bases of Full Row Rank Matrices
Internatonal Mathematcal Forum, Vol 7, 2012, no 52, 2549-2554 An Applcaton of the Dulmage-Mendelsohn Decomposton to Sparse Null Space Bases of Full Row Rank Matrces Mostafa Khorramzadeh Department of Mathematcal
More informationBrushlet Features for Texture Image Retrieval
DICTA00: Dgtal Image Computng Technques and Applcatons, 1 January 00, Melbourne, Australa 1 Brushlet Features for Texture Image Retreval Chbao Chen and Kap Luk Chan Informaton System Research Lab, School
More informationS1 Note. Basis functions.
S1 Note. Bass functons. Contents Types of bass functons...1 The Fourer bass...2 B-splne bass...3 Power and type I error rates wth dfferent numbers of bass functons...4 Table S1. Smulaton results of type
More informationTN348: Openlab Module - Colocalization
TN348: Openlab Module - Colocalzaton Topc The Colocalzaton module provdes the faclty to vsualze and quantfy colocalzaton between pars of mages. The Colocalzaton wndow contans a prevew of the two mages
More informationModular PCA Face Recognition Based on Weighted Average
odern Appled Scence odular PCA Face Recognton Based on Weghted Average Chengmao Han (Correspondng author) Department of athematcs, Lny Normal Unversty Lny 76005, Chna E-mal: hanchengmao@163.com Abstract
More informationA Fast Content-Based Multimedia Retrieval Technique Using Compressed Data
A Fast Content-Based Multmeda Retreval Technque Usng Compressed Data Borko Furht and Pornvt Saksobhavvat NSF Multmeda Laboratory Florda Atlantc Unversty, Boca Raton, Florda 3343 ABSTRACT In ths paper,
More informationA New Feature of Uniformity of Image Texture Directions Coinciding with the Human Eyes Perception 1
A New Feature of Unformty of Image Texture Drectons Concdng wth the Human Eyes Percepton Xng-Jan He, De-Shuang Huang, Yue Zhang, Tat-Mng Lo 2, and Mchael R. Lyu 3 Intellgent Computng Lab, Insttute of Intellgent
More informationCS 534: Computer Vision Model Fitting
CS 534: Computer Vson Model Fttng Sprng 004 Ahmed Elgammal Dept of Computer Scence CS 534 Model Fttng - 1 Outlnes Model fttng s mportant Least-squares fttng Maxmum lkelhood estmaton MAP estmaton Robust
More informationClassifying Acoustic Transient Signals Using Artificial Intelligence
Classfyng Acoustc Transent Sgnals Usng Artfcal Intellgence Steve Sutton, Unversty of North Carolna At Wlmngton (suttons@charter.net) Greg Huff, Unversty of North Carolna At Wlmngton (jgh7476@uncwl.edu)
More informationy and the total sum of
Lnear regresson Testng for non-lnearty In analytcal chemstry, lnear regresson s commonly used n the constructon of calbraton functons requred for analytcal technques such as gas chromatography, atomc absorpton
More informationProblem Definitions and Evaluation Criteria for Computational Expensive Optimization
Problem efntons and Evaluaton Crtera for Computatonal Expensve Optmzaton B. Lu 1, Q. Chen and Q. Zhang 3, J. J. Lang 4, P. N. Suganthan, B. Y. Qu 6 1 epartment of Computng, Glyndwr Unversty, UK Faclty
More informationHigh-Boost Mesh Filtering for 3-D Shape Enhancement
Hgh-Boost Mesh Flterng for 3-D Shape Enhancement Hrokazu Yagou Λ Alexander Belyaev y Damng We z Λ y z ; ; Shape Modelng Laboratory, Unversty of Azu, Azu-Wakamatsu 965-8580 Japan y Computer Graphcs Group,
More informationMachine Learning. Support Vector Machines. (contains material adapted from talks by Constantin F. Aliferis & Ioannis Tsamardinos, and Martin Law)
Machne Learnng Support Vector Machnes (contans materal adapted from talks by Constantn F. Alfers & Ioanns Tsamardnos, and Martn Law) Bryan Pardo, Machne Learnng: EECS 349 Fall 2014 Support Vector Machnes
More informationImprovement of Spatial Resolution Using BlockMatching Based Motion Estimation and Frame. Integration
Improvement of Spatal Resoluton Usng BlockMatchng Based Moton Estmaton and Frame Integraton Danya Suga and Takayuk Hamamoto Graduate School of Engneerng, Tokyo Unversty of Scence, 6-3-1, Nuku, Katsuska-ku,
More informationX- Chart Using ANOM Approach
ISSN 1684-8403 Journal of Statstcs Volume 17, 010, pp. 3-3 Abstract X- Chart Usng ANOM Approach Gullapall Chakravarth 1 and Chaluvad Venkateswara Rao Control lmts for ndvdual measurements (X) chart are
More informationOptimal Workload-based Weighted Wavelet Synopses
Optmal Workload-based Weghted Wavelet Synopses Yoss Matas School of Computer Scence Tel Avv Unversty Tel Avv 69978, Israel matas@tau.ac.l Danel Urel School of Computer Scence Tel Avv Unversty Tel Avv 69978,
More informationImage Alignment CSC 767
Image Algnment CSC 767 Image algnment Image from http://graphcs.cs.cmu.edu/courses/15-463/2010_fall/ Image algnment: Applcatons Panorama sttchng Image algnment: Applcatons Recognton of object nstances
More informationSLAM Summer School 2006 Practical 2: SLAM using Monocular Vision
SLAM Summer School 2006 Practcal 2: SLAM usng Monocular Vson Javer Cvera, Unversty of Zaragoza Andrew J. Davson, Imperal College London J.M.M Montel, Unversty of Zaragoza. josemar@unzar.es, jcvera@unzar.es,
More informationSum of Linear and Fractional Multiobjective Programming Problem under Fuzzy Rules Constraints
Australan Journal of Basc and Appled Scences, 2(4): 1204-1208, 2008 ISSN 1991-8178 Sum of Lnear and Fractonal Multobjectve Programmng Problem under Fuzzy Rules Constrants 1 2 Sanjay Jan and Kalash Lachhwan
More informationHybrid Non-Blind Color Image Watermarking
Hybrd Non-Blnd Color Image Watermarkng Ms C.N.Sujatha 1, Dr. P. Satyanarayana 2 1 Assocate Professor, Dept. of ECE, SNIST, Yamnampet, Ghatkesar Hyderabad-501301, Telangana 2 Professor, Dept. of ECE, AITS,
More informationHuman Face Recognition Using Generalized. Kernel Fisher Discriminant
Human Face Recognton Usng Generalzed Kernel Fsher Dscrmnant ng-yu Sun,2 De-Shuang Huang Ln Guo. Insttute of Intellgent Machnes, Chnese Academy of Scences, P.O.ox 30, Hefe, Anhu, Chna. 2. Department of
More informationA Novel Adaptive Descriptor Algorithm for Ternary Pattern Textures
A Novel Adaptve Descrptor Algorthm for Ternary Pattern Textures Fahuan Hu 1,2, Guopng Lu 1 *, Zengwen Dong 1 1.School of Mechancal & Electrcal Engneerng, Nanchang Unversty, Nanchang, 330031, Chna; 2. School
More informationLocal Quaternary Patterns and Feature Local Quaternary Patterns
Local Quaternary Patterns and Feature Local Quaternary Patterns Jayu Gu and Chengjun Lu The Department of Computer Scence, New Jersey Insttute of Technology, Newark, NJ 0102, USA Abstract - Ths paper presents
More informationMULTISPECTRAL IMAGES CLASSIFICATION BASED ON KLT AND ATR AUTOMATIC TARGET RECOGNITION
MULTISPECTRAL IMAGES CLASSIFICATION BASED ON KLT AND ATR AUTOMATIC TARGET RECOGNITION Paulo Quntlano 1 & Antono Santa-Rosa 1 Federal Polce Department, Brasla, Brazl. E-mals: quntlano.pqs@dpf.gov.br and
More informationSupport Vector Machines
Support Vector Machnes Decson surface s a hyperplane (lne n 2D) n feature space (smlar to the Perceptron) Arguably, the most mportant recent dscovery n machne learnng In a nutshell: map the data to a predetermned
More informationTerm Weighting Classification System Using the Chi-square Statistic for the Classification Subtask at NTCIR-6 Patent Retrieval Task
Proceedngs of NTCIR-6 Workshop Meetng, May 15-18, 2007, Tokyo, Japan Term Weghtng Classfcaton System Usng the Ch-square Statstc for the Classfcaton Subtask at NTCIR-6 Patent Retreval Task Kotaro Hashmoto
More informationModeling, Manipulating, and Visualizing Continuous Volumetric Data: A Novel Spline-based Approach
Modelng, Manpulatng, and Vsualzng Contnuous Volumetrc Data: A Novel Splne-based Approach Jng Hua Center for Vsual Computng, Department of Computer Scence SUNY at Stony Brook Talk Outlne Introducton and
More informationA Fast Visual Tracking Algorithm Based on Circle Pixels Matching
A Fast Vsual Trackng Algorthm Based on Crcle Pxels Matchng Zhqang Hou hou_zhq@sohu.com Chongzhao Han czhan@mal.xjtu.edu.cn Ln Zheng Abstract: A fast vsual trackng algorthm based on crcle pxels matchng
More informationClassification of Face Images Based on Gender using Dimensionality Reduction Techniques and SVM
Classfcaton of Face Images Based on Gender usng Dmensonalty Reducton Technques and SVM Fahm Mannan 260 266 294 School of Computer Scence McGll Unversty Abstract Ths report presents gender classfcaton based
More informationComparison Study of Textural Descriptors for Training Neural Network Classifiers
Comparson Study of Textural Descrptors for Tranng Neural Network Classfers G.D. MAGOULAS (1) S.A. KARKANIS (1) D.A. KARRAS () and M.N. VRAHATIS (3) (1) Department of Informatcs Unversty of Athens GR-157.84
More informationBackpropagation: In Search of Performance Parameters
Bacpropagaton: In Search of Performance Parameters ANIL KUMAR ENUMULAPALLY, LINGGUO BU, and KHOSROW KAIKHAH, Ph.D. Computer Scence Department Texas State Unversty-San Marcos San Marcos, TX-78666 USA ae049@txstate.edu,
More informationAPPLICATION OF MULTIVARIATE LOSS FUNCTION FOR ASSESSMENT OF THE QUALITY OF TECHNOLOGICAL PROCESS MANAGEMENT
3. - 5. 5., Brno, Czech Republc, EU APPLICATION OF MULTIVARIATE LOSS FUNCTION FOR ASSESSMENT OF THE QUALITY OF TECHNOLOGICAL PROCESS MANAGEMENT Abstract Josef TOŠENOVSKÝ ) Lenka MONSPORTOVÁ ) Flp TOŠENOVSKÝ
More informationAn Accurate Evaluation of Integrals in Convex and Non convex Polygonal Domain by Twelve Node Quadrilateral Finite Element Method
Internatonal Journal of Computatonal and Appled Mathematcs. ISSN 89-4966 Volume, Number (07), pp. 33-4 Research Inda Publcatons http://www.rpublcaton.com An Accurate Evaluaton of Integrals n Convex and
More informationFitting: Deformable contours April 26 th, 2018
4/6/08 Fttng: Deformable contours Aprl 6 th, 08 Yong Jae Lee UC Davs Recap so far: Groupng and Fttng Goal: move from array of pxel values (or flter outputs) to a collecton of regons, objects, and shapes.
More informationTexture Feature Extraction Inspired by Natural Vision System and HMAX Algorithm
The Journal of Mathematcs and Computer Scence Avalable onlne at http://www.tjmcs.com The Journal of Mathematcs and Computer Scence Vol. 4 No.2 (2012) 197-206 Texture Feature Extracton Inspred by Natural
More informationLecture 4: Principal components
/3/6 Lecture 4: Prncpal components 3..6 Multvarate lnear regresson MLR s optmal for the estmaton data...but poor for handlng collnear data Covarance matrx s not nvertble (large condton number) Robustness
More informationLearning a Class-Specific Dictionary for Facial Expression Recognition
BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 16, No 4 Sofa 016 Prnt ISSN: 1311-970; Onlne ISSN: 1314-4081 DOI: 10.1515/cat-016-0067 Learnng a Class-Specfc Dctonary for
More informationPositive Semi-definite Programming Localization in Wireless Sensor Networks
Postve Sem-defnte Programmng Localzaton n Wreless Sensor etworks Shengdong Xe 1,, Jn Wang, Aqun Hu 1, Yunl Gu, Jang Xu, 1 School of Informaton Scence and Engneerng, Southeast Unversty, 10096, anjng Computer
More informationAPPLICATION OF A COMPUTATIONALLY EFFICIENT GEOSTATISTICAL APPROACH TO CHARACTERIZING VARIABLY SPACED WATER-TABLE DATA
RFr"W/FZD JAN 2 4 1995 OST control # 1385 John J Q U ~ M Argonne Natonal Laboratory Argonne, L 60439 Tel: 708-252-5357, Fax: 708-252-3 611 APPLCATON OF A COMPUTATONALLY EFFCENT GEOSTATSTCAL APPROACH TO
More informationPRÉSENTATIONS DE PROJETS
PRÉSENTATIONS DE PROJETS Rex Onlne (V. Atanasu) What s Rex? Rex s an onlne browser for collectons of wrtten documents [1]. Asde ths core functon t has however many other applcatons that make t nterestng
More informationDetection of an Object by using Principal Component Analysis
Detecton of an Object by usng Prncpal Component Analyss 1. G. Nagaven, 2. Dr. T. Sreenvasulu Reddy 1. M.Tech, Department of EEE, SVUCE, Trupath, Inda. 2. Assoc. Professor, Department of ECE, SVUCE, Trupath,
More informationAn Entropy-Based Approach to Integrated Information Needs Assessment
Dstrbuton Statement A: Approved for publc release; dstrbuton s unlmted. An Entropy-Based Approach to ntegrated nformaton Needs Assessment June 8, 2004 Wllam J. Farrell Lockheed Martn Advanced Technology
More informationUnsupervised Learning
Pattern Recognton Lecture 8 Outlne Introducton Unsupervsed Learnng Parametrc VS Non-Parametrc Approach Mxture of Denstes Maxmum-Lkelhood Estmates Clusterng Prof. Danel Yeung School of Computer Scence and
More informationAccounting for the Use of Different Length Scale Factors in x, y and z Directions
1 Accountng for the Use of Dfferent Length Scale Factors n x, y and z Drectons Taha Soch (taha.soch@kcl.ac.uk) Imagng Scences & Bomedcal Engneerng, Kng s College London, The Rayne Insttute, St Thomas Hosptal,
More informationIMAGE FUSION BASED ON EXTENSIONS OF INDEPENDENT COMPONENT ANALYSIS
IMAGE FUSION BASED ON EXTENSIONS OF INDEPENDENT COMPONENT ANALYSIS M Chen a, *, Yngchun Fu b, Deren L c, Qanqng Qn c a College of Educaton Technology, Captal Normal Unversty, Bejng 00037,Chna - (merc@hotmal.com)
More informationLearning the Kernel Parameters in Kernel Minimum Distance Classifier
Learnng the Kernel Parameters n Kernel Mnmum Dstance Classfer Daoqang Zhang 1,, Songcan Chen and Zh-Hua Zhou 1* 1 Natonal Laboratory for Novel Software Technology Nanjng Unversty, Nanjng 193, Chna Department
More informationFast Feature Value Searching for Face Detection
Vol., No. 2 Computer and Informaton Scence Fast Feature Value Searchng for Face Detecton Yunyang Yan Department of Computer Engneerng Huayn Insttute of Technology Hua an 22300, Chna E-mal: areyyyke@63.com
More informationRecognition of Handwritten Numerals Using a Combined Classifier with Hybrid Features
Recognton of Handwrtten Numerals Usng a Combned Classfer wth Hybrd Features Kyoung Mn Km 1,4, Joong Jo Park 2, Young G Song 3, In Cheol Km 1, and Chng Y. Suen 1 1 Centre for Pattern Recognton and Machne
More informationUnsupervised Learning and Clustering
Unsupervsed Learnng and Clusterng Supervsed vs. Unsupervsed Learnng Up to now we consdered supervsed learnng scenaro, where we are gven 1. samples 1,, n 2. class labels for all samples 1,, n Ths s also
More informationOutline. Type of Machine Learning. Examples of Application. Unsupervised Learning
Outlne Artfcal Intellgence and ts applcatons Lecture 8 Unsupervsed Learnng Professor Danel Yeung danyeung@eee.org Dr. Patrck Chan patrckchan@eee.org South Chna Unversty of Technology, Chna Introducton
More informationTsinghua University at TAC 2009: Summarizing Multi-documents by Information Distance
Tsnghua Unversty at TAC 2009: Summarzng Mult-documents by Informaton Dstance Chong Long, Mnle Huang, Xaoyan Zhu State Key Laboratory of Intellgent Technology and Systems, Tsnghua Natonal Laboratory for
More informationCOMPLEX WAVELET TRANSFORM-BASED COLOR INDEXING FOR CONTENT-BASED IMAGE RETRIEVAL
COMPLEX WAVELET TRANSFORM-BASED COLOR INDEXING FOR CONTENT-BASED IMAGE RETRIEVAL Nader Safavan and Shohreh Kasae Department of Computer Engneerng Sharf Unversty of Technology Tehran, Iran skasae@sharf.edu
More informationA New Approach For the Ranking of Fuzzy Sets With Different Heights
New pproach For the ankng of Fuzzy Sets Wth Dfferent Heghts Pushpnder Sngh School of Mathematcs Computer pplcatons Thapar Unversty, Patala-7 00 Inda pushpndersnl@gmalcom STCT ankng of fuzzy sets plays
More informationDetermining the Optimal Bandwidth Based on Multi-criterion Fusion
Proceedngs of 01 4th Internatonal Conference on Machne Learnng and Computng IPCSIT vol. 5 (01) (01) IACSIT Press, Sngapore Determnng the Optmal Bandwdth Based on Mult-crteron Fuson Ha-L Lang 1+, Xan-Mn
More informationUnsupervised Learning and Clustering
Unsupervsed Learnng and Clusterng Why consder unlabeled samples?. Collectng and labelng large set of samples s costly Gettng recorded speech s free, labelng s tme consumng 2. Classfer could be desgned
More informationClassifier Selection Based on Data Complexity Measures *
Classfer Selecton Based on Data Complexty Measures * Edth Hernández-Reyes, J.A. Carrasco-Ochoa, and J.Fco. Martínez-Trndad Natonal Insttute for Astrophyscs, Optcs and Electroncs, Lus Enrque Erro No.1 Sta.
More information2x x l. Module 3: Element Properties Lecture 4: Lagrange and Serendipity Elements
Module 3: Element Propertes Lecture : Lagrange and Serendpty Elements 5 In last lecture note, the nterpolaton functons are derved on the bass of assumed polynomal from Pascal s trangle for the fled varable.
More informationFeature Extractions for Iris Recognition
Feature Extractons for Irs Recognton Jnwook Go, Jan Jang, Yllbyung Lee, and Chulhee Lee Department of Electrcal and Electronc Engneerng, Yonse Unversty 134 Shnchon-Dong, Seodaemoon-Gu, Seoul, KOREA Emal:
More information12/2/2009. Announcements. Parametric / Non-parametric. Case-Based Reasoning. Nearest-Neighbor on Images. Nearest-Neighbor Classification
Introducton to Artfcal Intellgence V22.0472-001 Fall 2009 Lecture 24: Nearest-Neghbors & Support Vector Machnes Rob Fergus Dept of Computer Scence, Courant Insttute, NYU Sldes from Danel Yeung, John DeNero
More informationHermite Splines in Lie Groups as Products of Geodesics
Hermte Splnes n Le Groups as Products of Geodescs Ethan Eade Updated May 28, 2017 1 Introducton 1.1 Goal Ths document defnes a curve n the Le group G parametrzed by tme and by structural parameters n the
More informationRange images. Range image registration. Examples of sampling patterns. Range images and range surfaces
Range mages For many structured lght scanners, the range data forms a hghly regular pattern known as a range mage. he samplng pattern s determned by the specfc scanner. Range mage regstraton 1 Examples
More informationA Gradient Difference based Technique for Video Text Detection
A Gradent Dfference based Technque for Vdeo Text Detecton Palaahnakote Shvakumara, Trung Quy Phan and Chew Lm Tan School of Computng, Natonal Unversty of Sngapore {shva, phanquyt, tancl }@comp.nus.edu.sg
More informationUsing Fuzzy Logic to Enhance the Large Size Remote Sensing Images
Internatonal Journal of Informaton and Electroncs Engneerng Vol. 5 No. 6 November 015 Usng Fuzzy Logc to Enhance the Large Sze Remote Sensng Images Trung Nguyen Tu Huy Ngo Hoang and Thoa Vu Van Abstract
More informationNovel Fuzzy logic Based Edge Detection Technique
Novel Fuzzy logc Based Edge Detecton Technque Aborsade, D.O Department of Electroncs Engneerng, adoke Akntola Unversty of Tech., Ogbomoso. Oyo-state. doaborsade@yahoo.com Abstract Ths paper s based on
More informationAnalysis of Continuous Beams in General
Analyss of Contnuous Beams n General Contnuous beams consdered here are prsmatc, rgdly connected to each beam segment and supported at varous ponts along the beam. onts are selected at ponts of support,
More informationActive Contours/Snakes
Actve Contours/Snakes Erkut Erdem Acknowledgement: The sldes are adapted from the sldes prepared by K. Grauman of Unversty of Texas at Austn Fttng: Edges vs. boundares Edges useful sgnal to ndcate occludng
More informationA Gradient Difference based Technique for Video Text Detection
2009 10th Internatonal Conference on Document Analyss and Recognton A Gradent Dfference based Technque for Vdeo Text Detecton Palaahnakote Shvakumara, Trung Quy Phan and Chew Lm Tan School of Computng,
More informationLecture #15 Lecture Notes
Lecture #15 Lecture Notes The ocean water column s very much a 3-D spatal entt and we need to represent that structure n an economcal way to deal wth t n calculatons. We wll dscuss one way to do so, emprcal
More informationFuzzy Filtering Algorithms for Image Processing: Performance Evaluation of Various Approaches
Proceedngs of the Internatonal Conference on Cognton and Recognton Fuzzy Flterng Algorthms for Image Processng: Performance Evaluaton of Varous Approaches Rajoo Pandey and Umesh Ghanekar Department of
More informationLaplacian Eigenmap for Image Retrieval
Laplacan Egenmap for Image Retreval Xaofe He Partha Nyog Department of Computer Scence The Unversty of Chcago, 1100 E 58 th Street, Chcago, IL 60637 ABSTRACT Dmensonalty reducton has been receved much
More informationRelated-Mode Attacks on CTR Encryption Mode
Internatonal Journal of Network Securty, Vol.4, No.3, PP.282 287, May 2007 282 Related-Mode Attacks on CTR Encrypton Mode Dayn Wang, Dongda Ln, and Wenlng Wu (Correspondng author: Dayn Wang) Key Laboratory
More informationUser Authentication Based On Behavioral Mouse Dynamics Biometrics
User Authentcaton Based On Behavoral Mouse Dynamcs Bometrcs Chee-Hyung Yoon Danel Donghyun Km Department of Computer Scence Department of Computer Scence Stanford Unversty Stanford Unversty Stanford, CA
More informationA Unified Framework for Semantics and Feature Based Relevance Feedback in Image Retrieval Systems
A Unfed Framework for Semantcs and Feature Based Relevance Feedback n Image Retreval Systems Ye Lu *, Chunhu Hu 2, Xngquan Zhu 3*, HongJang Zhang 2, Qang Yang * School of Computng Scence Smon Fraser Unversty
More informationLEARNING A WARPED SUBSPACE MODEL OF FACES WITH IMAGES OF UNKNOWN POSE AND ILLUMINATION
LEARNING A WARPED SUBSPACE MODEL OF FACES WITH IMAGES OF UNKNOWN POSE AND ILLUMINATION Jhun Hamm, and Danel D. Lee GRASP Laboratory, Unversty of Pennsylvana, 3330 Walnut Street, Phladelpha, PA, USA jhham@seas.upenn.edu,
More informationIntegrated Expression-Invariant Face Recognition with Constrained Optical Flow
Integrated Expresson-Invarant Face Recognton wth Constraned Optcal Flow Chao-Kue Hseh, Shang-Hong La 2, and Yung-Chang Chen Department of Electrcal Engneerng, Natonal Tsng Hua Unversty, Tawan 2 Department
More informationFuzzy C-Means Initialized by Fixed Threshold Clustering for Improving Image Retrieval
Fuzzy -Means Intalzed by Fxed Threshold lusterng for Improvng Image Retreval NAWARA HANSIRI, SIRIPORN SUPRATID,HOM KIMPAN 3 Faculty of Informaton Technology Rangst Unversty Muang-Ake, Paholyotn Road, Patumtan,
More informationLearning-based License Plate Detection on Edge Features
Learnng-based Lcense Plate Detecton on Edge Features Wng Teng Ho, Woo Hen Yap, Yong Haur Tay Computer Vson and Intellgent Systems (CVIS) Group Unverst Tunku Abdul Rahman, Malaysa wngteng_h@yahoo.com, woohen@yahoo.com,
More informationAppearance-based Statistical Methods for Face Recognition
47th Internatonal Symposum ELMAR-2005, 08-10 June 2005, Zadar, Croata Appearance-based Statstcal Methods for Face Recognton Kresmr Delac 1, Mslav Grgc 2, Panos Latss 3 1 Croatan elecom, Savsa 32, Zagreb,
More informationAn Image Fusion Approach Based on Segmentation Region
Rong Wang, L-Qun Gao, Shu Yang, Yu-Hua Cha, and Yan-Chun Lu An Image Fuson Approach Based On Segmentaton Regon An Image Fuson Approach Based on Segmentaton Regon Rong Wang, L-Qun Gao, Shu Yang 3, Yu-Hua
More informationObject-Based Techniques for Image Retrieval
54 Zhang, Gao, & Luo Chapter VII Object-Based Technques for Image Retreval Y. J. Zhang, Tsnghua Unversty, Chna Y. Y. Gao, Tsnghua Unversty, Chna Y. Luo, Tsnghua Unversty, Chna ABSTRACT To overcome the
More informationRobust Dictionary Learning with Capped l 1 -Norm
Proceedngs of the Twenty-Fourth Internatonal Jont Conference on Artfcal Intellgence (IJCAI 205) Robust Dctonary Learnng wth Capped l -Norm Wenhao Jang, Fepng Ne, Heng Huang Unversty of Texas at Arlngton
More information