Outline. Self-Organizing Maps (SOM) US Hebbian Learning, Cntd. The learning rule is Hebbian like:
|
|
- Kimberly Campbell
- 6 years ago
- Views:
Transcription
1 Self-Organzng Maps (SOM) Turgay İBRİKÇİ, PhD. Outlne Introducton Structures of SOM SOM Archtecture Neghborhoods SOM Algorthm Examples Summary 1 2 Unsupervsed Hebban Learnng US Hebban Learnng, Cntd 3 A lnear unt: V = W j X j The learnng rule s Hebban lke: ΔW j = ηv j ( X j j VW ) The change n weght depends on the product of the neuron s output and nput, wth a term that makes the weghts decrease 4 Such a net converges nto a weght that maxmzes the average on V 2 Ths means that the weght ponts at the frst prncpal component of the data The network learns a feature of the data wthout any pror knowledge Ths s called feature extracton Unsupervsed Compettve Learnng Smple Compettve Learnng Algorthm In Hebban networks, all neurons can fre at the same tme Compettve learnng means that only a sngle neuron from each group fres at each tme step Output unts compete wth one another. These are wnner takes all-wta unts (grandmother cells) - Intalze weghts of samples from the nput Leaky learnng: also update the weghts of the losers (but wth a smaller h) Arrange neurons n a geometrcal way: update also neghbors Turn on nput patterns gradually Conscence mechansm Add nose to nput patterns 5 6 1
2 Smple Compettve Learnng Network Actvaton N nputs unts P output neurons P x N weghts h = 1, 2... P N = W X j = 1 j j x1 x2 WP1 W11 W12 W22 Y1 Y2 The unt wth the hghest feld h fres * s the wnner unt Geometrcally s closest to the current nput W * The wnnng unt s weght s updated to be even closer to the current nput Y = 1or 0 xn WPN YP 7 8 Learnng Introducton of SOM Startng wth small random weghts, at each step: 1. a new nput s presented to the network 2. all felds are calculated to fnd a wnner 3. s updated to be closer to the nput W * SOM s the neuron network Development n 1980s by Teuvo Kohonen n fnland SOM s the Unsupervsed Learnng SOM look lkes Grd (Smple for lookng) Usng SOM for Clusterng 9 10 Some Hstorcal Notes Prncples of Self Organzaton Local orderng (von der Malsbyrg, 1973) (Amar, 1980) a matematcal analyss elucdates the dynamc stablty of a cortcal map Self-organzng feature map (SOM), (Kohonen 1982) (Erwn, 1992) a convex neghbourhood functon should be used (~ Gaussan) The relatonshp between the SOM and prncpal curves s dcussed (Rtter, 1992 & Cherkassky and Muler, 1995) 1. Modfcatons n synaptc weghts tend to self amplfy 2. Lmtaton of resources lead to competton among synapses 3. Modfcatons n synaptc weghts tend to cooperate 4. Order and structure n actvaton patterns represent redundant nformaton that s transformed nto knowledge by the network
3 13 Determne the wnner (the neuron of whch the weght has the smallest dstance to the nput ) Move the weght w of the wnnng neuron towards the nput w Before learnng w After learnng 14 Impose a topologcal order onto the compettve neurons (e.g., rectangular map) Let neghbors of the wnner share the prze (The postcode lottery prncple) After learnng, neurons wth smlar weghts tend to cluster on the map Another vew of 15 Concept of the SOM Structures of SOM Input space Input layer Reduced feature space Map layer X X X X Ba s 1 lnear X X X X X X Sr Mn s 2 X X X X X X X X X X X X X X X X 17 Cluster centers (code s) Place of these code s n the reduced space Clusterng and orderng of the cluster centers n a two dmensonal grd 18 Rectangular X X X X X X X X X X X X X X X X X Hexagonal 3
4 SOM Archtecture SOM Archtecture Two layers of unts Input: n unts (length of tranng s) Output: m unts (number of categores) Input unts fully connected wth weghts to output unts neghborhood wnnng node Intralayer (lateral) connectons Wthn output layer Defned accordng to some topology, no weghts for those connectons Adaptve process changes weghts to more closely nputs nput (n-dmensonal) SOM Archtecture (2) Neghborhoods Based on the lattce structure, each neuron has a neghborhood of adjacent neurons. Member of neghbors -lnear has 2 nearest neghbors - rectangular has 8 nearest neghbors - hexagonal has 6 nearest neghbors. When a neuron wns a competton, the weghts of the neurons n ts neghborhood are adjusted so the learnng rule s appled locally. Set of Neghborhoods Wnnng node SOM Algorthm Compettve process Intalze weghts randomly set weghts for each node n the map Compettve process fnd the wnnng node Cooperatve process determne the neghborhood of the wnnng neuron at ths tme step. Weght adjustment process nput matrx x = [x 1, x 2, x 3,, x m ] weght matrx w = [ w 1, w 2, w 3,, w n ] dstant d = x w, = { 1,2,3, } wnnng node d = mnmum x w weghts of the wnnng neuron are strengthen and weghts n the neghborng neurons are suppressed
5 Cooperatve process Weght adjustment process The topologcal neghborhood s centered on the wnnng neuron and falls off as the dstance to neghborng neuron ncreases. weght adjustment formula w j (new) = w j (current) + w j w( new) = w( n) + η( n)[ x w( n)] j j j SOM Learnng Algorthm Pseudocode Example 1. Randomly ntalse all weghts and topology (1d or 2d) 2. Select nput x = [x 1, x 2, x 3,, x n ] from tranng set 3. Compare x wth weghts w j for each neuron j to 2 d j = ( w j x ) 4. Determne wnner and fd fnd unt j wth h the mnmum dstance 5. Update wnner so that t becomes more lke x, together wth the wnner s neghbours for unts wthn the radus accordng to wj( n+ 1) = wj( n) + η( n)[ x wj( n 6. Adjust parameters: learnng rate & neghbourhood functon 7. Repeat from (2) untl? )] Form a self-organzng map (SOM) to cluster a set of four s We wll look for 2 clusters for ths set. 27 Note that: Learnng rate generally decreases wth tme: 0 < η( n) η( n 1) 1 28 Trace Trace (2) Input d 1 = d 2 = Input d 1 = d 2 = Weght Weght
6 Trace (3) Trace (4) Input d 1 = d 2 = Input d 1 = d 2 = Weght Weght Trace of Weghts Fnal clusters Intal Epoch Epoch Epoch Epoch Epoch Epoch Epoch fnal cluster assgnment of the nputs: Input Vectors Fnal weght Input d 1 d 2 cluster Analyss Input Vectors Cluster = Cluster Cluster
7 Example for Cluster the color
8 Examples of Applcatons Summary-I 43 Kohonen (1984). Speech recognton - a map of phonemes n the Fnsh language Optcal character recognton - clusterng of letters of dfferent fonts Angelol etal (1988) travellng salesman problem (an optmzaton problem) Kohonen (1990) learnng quantzaton (pattern classfcaton problem) Rtter & Kohonen (1989) semantc maps 44 Unsupervsed learnng s very common US learnng requres redundancy n the stmul Self organzaton s a basc property of the bran s computatonal structure The SOM uses an unsupervsed clusterng process. Propertes of the fnal output map correspond to statstcally related nput data. Summary-II Questons & Answers Almost usng SOM for Clusterng the colors SOMs are based on competton (wnner takes all-wta unts) cooperaton synaptc adaptaton SOMs conserve topologcal relatonshps between the stmul Artfcal SOMs have many applcatons n computatonal neuroscence
KOHONEN'S SELF ORGANIZING NETWORKS WITH "CONSCIENCE"
Kohonen's Self Organzng Maps and ther use n Interpretaton, Dr. M. Turhan (Tury) Taner, Rock Sold Images Page: 1 KOHONEN'S SELF ORGANIZING NETWORKS WITH "CONSCIENCE" By: Dr. M. Turhan (Tury) Taner, Rock
More informationMachine Learning 9. week
Machne Learnng 9. week Mappng Concept Radal Bass Functons (RBF) RBF Networks 1 Mappng It s probably the best scenaro for the classfcaton of two dataset s to separate them lnearly. As you see n the below
More informationHierarchical clustering for gene expression data analysis
Herarchcal clusterng for gene expresson data analyss Gorgo Valentn e-mal: valentn@ds.unm.t Clusterng of Mcroarray Data. Clusterng of gene expresson profles (rows) => dscovery of co-regulated and functonally
More informationSubspace clustering. Clustering. Fundamental to all clustering techniques is the choice of distance measure between data points;
Subspace clusterng Clusterng Fundamental to all clusterng technques s the choce of dstance measure between data ponts; D q ( ) ( ) 2 x x = x x, j k = 1 k jk Squared Eucldean dstance Assumpton: All features
More informationClassifying Acoustic Transient Signals Using Artificial Intelligence
Classfyng Acoustc Transent Sgnals Usng Artfcal Intellgence Steve Sutton, Unversty of North Carolna At Wlmngton (suttons@charter.net) Greg Huff, Unversty of North Carolna At Wlmngton (jgh7476@uncwl.edu)
More informationRecognition of Tifinagh Characters Using Self Organizing Map And Fuzzy K-Nearest Neighbor
Global Journal of Computer Scence and Technology Volume Issue 5 Verson.0 September 0 Type: Double Blnd Peer Revewed Internatonal Research Journal Publsher: Global Journals Inc. (USA) Onlne ISSN: 0975-47
More informationBiological Sequence Mining Using Plausible Neural Network and its Application to Exon/intron Boundaries Prediction
Bologcal Sequence Mnng Usng Plausble Neural Networ and ts Applcaton to Exon/ntron Boundares Predcton Kuochen L, Dar-en Chang, and Erc Roucha CECS, Unversty of Lousvlle, Lousvlle, KY 40292, USA Yuan Yan
More informationLearning the Kernel Parameters in Kernel Minimum Distance Classifier
Learnng the Kernel Parameters n Kernel Mnmum Dstance Classfer Daoqang Zhang 1,, Songcan Chen and Zh-Hua Zhou 1* 1 Natonal Laboratory for Novel Software Technology Nanjng Unversty, Nanjng 193, Chna Department
More information6.854 Advanced Algorithms Petar Maymounkov Problem Set 11 (November 23, 2005) With: Benjamin Rossman, Oren Weimann, and Pouya Kheradpour
6.854 Advanced Algorthms Petar Maymounkov Problem Set 11 (November 23, 2005) Wth: Benjamn Rossman, Oren Wemann, and Pouya Kheradpour Problem 1. We reduce vertex cover to MAX-SAT wth weghts, such that the
More informationOutline. Discriminative classifiers for image recognition. Where in the World? A nearest neighbor recognition example 4/14/2011. CS 376 Lecture 22 1
4/14/011 Outlne Dscrmnatve classfers for mage recognton Wednesday, Aprl 13 Krsten Grauman UT-Austn Last tme: wndow-based generc obect detecton basc ppelne face detecton wth boostng as case study Today:
More informationHYPERSPECTRAL IMAGE CLASSIFICATION USING A SELF-ORGANIZING MAP . (2)
HYPERSPECTRAL IMAGE CLASSIFICATION USING A SELF-ORGANIZING MAP P. Martínez, 1 J.A. Gualter, 2 P.L. Agular, 1 R.M. Pérez, 1 M. Lnaje, 1 J.C. Precado, 1 A. Plaza 1 1. INTRODUCTION The use of hyperspectral
More informationLECTURE : MANIFOLD LEARNING
LECTURE : MANIFOLD LEARNING Rta Osadchy Some sldes are due to L.Saul, V. C. Raykar, N. Verma Topcs PCA MDS IsoMap LLE EgenMaps Done! Dmensonalty Reducton Data representaton Inputs are real-valued vectors
More informationThe Greedy Method. Outline and Reading. Change Money Problem. Greedy Algorithms. Applications of the Greedy Strategy. The Greedy Method Technique
//00 :0 AM Outlne and Readng The Greedy Method The Greedy Method Technque (secton.) Fractonal Knapsack Problem (secton..) Task Schedulng (secton..) Mnmum Spannng Trees (secton.) Change Money Problem Greedy
More informationMachine Learning: Algorithms and Applications
14/05/1 Machne Learnng: Algorthms and Applcatons Florano Zn Free Unversty of Bozen-Bolzano Faculty of Computer Scence Academc Year 011-01 Lecture 10: 14 May 01 Unsupervsed Learnng cont Sldes courtesy of
More informationOutline. Type of Machine Learning. Examples of Application. Unsupervised Learning
Outlne Artfcal Intellgence and ts applcatons Lecture 8 Unsupervsed Learnng Professor Danel Yeung danyeung@eee.org Dr. Patrck Chan patrckchan@eee.org South Chna Unversty of Technology, Chna Introducton
More informationCS 534: Computer Vision Model Fitting
CS 534: Computer Vson Model Fttng Sprng 004 Ahmed Elgammal Dept of Computer Scence CS 534 Model Fttng - 1 Outlnes Model fttng s mportant Least-squares fttng Maxmum lkelhood estmaton MAP estmaton Robust
More informationTime Series Prediction Using RSOM and Local Models
Tme Seres Predcton Usng RSOM and Local Models Peter ANGELOVIČ Slovak Unversty of Technology Faculty of Informatcs and Informaton Technologes Ilkovčova 3, 842 16 Bratslava, Slovaka angelovc@ft.stuba.sk
More informationFace Recognition University at Buffalo CSE666 Lecture Slides Resources:
Face Recognton Unversty at Buffalo CSE666 Lecture Sldes Resources: http://www.face-rec.org/algorthms/ Overvew of face recognton algorthms Correlaton - Pxel based correspondence between two face mages Structural
More informationApplication of Learning Machine Methods to 3 D Object Modeling
Applcaton of Learnng Machne Methods to 3 D Object Modelng Crstna Garca, and José Al Moreno Laboratoro de Computacón Emergente, Facultades de Cencas e Ingenería, Unversdad Central de Venezuela. Caracas,
More informationUnsupervised Learning
Pattern Recognton Lecture 8 Outlne Introducton Unsupervsed Learnng Parametrc VS Non-Parametrc Approach Mxture of Denstes Maxmum-Lkelhood Estmates Clusterng Prof. Danel Yeung School of Computer Scence and
More informationData Mining MTAT (4AP = 6EAP)
Clusterng Data Mnng MTAT018 (AP = 6EAP) Clusterng Jaak Vlo 009 Fall Groupng objects by smlarty Take all data and ask what are typcal examples, groups n data Jaak Vlo and other authors UT: Data Mnng 009
More informationTopics. Clustering. Unsupervised vs. Supervised. Vehicle Example. Vehicle Clusters Advanced Algorithmics
.0.009 Topcs Advanced Algorthmcs Clusterng Jaak Vlo 009 Sprng What s clusterng Herarchcal clusterng K means + K medods SOM Fuzzy EM Jaak Vlo MTAT.0.90 Text Algorthms Unsupervsed vs. Supervsed Clusterng
More informationBrief Review of Self-Organizing Maps
Bref Revew of Self-Organzng Maps Dubravko Mljkovć Hrvatska elektroprvreda, Zagreb, Croata dubravko.mljkovc@hep.hr Abstract - As a partcular type of artfcal neural networks, self-organzng maps (SOMs) are
More informationAnnouncements. Supervised Learning
Announcements See Chapter 5 of Duda, Hart, and Stork. Tutoral by Burge lnked to on web page. Supervsed Learnng Classfcaton wth labeled eamples. Images vectors n hgh-d space. Supervsed Learnng Labeled eamples
More informationK-means and Hierarchical Clustering
Note to other teachers and users of these sldes. Andrew would be delghted f you found ths source materal useful n gvng your own lectures. Feel free to use these sldes verbatm, or to modfy them to ft your
More informationA SCALABLE DIGITAL ARCHITECTURE OF A KOHONEN NEURAL NETWORK
A SCALABLE DIGITAL ARCHITECTURE OF A KOHONEN NEURAL NETWORK Andrés E. Valenca, Jorge A. Peña and Maurco Vanegas. Unversdad Pontfca Bolvarana, Medellín, Colomba andrez_valenca@yahoo.com, jorge.pena@alar.ch,
More informationMachine Learning. Topic 6: Clustering
Machne Learnng Topc 6: lusterng lusterng Groupng data nto (hopefully useful) sets. Thngs on the left Thngs on the rght Applcatons of lusterng Hypothess Generaton lusters mght suggest natural groups. Hypothess
More informationClassifier Selection Based on Data Complexity Measures *
Classfer Selecton Based on Data Complexty Measures * Edth Hernández-Reyes, J.A. Carrasco-Ochoa, and J.Fco. Martínez-Trndad Natonal Insttute for Astrophyscs, Optcs and Electroncs, Lus Enrque Erro No.1 Sta.
More informationSelection of Streets from a Network Using Self-Organizing Maps
NOT FOR CITATION, TO BE PUBLISHED IN TRANSACTIONS IN GIS 1 Selecton of Streets from a Network Usng Self-Organzng Maps Bn Jang 1 and Lars Harre 2 1 Dvson of Geomatcs, Dept. of Technology and Bult Envronment
More informationLecture 5: Multilayer Perceptrons
Lecture 5: Multlayer Perceptrons Roger Grosse 1 Introducton So far, we ve only talked about lnear models: lnear regresson and lnear bnary classfers. We noted that there are functons that can t be represented
More informationRecognizing Faces. Outline
Recognzng Faces Drk Colbry Outlne Introducton and Motvaton Defnng a feature vector Prncpal Component Analyss Lnear Dscrmnate Analyss !"" #$""% http://www.nfotech.oulu.f/annual/2004 + &'()*) '+)* 2 ! &
More information12/2/2009. Announcements. Parametric / Non-parametric. Case-Based Reasoning. Nearest-Neighbor on Images. Nearest-Neighbor Classification
Introducton to Artfcal Intellgence V22.0472-001 Fall 2009 Lecture 24: Nearest-Neghbors & Support Vector Machnes Rob Fergus Dept of Computer Scence, Courant Insttute, NYU Sldes from Danel Yeung, John DeNero
More informationUnsupervised Learning and Clustering
Unsupervsed Learnng and Clusterng Why consder unlabeled samples?. Collectng and labelng large set of samples s costly Gettng recorded speech s free, labelng s tme consumng 2. Classfer could be desgned
More informationKent State University CS 4/ Design and Analysis of Algorithms. Dept. of Math & Computer Science LECT-16. Dynamic Programming
CS 4/560 Desgn and Analyss of Algorthms Kent State Unversty Dept. of Math & Computer Scence LECT-6 Dynamc Programmng 2 Dynamc Programmng Dynamc Programmng, lke the dvde-and-conquer method, solves problems
More informationDiscriminative Dictionary Learning with Pairwise Constraints
Dscrmnatve Dctonary Learnng wth Parwse Constrants Humn Guo Zhuoln Jang LARRY S. DAVIS UNIVERSITY OF MARYLAND Nov. 6 th, Outlne Introducton/motvaton Dctonary Learnng Dscrmnatve Dctonary Learnng wth Parwse
More informationProgramming in Fortran 90 : 2017/2018
Programmng n Fortran 90 : 2017/2018 Programmng n Fortran 90 : 2017/2018 Exercse 1 : Evaluaton of functon dependng on nput Wrte a program who evaluate the functon f (x,y) for any two user specfed values
More informationMulti-stable Perception. Necker Cube
Mult-stable Percepton Necker Cube Spnnng dancer lluson, Nobuuk Kaahara Fttng and Algnment Computer Vson Szelsk 6.1 James Has Acknowledgment: Man sldes from Derek Hoem, Lana Lazebnk, and Grauman&Lebe 2008
More informationSupport Vector Machines
Support Vector Machnes Decson surface s a hyperplane (lne n 2D) n feature space (smlar to the Perceptron) Arguably, the most mportant recent dscovery n machne learnng In a nutshell: map the data to a predetermned
More informationSupport Vector Machines
/9/207 MIST.6060 Busness Intellgence and Data Mnng What are Support Vector Machnes? Support Vector Machnes Support Vector Machnes (SVMs) are supervsed learnng technques that analyze data and recognze patterns.
More informationSmoothing Spline ANOVA for variable screening
Smoothng Splne ANOVA for varable screenng a useful tool for metamodels tranng and mult-objectve optmzaton L. Rcco, E. Rgon, A. Turco Outlne RSM Introducton Possble couplng Test case MOO MOO wth Game Theory
More informationAPPLIED MACHINE LEARNING
Methods for Clusterng K-means, Soft K-means DBSCAN 1 Objectves Learn basc technques for data clusterng K-means and soft K-means, GMM (next lecture) DBSCAN Understand the ssues and major challenges n clusterng
More informationSHAPE RECOGNITION METHOD BASED ON THE k-nearest NEIGHBOR RULE
SHAPE RECOGNITION METHOD BASED ON THE k-nearest NEIGHBOR RULE Dorna Purcaru Faculty of Automaton, Computers and Electroncs Unersty of Craoa 13 Al. I. Cuza Street, Craoa RO-1100 ROMANIA E-mal: dpurcaru@electroncs.uc.ro
More informationPerformance Assessment and Fault Diagnosis for Hydraulic Pump Based on WPT and SOM
Performance Assessment and Fault Dagnoss for Hydraulc Pump Based on WPT and SOM Be Jkun, Lu Chen and Wang Zl PERFORMANCE ASSESSMENT AND FAULT DIAGNOSIS FOR HYDRAULIC PUMP BASED ON WPT AND SOM. Be Jkun,
More informationTexture Feature Extraction Inspired by Natural Vision System and HMAX Algorithm
The Journal of Mathematcs and Computer Scence Avalable onlne at http://www.tjmcs.com The Journal of Mathematcs and Computer Scence Vol. 4 No.2 (2012) 197-206 Texture Feature Extracton Inspred by Natural
More informationFitting & Matching. Lecture 4 Prof. Bregler. Slides from: S. Lazebnik, S. Seitz, M. Pollefeys, A. Effros.
Fttng & Matchng Lecture 4 Prof. Bregler Sldes from: S. Lazebnk, S. Setz, M. Pollefeys, A. Effros. How do we buld panorama? We need to match (algn) mages Matchng wth Features Detect feature ponts n both
More informationNUMERICAL SOLVING OPTIMAL CONTROL PROBLEMS BY THE METHOD OF VARIATIONS
ARPN Journal of Engneerng and Appled Scences 006-017 Asan Research Publshng Network (ARPN). All rghts reserved. NUMERICAL SOLVING OPTIMAL CONTROL PROBLEMS BY THE METHOD OF VARIATIONS Igor Grgoryev, Svetlana
More informationSIGGRAPH Interactive Image Cutout. Interactive Graph Cut. Interactive Graph Cut. Interactive Graph Cut. Hard Constraints. Lazy Snapping.
SIGGRAPH 004 Interactve Image Cutout Lazy Snappng Yn L Jan Sun Ch-Keung Tang Heung-Yeung Shum Mcrosoft Research Asa Hong Kong Unversty Separate an object from ts background Compose the object on another
More informationA Knowledge Management System for Organizing MEDLINE Database
A Knowledge Management System for Organzng MEDLINE Database Hyunk Km, Su-Shng Chen Computer and Informaton Scence Engneerng Department, Unversty of Florda, Ganesvlle, Florda 32611, USA Wth the exploson
More informationAn Intelligent Tool for Building E-Learning Contend- Material Using Natural Language in Digital Libraries
An Intellgent Tool for Buldng E-Learnng Contend- Materal Usng Natural Language n Dgtal Lbrares A. Drgas, J. Vrettaros NCSR Demokrtos DTE/YE, Department of technologcal applcaton, NetMeda Lab Ag. Paraskev
More informationBiostatistics 615/815
The E-M Algorthm Bostatstcs 615/815 Lecture 17 Last Lecture: The Smplex Method General method for optmzaton Makes few assumptons about functon Crawls towards mnmum Some recommendatons Multple startng ponts
More informationGSLM Operations Research II Fall 13/14
GSLM 58 Operatons Research II Fall /4 6. Separable Programmng Consder a general NLP mn f(x) s.t. g j (x) b j j =. m. Defnton 6.. The NLP s a separable program f ts objectve functon and all constrants are
More informationPositive Semi-definite Programming Localization in Wireless Sensor Networks
Postve Sem-defnte Programmng Localzaton n Wreless Sensor etworks Shengdong Xe 1,, Jn Wang, Aqun Hu 1, Yunl Gu, Jang Xu, 1 School of Informaton Scence and Engneerng, Southeast Unversty, 10096, anjng Computer
More informationA PATTERN RECOGNITION APPROACH TO IMAGE SEGMENTATION
1 THE PUBLISHING HOUSE PROCEEDINGS OF THE ROMANIAN ACADEMY, Seres A, OF THE ROMANIAN ACADEMY Volume 4, Number 2/2003, pp.000-000 A PATTERN RECOGNITION APPROACH TO IMAGE SEGMENTATION Tudor BARBU Insttute
More informationNatural Computing. Lecture 13: Particle swarm optimisation INFR /11/2010
Natural Computng Lecture 13: Partcle swarm optmsaton Mchael Herrmann mherrman@nf.ed.ac.uk phone: 0131 6 517177 Informatcs Forum 1.42 INFR09038 5/11/2010 Swarm ntellgence Collectve ntellgence: A super-organsm
More informationCollaboratively Regularized Nearest Points for Set Based Recognition
Academc Center for Computng and Meda Studes, Kyoto Unversty Collaboratvely Regularzed Nearest Ponts for Set Based Recognton Yang Wu, Mchhko Mnoh, Masayuk Mukunok Kyoto Unversty 9/1/013 BMVC 013 @ Brstol,
More informationSteps for Computing the Dissimilarity, Entropy, Herfindahl-Hirschman and. Accessibility (Gravity with Competition) Indices
Steps for Computng the Dssmlarty, Entropy, Herfndahl-Hrschman and Accessblty (Gravty wth Competton) Indces I. Dssmlarty Index Measurement: The followng formula can be used to measure the evenness between
More informationA Deflected Grid-based Algorithm for Clustering Analysis
A Deflected Grd-based Algorthm for Clusterng Analyss NANCY P. LIN, CHUNG-I CHANG, HAO-EN CHUEH, HUNG-JEN CHEN, WEI-HUA HAO Department of Computer Scence and Informaton Engneerng Tamkang Unversty 5 Yng-chuan
More informationLecture #15 Lecture Notes
Lecture #15 Lecture Notes The ocean water column s very much a 3-D spatal entt and we need to represent that structure n an economcal way to deal wth t n calculatons. We wll dscuss one way to do so, emprcal
More informationHermite Splines in Lie Groups as Products of Geodesics
Hermte Splnes n Le Groups as Products of Geodescs Ethan Eade Updated May 28, 2017 1 Introducton 1.1 Goal Ths document defnes a curve n the Le group G parametrzed by tme and by structural parameters n the
More informationUnsupervised Learning and Clustering
Unsupervsed Learnng and Clusterng Supervsed vs. Unsupervsed Learnng Up to now we consdered supervsed learnng scenaro, where we are gven 1. samples 1,, n 2. class labels for all samples 1,, n Ths s also
More informationContent Based Image Retrieval Using 2-D Discrete Wavelet with Texture Feature with Different Classifiers
IOSR Journal of Electroncs and Communcaton Engneerng (IOSR-JECE) e-issn: 78-834,p- ISSN: 78-8735.Volume 9, Issue, Ver. IV (Mar - Apr. 04), PP 0-07 Content Based Image Retreval Usng -D Dscrete Wavelet wth
More informationDetecting Compounded Anomalous SNMP Situations Using Cooperative Unsupervised Pattern Recognition
Detectng Compounded Anomalous SNMP Stuatons Usng Cooperatve Unsupervsed Pattern Recognton Emlo Corchado, Álvaro Herrero, José Manuel Sáz Department of Cvl Engneerng, Unversty of Burgos, Span escorchado@ubu.es
More informationLocal Adaptive Receptive Field Self-organizing Map for Image Segmentation
Local Adaptve Receptve Feld Self-organzng Map for Image Segmentaton Aluzo R. F. Araúo, Dogo C. Costa Unversdade Federal de Pernambuco Centro de Informátca - CIn Departamento de Sstemas da Computação Av.
More informationWavefront Reconstructor
A Dstrbuted Smplex B-Splne Based Wavefront Reconstructor Coen de Vsser and Mchel Verhaegen 14-12-201212 2012 Delft Unversty of Technology Contents Introducton Wavefront reconstructon usng Smplex B-Splnes
More informationLecture 36 of 42. Expectation Maximization (EM), Unsupervised Learning and Clustering
Lecture 36 of 42 Expectaton Maxmzaton (EM), Unsupervsed Learnng and Clusterng Wednesday, 18 Aprl 2007 Wllam H. Hsu, KSU http://www.cs.ksu.edu/courses/sprng-2007/cis732 Readngs: Secton 6.12, Mtchell Secton
More informationCluster Analysis of Electrical Behavior
Journal of Computer and Communcatons, 205, 3, 88-93 Publshed Onlne May 205 n ScRes. http://www.scrp.org/ournal/cc http://dx.do.org/0.4236/cc.205.350 Cluster Analyss of Electrcal Behavor Ln Lu Ln Lu, School
More informationFace Recognition Based on Neuro-Fuzzy System
IJCSNS Internatonal Journal of Computer Scence and Network Securty, VOL.9 No.4, Aprl 2009 39 Face Recognton Based on Neuro-Fuzzy System Nna aher Makhsoos, Reza Ebrahmpour and Alreza Hajany Department of
More informationFace Recognition Method Based on Within-class Clustering SVM
Face Recognton Method Based on Wthn-class Clusterng SVM Yan Wu, Xao Yao and Yng Xa Department of Computer Scence and Engneerng Tong Unversty Shangha, Chna Abstract - A face recognton method based on Wthn-class
More informationEdge Detection in Noisy Images Using the Support Vector Machines
Edge Detecton n Nosy Images Usng the Support Vector Machnes Hlaro Gómez-Moreno, Saturnno Maldonado-Bascón, Francsco López-Ferreras Sgnal Theory and Communcatons Department. Unversty of Alcalá Crta. Madrd-Barcelona
More informationAnalysis of EEG of shooters
Analyss of EEG of shooters Nuno Bandera Computer Scence Dept. New Unversty of Lsbon Qunta da Torre 2825-114 Caparca Vctor Lobo Portuguese Naval Academy, Escola Naval, Alfete, 28 ALMADA Fernando Moura-Pres
More informationCSE 326: Data Structures Quicksort Comparison Sorting Bound
CSE 326: Data Structures Qucksort Comparson Sortng Bound Bran Curless Sprng 2008 Announcements (5/14/08) Homework due at begnnng of class on Frday. Secton tomorrow: Graded homeworks returned More dscusson
More informationFEATURE EXTRACTION. Dr. K.Vijayarekha. Associate Dean School of Electrical and Electronics Engineering SASTRA University, Thanjavur
FEATURE EXTRACTION Dr. K.Vjayarekha Assocate Dean School of Electrcal and Electroncs Engneerng SASTRA Unversty, Thanjavur613 41 Jont Intatve of IITs and IISc Funded by MHRD Page 1 of 8 Table of Contents
More informationFeature Reduction and Selection
Feature Reducton and Selecton Dr. Shuang LIANG School of Software Engneerng TongJ Unversty Fall, 2012 Today s Topcs Introducton Problems of Dmensonalty Feature Reducton Statstc methods Prncpal Components
More informationCSE 326: Data Structures Quicksort Comparison Sorting Bound
CSE 326: Data Structures Qucksort Comparson Sortng Bound Steve Setz Wnter 2009 Qucksort Qucksort uses a dvde and conquer strategy, but does not requre the O(N) extra space that MergeSort does. Here s the
More informationSequential search. Building Java Programs Chapter 13. Sequential search. Sequential search
Sequental search Buldng Java Programs Chapter 13 Searchng and Sortng sequental search: Locates a target value n an array/lst by examnng each element from start to fnsh. How many elements wll t need to
More informationUnsupervised Neural Network Adaptive Resonance Theory 2 for Clustering
3 rd Internatonal G raduate Conference on Engneerng, Scence and Humantes (IGCESH) School of Graduate Studes Unverst Teknolog Malaysa 4 November 00 Unsupervsed Neural Network Adaptve Resonance Theory for
More informationVisual Thesaurus for Color Image Retrieval using Self-Organizing Maps
Vsual Thesaurus for Color Image Retreval usng Self-Organzng Maps Chrstopher C. Yang and Mlo K. Yp Department of System Engneerng and Engneerng Management The Chnese Unversty of Hong Kong, Hong Kong ABSTRACT
More informationA Binarization Algorithm specialized on Document Images and Photos
A Bnarzaton Algorthm specalzed on Document mages and Photos Ergna Kavalleratou Dept. of nformaton and Communcaton Systems Engneerng Unversty of the Aegean kavalleratou@aegean.gr Abstract n ths paper, a
More informationSupervised Learning in Parallel Universes Using Neighborgrams
Supervsed Learnng n Parallel Unverses Usng Neghborgrams Bernd Wswedel and Mchael R. Berthold Department of Computer and Informaton Scence, Unversty of Konstanz, Germany Abstract. We present a supervsed
More informationWhy Neural Networks? An Enduring Synthesis. Neural Networks. After s: Hebb, McCulloch and Pitts
Neural Networks Donald H. Cooley An Endurng Synthess An endurng synthess for how the bran works wll enable us to explan how we rapdly and spontaneously adapt to nosy and complex envronments whose rules
More informationOptimal connection strategies in one- and two-dimensional associative memory models
Optmal connecton strateges n one- and two-dmensonal assocatve memory models Lee Calcraft, Rod Adams, and Nel Davey School of Computer Scence, Unversty of Hertfordshre College lane, Hatfeld, Hertfordshre
More informationRobust Classification of ph Levels on a Camera Phone
Robust Classfcaton of ph Levels on a Camera Phone B.Y. Loh, N.K. Vuong, S. Chan and C.. Lau AbstractIn ths paper, we present a new algorthm that automatcally classfes the ph level on a test strp usng color
More informationData Mining For Multi-Criteria Energy Predictions
Data Mnng For Mult-Crtera Energy Predctons Kashf Gll and Denns Moon Abstract We present a data mnng technque for mult-crtera predctons of wnd energy. A mult-crtera (MC) evolutonary computng method has
More informationImage Fusion based on Wavelet and Curvelet Transform using ANFIS Algorithm
Internatonal Journal of Applcaton or Innovaton n Engneerng & Management (IJAIEM) Web Ste: www.jaem.org Emal: edtor@jaem.org Image Fuson based on Wavelet and Curvelet Transform usng ANFIS Algorthm Navneet
More informationCS246: Mining Massive Datasets Jure Leskovec, Stanford University
CS46: Mnng Massve Datasets Jure Leskovec, Stanford Unversty http://cs46.stanford.edu /19/013 Jure Leskovec, Stanford CS46: Mnng Massve Datasets, http://cs46.stanford.edu Perceptron: y = sgn( x Ho to fnd
More informationSimulation Based Analysis of FAST TCP using OMNET++
Smulaton Based Analyss of FAST TCP usng OMNET++ Umar ul Hassan 04030038@lums.edu.pk Md Term Report CS678 Topcs n Internet Research Sprng, 2006 Introducton Internet traffc s doublng roughly every 3 months
More informationAPPLYING PRINCIPAL COMPONENT ANALYSIS, MULTILAYER PERCEPTRON AND SELF-ORGANIZING MAPS FOR OPTICAL CHARACTER RECOGNITION
ISSN: 0976-902(ONLINE) DOI: 0.297/jvp.205.062 ICTACT JOURNAL ON IMAGE AND VIDEO PROCESSING, NOVEMBER 205, VOLUME: 06, ISSUE: 02 APPLYING PRINCIPAL COMPONENT ANALYSIS, MULTILAYER PERCEPTRON AND SELF-ORGANIZING
More informationCourse Introduction. Algorithm 8/31/2017. COSC 320 Advanced Data Structures and Algorithms. COSC 320 Advanced Data Structures and Algorithms
Course Introducton Course Topcs Exams, abs, Proects A quc loo at a few algorthms 1 Advanced Data Structures and Algorthms Descrpton: We are gong to dscuss algorthm complexty analyss, algorthm desgn technques
More informationComputer Animation and Visualisation. Lecture 4. Rigging / Skinning
Computer Anmaton and Vsualsaton Lecture 4. Rggng / Sknnng Taku Komura Overvew Sknnng / Rggng Background knowledge Lnear Blendng How to decde weghts? Example-based Method Anatomcal models Sknnng Assume
More informationHierarchical agglomerative. Cluster Analysis. Christine Siedle Clustering 1
Herarchcal agglomeratve Cluster Analyss Chrstne Sedle 19-3-2004 Clusterng 1 Classfcaton Basc (unconscous & conscous) human strategy to reduce complexty Always based Cluster analyss to fnd or confrm types
More informationParallelism for Nested Loops with Non-uniform and Flow Dependences
Parallelsm for Nested Loops wth Non-unform and Flow Dependences Sam-Jn Jeong Dept. of Informaton & Communcaton Engneerng, Cheonan Unversty, 5, Anseo-dong, Cheonan, Chungnam, 330-80, Korea. seong@cheonan.ac.kr
More informationLoad Balancing for Hex-Cell Interconnection Network
Int. J. Communcatons, Network and System Scences,,, - Publshed Onlne Aprl n ScRes. http://www.scrp.org/journal/jcns http://dx.do.org/./jcns.. Load Balancng for Hex-Cell Interconnecton Network Saher Manaseer,
More informationSupport Vector Machines. CS534 - Machine Learning
Support Vector Machnes CS534 - Machne Learnng Perceptron Revsted: Lnear Separators Bnar classfcaton can be veed as the task of separatng classes n feature space: b > 0 b 0 b < 0 f() sgn( b) Lnear Separators
More informationStructure Formation of Social Network
Structure Formaton of Socal Network DU Nan 1, FENG Hu 2, HUANG Zgang 3, Sally MAKI 4, WANG Ru(Ruby) 5, and ZHAO Hongxa (Melssa) 6 1 Bejng Unversty of Posts and Telecommuncatons, Chna 2 Fudan Unversty,
More informationChinese Word Segmentation based on the Improved Particle Swarm Optimization Neural Networks
Chnese Word Segmentaton based on the Improved Partcle Swarm Optmzaton Neural Networks Ja He Computatonal Intellgence Laboratory School of Computer Scence and Engneerng, UESTC Chengdu, Chna Department of
More informationS1 Note. Basis functions.
S1 Note. Bass functons. Contents Types of bass functons...1 The Fourer bass...2 B-splne bass...3 Power and type I error rates wth dfferent numbers of bass functons...4 Table S1. Smulaton results of type
More informationAngle-Independent 3D Reconstruction. Ji Zhang Mireille Boutin Daniel Aliaga
Angle-Independent 3D Reconstructon J Zhang Mrelle Boutn Danel Alaga Goal: Structure from Moton To reconstruct the 3D geometry of a scene from a set of pctures (e.g. a move of the scene pont reconstructon
More informationThe Research of Support Vector Machine in Agricultural Data Classification
The Research of Support Vector Machne n Agrcultural Data Classfcaton Le Sh, Qguo Duan, Xnmng Ma, Me Weng College of Informaton and Management Scence, HeNan Agrcultural Unversty, Zhengzhou 45000 Chna Zhengzhou
More informationReading. 14. Subdivision curves. Recommended:
eadng ecommended: Stollntz, Deose, and Salesn. Wavelets for Computer Graphcs: heory and Applcatons, 996, secton 6.-6., A.5. 4. Subdvson curves Note: there s an error n Stollntz, et al., secton A.5. Equaton
More informationAMath 483/583 Lecture 21 May 13, Notes: Notes: Jacobi iteration. Notes: Jacobi with OpenMP coarse grain
AMath 483/583 Lecture 21 May 13, 2011 Today: OpenMP and MPI versons of Jacob teraton Gauss-Sedel and SOR teratve methods Next week: More MPI Debuggng and totalvew GPU computng Read: Class notes and references
More information