464 Index. Associative memory paradigms

Size: px
Start display at page:

Download "464 Index. Associative memory paradigms"

Transcription

1 Index ABC analysis 5 Adaline 27 Adaptive resonance theory (ART) 56-9, 300, 309 architecture of 58 ART3 59 ARTMAP 63 bottom up weights 59 components of 57 fuzzy ART 63 gain control 58 learning algorithm 59 LTM (Long Term Memory) 58 networks orienting subsystem 57 pattern matching 57 STM (Short Term Memory) 58 subsystem 57 top down weights 59 vigilance value 59 winner-take-all network 278 Adaptive back-propagation ABP1 energy/sliding based method 361 ABP2 energy/smoothing based method 361 learning mechanism 360 total sum of squared errors (TSS) Adaptive neurocontrol 383 Adaptive control in manufacturing 399 methods, indirect approach 400 methods, traditional 400 model reference (MRAC) 401 systems, characteristics of Artificial neural network architectures mechanisms 303 competitive 303 cooperative 303 decoder 303 direct object based 292 encoder 303 normalization 303 performance analysis of 299 sequence decoder 303 sequence encoder 303 Artificial neural network 4, paradigm selection in manufacturing 352 systems in manufacturing vision based inspection ART-1 network 27, , 207 fast learning 207 slow learning 207 Artificial life 72 Artificial intelligence 3, 4 in process planning Associative memory 309 Associative memory paradigms adaptive resonance theory (ART) 312 bidirectional associative memory (BAM) 310 Boltzmann machine 314 fuzzy associative memory (FAM) 313 Hopfield network 312 learning vector quantizer (L VQ) 312 linear associative memory (LAM) 310

2 464 Index Associative memory paradigms contd optimal linear associative memory (OLAM) 312 self organizing map (SOM) 313 sparse distributed memory (SDM) 313 temporal associative memory (TAM) 313 Automated assembly fixed, high volume design 196 flexible general purpose system 196 single flexible programmable robot 196 systems 195 Automatic feature recognition 231 Average linkage cluster analysis 113 Axon 39 Backpropagation 27, 28, 48-9 BAM (Bidirectional Association Memory) 27, 309 Batch updating 300 Bayes' theorem 12 Bayesian decision rule 345 Behavior generation system 14 Benchmarks accuracy problem 329 control problem 337 encoding decoding problem 324 inverted pendulum 337 logic arithmetic operations 325 n-parity problem 321 sequencing problem 336 sin(x)sin(y) problem 330 static/dynamic mapping problem controllability 333 observability 333 TC problem 332 bounded perceptron 332 diameter limited perceptron 332 gamba perceptron 332 order restricted perceptron 332 random perceptron 332 travelling salesman problem (TSP) 328 truck backer upper 337 two spiral problem 322 XOR problem 321 Bias term 41 Blackboard system 31 Blackboard data structure 32 Boltzmann machine 27, 175 Bond energy method 114 Bottleneck machine 115 Boundary contour system 276 decision regions representation 230 Brain state in a box 151, 152 encoding 152 modified encoding and recall 153 recall 152 CAD (Computer Aided Design) 6 Calibration tool 224 CAM (Computer Aided Manufacturing) 6 Camera calibration CAPP (Computer Aided Process Planning) 144 neural networks applications 150 Category formation 315 Characteristics of design problem 93-5 of group technology 111 of scheduling problem Classification 315 Classification model for Hybrid intelligent systems 73-7 Classification and coding 112 Cluster analysis identification 114 Common discriminatory functions 306 binary threshold 306 hyperbolic 306 linear ramp 306 sigmoid 306 tangent 306 Competing type network 161 Competition model 119 network Competitive learning 43, Computational problems 315 Computer memory storage for variables 319 Conceptual design problem

3 Index 465 Confusion matrix 351 Constraint optimization 159 Constructive solid geometry 230 Content addressable memory 26 Controller (master slave) paradigm 33 Control mechanism 32 Cooperative process and boundary completion Coordinate mapping 219 Counter-propagation 27 Coupling or intercommunication 76 Coupling intercommunication continuum 68 Credit assignment problem 23 Crisp set 98 Data capture card 201 Decision making in intelligent manufacturing 67 Decision functions Declarative knowledge representations 23 Defuzzification 106 Dendogram 113 Dendrites 39 Description problem 22 Design mapping paradigm 95 characteristics 95 parameters 95 Detection of oriented edges Direct clustering 114 Discrete event simulation 80 Domain of neural net based recognition Dynamic feedback 28 Entropy 9 Error backpropagation 28 correction learning 27 correction network 161 estimation 351 Expert system 19, 78 Forcing term 41 Function approximation 309 replacement 76 replacement continuum 68 Functional requirements 95 Fuzzification 421 Fuzzy associative memory (FAM) 100, 309, 313 cantorian or crisp sets 414 centric approach 417 control 413 dissemblance index 425 introduction to 98 knowledge representations linguistic variable 414 logic 31 max-min method 421 max-product method 421 membership function 414 neural architectures 417 neural control 413 neural network 424 implementation performance 430 neuro centric approach 418 rules 415 set 414 operations 414 sets 9 systems 79 universe of discourse 414 Gain constant 162 Gaussian potential function network (GPFN) 283 Generalization and specialization 22 Generalized delta rule 49, Generative approach 146 Generic assembly cell 198 neural network 25 steps of design process 95 Genetic algorithms 79 Geometrically complete models 229 Graph based systems 232 Guidance 201 Hebbian learning 100 Hidden layer 50 markov models 34 units 26 Hierarchical approach 30 Hierarchical levels in manufacturing coordination level 7 organization level 7

4 466 Hopfield networks 27, 161, 309 for recognition 290 Hopfield net applications multiple travelling salesman problem 169 optimization problems 170 scheduling problems 170 simulated annealing 174 Human assisted feature recognition 231 Hybrid intelligent system (HIS) 30-34, 67, 71 neural network 71 solutions 67 synapse chips 71 Image acquisition 215 analysis 217 pre-processing 202, 215 segmentation 277 Implementation and realization analog 300 discrete 300 software 300 Independence axiom 95 Inductive learning 21 Information axiom 95 processing 68 Injection molding 404 Input operator 307 feedback 307 sigma Pi 307 simple linear 307 thermodynamic 307 weighted sum 307 Input layer 50 Input PEs 41 Inputs and outputs 40 Inspection 111 Integrated module approach 33 Intelligence 3 Intelligent computing techniques 67 machine, theory of 10 Manufacturing Systems 3, 14 systems architecture design techniques 17 technologies 70 Interactive activation 119 Interconnections 42 Index Interfield connections 42 Interpolative recall 26 Intrafield connections 42 Inverse process neurocontrol 382 Jaynes' principle 12 JIT (Just-in-time systems) 6 Knowledge based systems 18 Knowledge engineering 19 flow 9 sources 31 Kohonen's model 126 Linear Associative Memory (LAM) 309 Lateral connections 2 Learning algorithm 300 by analogy 21 by deduction 21 by instruction 21 by observation and discovery 22 logic 28 Off line 300 On line 300 parameters 300 procedure 300 rate 56 rules 42, 308 2nd and LMS 308 exact least squares 308 generalized delta rule 308 gradient descent 308 greedy delta rule 308 Hebb's rule 308 updating exact least squares 308 Widrow-Hoff rule 308 vector quantizer (L VQ) 27, 309 Least mean square (LMS) 345 Linear function 25 interpolation 356 Logistic sigmoid threshold function 29 Loss function 339 Lyapunov function 163 Machine vision system for robot guidance 200

5 Index 467 Machine cell formation 124 intelligence 17 part family formation 111 Madaline 27 Manufacturing Feature Recognition multisegment profile neural net recognition of features 235 3D feature identification 235 feature based modelling 234 identification 234 recognition 234 primary or principal feature face 237 secondary feature face 237 Manufacturing decision making problems 68-9 feature identification 229 flexibility 6, 7 problem solving Masks 276 Material requirements planning 6 Mathematical optimization 80 Matrix clustering 115 manipulation methods 114 Max-min composition 100 Maximum distance 345 entropy 10 Measures for recall Bhattacharya distance 352 divergence distance 352 Kolmogorov variational distance 352 Kullback-Leibler number 352 Matusita's distance 352 Measures for network selection 351 Membership function 98 matrix 99 Metrics from measure 347 Minimum distance classifier 347 Min-max solution 344 Misclassification cost 351 Modeling and matching strategies Multi layer perceptron (MLP) 300, 309 network 182 Multi sensor automata 315 Multiple integrated technologies 80 neural networks 79 N-P complete problems 160 Nanotechnology 72 Nearest neighbor decision procedure recall 26 Network functionality 300 model 303 size 300 topology 300 topology and classification 304 discriminatory function 304 functionality 304 input operator 304 learning rules 305 node functionality 304 topology 304 transfer function 304 Neural network architecture 49, 309 networks in continuous process diagnostics 435 for diagnostics 436 space initialization 354 Neuro control architecture 406 general learning 407 indirect learning 406 Neurocomputing for intelligent manufacturing 91 execution level applications 369 Neuron 25, 39 Non-linear classifiers 347 separation 48 Nonlinear ramp function 26 Normalization 355 Numeric processing 68 Optimal Linear Associative Memory (OLAM) 309 Optimization by simulated annealing 174, 179 crew scheduling problems 180 quadratic assignment problems 178 scheduling problems 179 using Hopfield net 162

6 468 Index Output layer 50 Output PEs 41 Overlapping part 115 p-median 114 Part family identification 121 Pattern recognition 206 in CAD/CAM integration 230 in stationary time domain and frequency domain 379 Pattern isolation and center computation 204 Pattern extraction for recognition 205 Perceptron 27, 43-8 Performance analysis capability 315 capacity 316 credit assignment 316 data extraction 316 representation 316 learnability 316 network design 316 operation issues 316 resource requirements 317 training issues 316 Performance issues 316 measures requirements 317 Polymorphic replacement 76 Popov-like bounding functions 358 Power supply board assembly Predicting features in a view 285 Probabilistic network 161 Problem solving methods for manufacturing 75 taxonomy 68 Procedural approach 23 Process control Process monitoring , and control 371 neural network models functions 372 Process planning 143 Processing elements (PE) 25, 40 Production flow analysis 112 Qualifying performance benchmark problems 320 capability of creating new categories 320 computation time of each epoch 319 computational requirements 318 convergence 320 data representation 319 fault tolerance 320 generalization test 320 limit cycle 320 memory requirements 318 memory capacity vs network size 320 network capacity 318 size 319 number of epochs for convergence 319 overtraining 320 problem scalability 319 processing speed 318 spurious state 320 stability 320 static and dynamic problems 320 turning 319 uncle Bernie's rules 318 Quickprop 56 Radial basis function networks (RBFs) 282 robust viewer centered object representation Rank order clustering 114 Recurrent connections 26, 42 Reinforcement learning 27 Relaxation labelling 276 Representation of 3D objects aspect graph 271 constructive solid geometry 272 discontinuity based representation 270 dual spherical representation 270 Gaussian sphere 269 moment based 270 octrees 272 shape polynomial 270 space curve 270 superquadrics 271 surface based representation 269 volumetric representation 271 Ridge regression 340

7 Index 469 Robust object representation 283 Rote learning 21 Route optimizer 224 Rule induction 78 Rule-based approach 232 Sagittal diagram 99 Scaling 357 Scheduling Searching type network 161 Self-organization map (SOM) 185, 309, 313 Self organization 315 Sensory data processing 315 Sensory processing system 14 Sequential updating 300 Sigmoid function 41 Sigmoid threshold function 26 Similarity coefficient based methods 113 Simulated annealing 161, 314 travelling salesman problem 176 Simulation paradox Single linkage cluster analysis 113 Single technique based tool 67 Situation-identification problem 22 Sparse distributed memory (SDM) 309, 313 SPC (Statistical Process Control) 6 Specialized signal filtering 379 Step threshold function 26 Stepwise regression 340 Stimulus response learning 22 Stochastic learning 27 Sub symbolic adaptive processing 72 processing 68 Supervised control 381 learning 27, 42 Symbolic knowledge processing 72 processing 68 Synapse 39 Taxonomy of clustering methodologies 117 TMI-nuclear reactor 442 Tools that increase performance TQC (Total Quality Control) 6 Traditional clustering methodologies 113 Traditional feature identification 231 Training time 55 Training the perceptron complex object graphical pattern trainer 262 object with intersecting features with simple features 255 simple features 251 Training and validation 300 data format 300 quality 300 training size 300 Trajectory planning 35 Transfer function 41-2 Travelling salesman problem Tree structure of design decision 98 Unsupervised learning 27, 43 Value judgement system 14 Variant process planning Viewer position estimation 285 Viewer centred object recognition Vision based inspection systems Weight matrices 55 World model 14 Zernike moments 293

Neural Networks. CE-725: Statistical Pattern Recognition Sharif University of Technology Spring Soleymani

Neural Networks. CE-725: Statistical Pattern Recognition Sharif University of Technology Spring Soleymani Neural Networks CE-725: Statistical Pattern Recognition Sharif University of Technology Spring 2013 Soleymani Outline Biological and artificial neural networks Feed-forward neural networks Single layer

More information

Neural Networks CMSC475/675

Neural Networks CMSC475/675 Introduction to Neural Networks CMSC475/675 Chapter 1 Introduction Why ANN Introduction Some tasks can be done easily (effortlessly) by humans but are hard by conventional paradigms on Von Neumann machine

More information

Neural Networks. Neural Network. Neural Network. Neural Network 2/21/2008. Andrew Kusiak. Intelligent Systems Laboratory Seamans Center

Neural Networks. Neural Network. Neural Network. Neural Network 2/21/2008. Andrew Kusiak. Intelligent Systems Laboratory Seamans Center Neural Networks Neural Network Input Andrew Kusiak Intelligent t Systems Laboratory 2139 Seamans Center Iowa City, IA 52242-1527 andrew-kusiak@uiowa.edu http://www.icaen.uiowa.edu/~ankusiak Tel. 319-335

More information

CL7204-SOFT COMPUTING TECHNIQUES

CL7204-SOFT COMPUTING TECHNIQUES VALLIAMMAI ENGINEERING COLLEGE 2015-2016(EVEN) [DOCUMENT TITLE] CL7204-SOFT COMPUTING TECHNIQUES UNIT I Prepared b Ms. Z. Jenifer A. P(O.G) QUESTION BANK INTRODUCTION AND NEURAL NETWORKS 1. What is soft

More information

^ Springer. Computational Intelligence. A Methodological Introduction. Rudolf Kruse Christian Borgelt. Matthias Steinbrecher Pascal Held

^ Springer. Computational Intelligence. A Methodological Introduction. Rudolf Kruse Christian Borgelt. Matthias Steinbrecher Pascal Held Rudolf Kruse Christian Borgelt Frank Klawonn Christian Moewes Matthias Steinbrecher Pascal Held Computational Intelligence A Methodological Introduction ^ Springer Contents 1 Introduction 1 1.1 Intelligent

More information

Artificial neural networks are the paradigm of connectionist systems (connectionism vs. symbolism)

Artificial neural networks are the paradigm of connectionist systems (connectionism vs. symbolism) Artificial Neural Networks Analogy to biological neural systems, the most robust learning systems we know. Attempt to: Understand natural biological systems through computational modeling. Model intelligent

More information

6. NEURAL NETWORK BASED PATH PLANNING ALGORITHM 6.1 INTRODUCTION

6. NEURAL NETWORK BASED PATH PLANNING ALGORITHM 6.1 INTRODUCTION 6 NEURAL NETWORK BASED PATH PLANNING ALGORITHM 61 INTRODUCTION In previous chapters path planning algorithms such as trigonometry based path planning algorithm and direction based path planning algorithm

More information

Predictive Analytics: Demystifying Current and Emerging Methodologies. Tom Kolde, FCAS, MAAA Linda Brobeck, FCAS, MAAA

Predictive Analytics: Demystifying Current and Emerging Methodologies. Tom Kolde, FCAS, MAAA Linda Brobeck, FCAS, MAAA Predictive Analytics: Demystifying Current and Emerging Methodologies Tom Kolde, FCAS, MAAA Linda Brobeck, FCAS, MAAA May 18, 2017 About the Presenters Tom Kolde, FCAS, MAAA Consulting Actuary Chicago,

More information

Data Mining. Neural Networks

Data Mining. Neural Networks Data Mining Neural Networks Goals for this Unit Basic understanding of Neural Networks and how they work Ability to use Neural Networks to solve real problems Understand when neural networks may be most

More information

11/14/2010 Intelligent Systems and Soft Computing 1

11/14/2010 Intelligent Systems and Soft Computing 1 Lecture 7 Artificial neural networks: Supervised learning Introduction, or how the brain works The neuron as a simple computing element The perceptron Multilayer neural networks Accelerated learning in

More information

Artificial Neural Networks. Introduction to Computational Neuroscience Ardi Tampuu

Artificial Neural Networks. Introduction to Computational Neuroscience Ardi Tampuu Artificial Neural Networks Introduction to Computational Neuroscience Ardi Tampuu 7.0.206 Artificial neural network NB! Inspired by biology, not based on biology! Applications Automatic speech recognition

More information

CMPT 882 Week 3 Summary

CMPT 882 Week 3 Summary CMPT 882 Week 3 Summary! Artificial Neural Networks (ANNs) are networks of interconnected simple units that are based on a greatly simplified model of the brain. ANNs are useful learning tools by being

More information

IMPROVEMENTS TO THE BACKPROPAGATION ALGORITHM

IMPROVEMENTS TO THE BACKPROPAGATION ALGORITHM Annals of the University of Petroşani, Economics, 12(4), 2012, 185-192 185 IMPROVEMENTS TO THE BACKPROPAGATION ALGORITHM MIRCEA PETRINI * ABSTACT: This paper presents some simple techniques to improve

More information

Supervised Learning in Neural Networks (Part 2)

Supervised Learning in Neural Networks (Part 2) Supervised Learning in Neural Networks (Part 2) Multilayer neural networks (back-propagation training algorithm) The input signals are propagated in a forward direction on a layer-bylayer basis. Learning

More information

Learning. Learning agents Inductive learning. Neural Networks. Different Learning Scenarios Evaluation

Learning. Learning agents Inductive learning. Neural Networks. Different Learning Scenarios Evaluation Learning Learning agents Inductive learning Different Learning Scenarios Evaluation Slides based on Slides by Russell/Norvig, Ronald Williams, and Torsten Reil Material from Russell & Norvig, chapters

More information

A Dendrogram. Bioinformatics (Lec 17)

A Dendrogram. Bioinformatics (Lec 17) A Dendrogram 3/15/05 1 Hierarchical Clustering [Johnson, SC, 1967] Given n points in R d, compute the distance between every pair of points While (not done) Pick closest pair of points s i and s j and

More information

COMPUTER AND ROBOT VISION

COMPUTER AND ROBOT VISION VOLUME COMPUTER AND ROBOT VISION Robert M. Haralick University of Washington Linda G. Shapiro University of Washington A^ ADDISON-WESLEY PUBLISHING COMPANY Reading, Massachusetts Menlo Park, California

More information

Preface to the Second Edition. Preface to the First Edition. 1 Introduction 1

Preface to the Second Edition. Preface to the First Edition. 1 Introduction 1 Preface to the Second Edition Preface to the First Edition vii xi 1 Introduction 1 2 Overview of Supervised Learning 9 2.1 Introduction... 9 2.2 Variable Types and Terminology... 9 2.3 Two Simple Approaches

More information

Index. Umberto Michelucci 2018 U. Michelucci, Applied Deep Learning,

Index. Umberto Michelucci 2018 U. Michelucci, Applied Deep Learning, A Acquisition function, 298, 301 Adam optimizer, 175 178 Anaconda navigator conda command, 3 Create button, 5 download and install, 1 installing packages, 8 Jupyter Notebook, 11 13 left navigation pane,

More information

9. Lecture Neural Networks

9. Lecture Neural Networks Soft Control (AT 3, RMA) 9. Lecture Neural Networks Application in Automation Engineering Outline of the lecture 1. Introduction to Soft Control: definition and limitations, basics of "smart" systems 2.

More information

Index. Springer Nature Switzerland AG 2019 B. Moons et al., Embedded Deep Learning,

Index. Springer Nature Switzerland AG 2019 B. Moons et al., Embedded Deep Learning, Index A Algorithmic noise tolerance (ANT), 93 94 Application specific instruction set processors (ASIPs), 115 116 Approximate computing application level, 95 circuits-levels, 93 94 DAS and DVAS, 107 110

More information

4.12 Generalization. In back-propagation learning, as many training examples as possible are typically used.

4.12 Generalization. In back-propagation learning, as many training examples as possible are typically used. 1 4.12 Generalization In back-propagation learning, as many training examples as possible are typically used. It is hoped that the network so designed generalizes well. A network generalizes well when

More information

For Monday. Read chapter 18, sections Homework:

For Monday. Read chapter 18, sections Homework: For Monday Read chapter 18, sections 10-12 The material in section 8 and 9 is interesting, but we won t take time to cover it this semester Homework: Chapter 18, exercise 25 a-b Program 4 Model Neuron

More information

IMAGE ANALYSIS, CLASSIFICATION, and CHANGE DETECTION in REMOTE SENSING

IMAGE ANALYSIS, CLASSIFICATION, and CHANGE DETECTION in REMOTE SENSING SECOND EDITION IMAGE ANALYSIS, CLASSIFICATION, and CHANGE DETECTION in REMOTE SENSING ith Algorithms for ENVI/IDL Morton J. Canty с*' Q\ CRC Press Taylor &. Francis Group Boca Raton London New York CRC

More information

Image Compression: An Artificial Neural Network Approach

Image Compression: An Artificial Neural Network Approach Image Compression: An Artificial Neural Network Approach Anjana B 1, Mrs Shreeja R 2 1 Department of Computer Science and Engineering, Calicut University, Kuttippuram 2 Department of Computer Science and

More information

CS6220: DATA MINING TECHNIQUES

CS6220: DATA MINING TECHNIQUES CS6220: DATA MINING TECHNIQUES Image Data: Classification via Neural Networks Instructor: Yizhou Sun yzsun@ccs.neu.edu November 19, 2015 Methods to Learn Classification Clustering Frequent Pattern Mining

More information

Artificial Neural Networks MLP, RBF & GMDH

Artificial Neural Networks MLP, RBF & GMDH Artificial Neural Networks MLP, RBF & GMDH Jan Drchal drchajan@fel.cvut.cz Computational Intelligence Group Department of Computer Science and Engineering Faculty of Electrical Engineering Czech Technical

More information

Support Vector Machines

Support Vector Machines Support Vector Machines RBF-networks Support Vector Machines Good Decision Boundary Optimization Problem Soft margin Hyperplane Non-linear Decision Boundary Kernel-Trick Approximation Accurancy Overtraining

More information

Pattern Recognition. Kjell Elenius. Speech, Music and Hearing KTH. March 29, 2007 Speech recognition

Pattern Recognition. Kjell Elenius. Speech, Music and Hearing KTH. March 29, 2007 Speech recognition Pattern Recognition Kjell Elenius Speech, Music and Hearing KTH March 29, 2007 Speech recognition 2007 1 Ch 4. Pattern Recognition 1(3) Bayes Decision Theory Minimum-Error-Rate Decision Rules Discriminant

More information

Neural Networks and Deep Learning

Neural Networks and Deep Learning Neural Networks and Deep Learning Example Learning Problem Example Learning Problem Celebrity Faces in the Wild Machine Learning Pipeline Raw data Feature extract. Feature computation Inference: prediction,

More information

PATTERN CLASSIFICATION AND SCENE ANALYSIS

PATTERN CLASSIFICATION AND SCENE ANALYSIS PATTERN CLASSIFICATION AND SCENE ANALYSIS RICHARD O. DUDA PETER E. HART Stanford Research Institute, Menlo Park, California A WILEY-INTERSCIENCE PUBLICATION JOHN WILEY & SONS New York Chichester Brisbane

More information

Introduction to Neural Networks

Introduction to Neural Networks Introduction to Neural Networks What are connectionist neural networks? Connectionism refers to a computer modeling approach to computation that is loosely based upon the architecture of the brain Many

More information

NOORUL ISLAM COLLEGE OF ENGINEERING KUMARACOIL. Department of Electrical and Electronics Engineering Question Answer Bank

NOORUL ISLAM COLLEGE OF ENGINEERING KUMARACOIL. Department of Electrical and Electronics Engineering Question Answer Bank NOORUL ISLAM COLLEGE OF ENGINEERING KUMARACOIL. Department of Electrical and Electronics Engineering Question Answer Bank IC 1403 NEURAL NETWORKS AND FUZZY LOGIC CONTROL (S 8 EEE) Prepared by S.Anitha

More information

AN INTRODUCTION TO FUZZY SETS Analysis and Design. Witold Pedrycz and Fernando Gomide

AN INTRODUCTION TO FUZZY SETS Analysis and Design. Witold Pedrycz and Fernando Gomide AN INTRODUCTION TO FUZZY SETS Analysis and Design Witold Pedrycz and Fernando Gomide A Bradford Book The MIT Press Cambridge, Massachusetts London, England Foreword - Preface Introduction xiii xxv xxi

More information

This leads to our algorithm which is outlined in Section III, along with a tabular summary of it's performance on several benchmarks. The last section

This leads to our algorithm which is outlined in Section III, along with a tabular summary of it's performance on several benchmarks. The last section An Algorithm for Incremental Construction of Feedforward Networks of Threshold Units with Real Valued Inputs Dhananjay S. Phatak Electrical Engineering Department State University of New York, Binghamton,

More information

Review: Final Exam CPSC Artificial Intelligence Michael M. Richter

Review: Final Exam CPSC Artificial Intelligence Michael M. Richter Review: Final Exam Model for a Learning Step Learner initially Environm ent Teacher Compare s pe c ia l Information Control Correct Learning criteria Feedback changed Learner after Learning Learning by

More information

Chapter 7: Competitive learning, clustering, and self-organizing maps

Chapter 7: Competitive learning, clustering, and self-organizing maps Chapter 7: Competitive learning, clustering, and self-organizing maps António R. C. Paiva EEL 6814 Spring 2008 Outline Competitive learning Clustering Self-Organizing Maps What is competition in neural

More information

ECS289: Scalable Machine Learning

ECS289: Scalable Machine Learning ECS289: Scalable Machine Learning Cho-Jui Hsieh UC Davis Sept 22, 2016 Course Information Website: http://www.stat.ucdavis.edu/~chohsieh/teaching/ ECS289G_Fall2016/main.html My office: Mathematical Sciences

More information

Bioinformatics - Lecture 07

Bioinformatics - Lecture 07 Bioinformatics - Lecture 07 Bioinformatics Clusters and networks Martin Saturka http://www.bioplexity.org/lectures/ EBI version 0.4 Creative Commons Attribution-Share Alike 2.5 License Learning on profiles

More information

Dietrich Paulus Joachim Hornegger. Pattern Recognition of Images and Speech in C++

Dietrich Paulus Joachim Hornegger. Pattern Recognition of Images and Speech in C++ Dietrich Paulus Joachim Hornegger Pattern Recognition of Images and Speech in C++ To Dorothea, Belinda, and Dominik In the text we use the following names which are protected, trademarks owned by a company

More information

[Time : 3 Hours] [Max. Marks : 100] SECTION-I. What are their effects? [8]

[Time : 3 Hours] [Max. Marks : 100] SECTION-I. What are their effects? [8] UNIVERSITY OF PUNE [4364]-542 B. E. (Electronics) Examination - 2013 VLSI Design (200 Pattern) Total No. of Questions : 12 [Total No. of Printed Pages :3] [Time : 3 Hours] [Max. Marks : 100] Q1. Q2. Instructions

More information

Image Processing, Analysis and Machine Vision

Image Processing, Analysis and Machine Vision Image Processing, Analysis and Machine Vision Milan Sonka PhD University of Iowa Iowa City, USA Vaclav Hlavac PhD Czech Technical University Prague, Czech Republic and Roger Boyle DPhil, MBCS, CEng University

More information

Lecture notes. Com Page 1

Lecture notes. Com Page 1 Lecture notes Com Page 1 Contents Lectures 1. Introduction to Computational Intelligence 2. Traditional computation 2.1. Sorting algorithms 2.2. Graph search algorithms 3. Supervised neural computation

More information

Deep Learning. Volker Tresp Summer 2014

Deep Learning. Volker Tresp Summer 2014 Deep Learning Volker Tresp Summer 2014 1 Neural Network Winter and Revival While Machine Learning was flourishing, there was a Neural Network winter (late 1990 s until late 2000 s) Around 2010 there

More information

Neuro-Fuzzy Inverse Forward Models

Neuro-Fuzzy Inverse Forward Models CS9 Autumn Neuro-Fuzzy Inverse Forward Models Brian Highfill Stanford University Department of Computer Science Abstract- Internal cognitive models are useful methods for the implementation of motor control

More information

Dynamic Analysis of Structures Using Neural Networks

Dynamic Analysis of Structures Using Neural Networks Dynamic Analysis of Structures Using Neural Networks Alireza Lavaei Academic member, Islamic Azad University, Boroujerd Branch, Iran Alireza Lohrasbi Academic member, Islamic Azad University, Boroujerd

More information

Model learning for robot control: a survey

Model learning for robot control: a survey Model learning for robot control: a survey Duy Nguyen-Tuong, Jan Peters 2011 Presented by Evan Beachly 1 Motivation Robots that can learn how their motors move their body Complexity Unanticipated Environments

More information

Support Vector Machines

Support Vector Machines Support Vector Machines RBF-networks Support Vector Machines Good Decision Boundary Optimization Problem Soft margin Hyperplane Non-linear Decision Boundary Kernel-Trick Approximation Accurancy Overtraining

More information

Optimization Methods for Machine Learning (OMML)

Optimization Methods for Machine Learning (OMML) Optimization Methods for Machine Learning (OMML) 2nd lecture Prof. L. Palagi References: 1. Bishop Pattern Recognition and Machine Learning, Springer, 2006 (Chap 1) 2. V. Cherlassky, F. Mulier - Learning

More information

COMPUTATIONAL INTELLIGENCE

COMPUTATIONAL INTELLIGENCE COMPUTATIONAL INTELLIGENCE Radial Basis Function Networks Adrian Horzyk Preface Radial Basis Function Networks (RBFN) are a kind of artificial neural networks that use radial basis functions (RBF) as activation

More information

Multilayer Feed-forward networks

Multilayer Feed-forward networks Multi Feed-forward networks 1. Computational models of McCulloch and Pitts proposed a binary threshold unit as a computational model for artificial neuron. This first type of neuron has been generalized

More information

CLASSIFICATION AND CHANGE DETECTION

CLASSIFICATION AND CHANGE DETECTION IMAGE ANALYSIS, CLASSIFICATION AND CHANGE DETECTION IN REMOTE SENSING With Algorithms for ENVI/IDL and Python THIRD EDITION Morton J. Canty CRC Press Taylor & Francis Group Boca Raton London NewYork CRC

More information

Classification Lecture Notes cse352. Neural Networks. Professor Anita Wasilewska

Classification Lecture Notes cse352. Neural Networks. Professor Anita Wasilewska Classification Lecture Notes cse352 Neural Networks Professor Anita Wasilewska Neural Networks Classification Introduction INPUT: classification data, i.e. it contains an classification (class) attribute

More information

Function approximation using RBF network. 10 basis functions and 25 data points.

Function approximation using RBF network. 10 basis functions and 25 data points. 1 Function approximation using RBF network F (x j ) = m 1 w i ϕ( x j t i ) i=1 j = 1... N, m 1 = 10, N = 25 10 basis functions and 25 data points. Basis function centers are plotted with circles and data

More information

European Journal of Science and Engineering Vol. 1, Issue 1, 2013 ADAPTIVE NEURO-FUZZY INFERENCE SYSTEM IDENTIFICATION OF AN INDUCTION MOTOR

European Journal of Science and Engineering Vol. 1, Issue 1, 2013 ADAPTIVE NEURO-FUZZY INFERENCE SYSTEM IDENTIFICATION OF AN INDUCTION MOTOR ADAPTIVE NEURO-FUZZY INFERENCE SYSTEM IDENTIFICATION OF AN INDUCTION MOTOR Ahmed A. M. Emam College of Engineering Karrary University SUDAN ahmedimam1965@yahoo.co.in Eisa Bashier M. Tayeb College of Engineering

More information

Machine Learning in Biology

Machine Learning in Biology Università degli studi di Padova Machine Learning in Biology Luca Silvestrin (Dottorando, XXIII ciclo) Supervised learning Contents Class-conditional probability density Linear and quadratic discriminant

More information

Department of Computer Science & Engineering University of Kalyani. Syllabus for Ph.D. Coursework

Department of Computer Science & Engineering University of Kalyani. Syllabus for Ph.D. Coursework Department of Computer Science & Engineering University of Kalyani Syllabus for Ph.D. Coursework Paper 1: A) Literature Review: (Marks - 25) B) Research Methodology: (Marks - 25) Paper 2: Computer Applications:

More information

Neural Network Neurons

Neural Network Neurons Neural Networks Neural Network Neurons 1 Receives n inputs (plus a bias term) Multiplies each input by its weight Applies activation function to the sum of results Outputs result Activation Functions Given

More information

Contents. Preface to the Second Edition

Contents. Preface to the Second Edition Preface to the Second Edition v 1 Introduction 1 1.1 What Is Data Mining?....................... 4 1.2 Motivating Challenges....................... 5 1.3 The Origins of Data Mining....................

More information

Review on Methods of Selecting Number of Hidden Nodes in Artificial Neural Network

Review on Methods of Selecting Number of Hidden Nodes in Artificial Neural Network Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology IJCSMC, Vol. 3, Issue. 11, November 2014,

More information

Cursive Handwriting Recognition System Using Feature Extraction and Artificial Neural Network

Cursive Handwriting Recognition System Using Feature Extraction and Artificial Neural Network Cursive Handwriting Recognition System Using Feature Extraction and Artificial Neural Network Utkarsh Dwivedi 1, Pranjal Rajput 2, Manish Kumar Sharma 3 1UG Scholar, Dept. of CSE, GCET, Greater Noida,

More information

Why Normalizing v? Why did we normalize v on the right side? Because we want the length of the left side to be the eigenvalue

Why Normalizing v? Why did we normalize v on the right side? Because we want the length of the left side to be the eigenvalue Why Normalizing v? Why did we normalize v on the right side? Because we want the length of the left side to be the eigenvalue 1 CCI PCA Algorithm (1) 2 CCI PCA Algorithm (2) 3 PCA from the FERET Face Image

More information

Supervised Learning (contd) Linear Separation. Mausam (based on slides by UW-AI faculty)

Supervised Learning (contd) Linear Separation. Mausam (based on slides by UW-AI faculty) Supervised Learning (contd) Linear Separation Mausam (based on slides by UW-AI faculty) Images as Vectors Binary handwritten characters Treat an image as a highdimensional vector (e.g., by reading pixel

More information

ECG782: Multidimensional Digital Signal Processing

ECG782: Multidimensional Digital Signal Processing ECG782: Multidimensional Digital Signal Processing Object Recognition http://www.ee.unlv.edu/~b1morris/ecg782/ 2 Outline Knowledge Representation Statistical Pattern Recognition Neural Networks Boosting

More information

Neural Network Learning. Today s Lecture. Continuation of Neural Networks. Artificial Neural Networks. Lecture 24: Learning 3. Victor R.

Neural Network Learning. Today s Lecture. Continuation of Neural Networks. Artificial Neural Networks. Lecture 24: Learning 3. Victor R. Lecture 24: Learning 3 Victor R. Lesser CMPSCI 683 Fall 2010 Today s Lecture Continuation of Neural Networks Artificial Neural Networks Compose of nodes/units connected by links Each link has a numeric

More information

Yuki Osada Andrew Cannon

Yuki Osada Andrew Cannon Yuki Osada Andrew Cannon 1 Humans are an intelligent species One feature is the ability to learn The ability to learn comes down to the brain The brain learns from experience Research shows that the brain

More information

Constructive Feedforward ART Clustering Networks Part I

Constructive Feedforward ART Clustering Networks Part I IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 13, NO. 3, MAY 2002 645 Constructive Feedforward ART Clustering Networks Part I Andrea Baraldi and Ethem Alpaydın Abstract Part I of this paper proposes a definition

More information

Name of the lecturer Doç. Dr. Selma Ayşe ÖZEL

Name of the lecturer Doç. Dr. Selma Ayşe ÖZEL Y.L. CENG-541 Information Retrieval Systems MASTER Doç. Dr. Selma Ayşe ÖZEL Information retrieval strategies: vector space model, probabilistic retrieval, language models, inference networks, extended

More information

Network Traffic Measurements and Analysis

Network Traffic Measurements and Analysis DEIB - Politecnico di Milano Fall, 2017 Sources Hastie, Tibshirani, Friedman: The Elements of Statistical Learning James, Witten, Hastie, Tibshirani: An Introduction to Statistical Learning Andrew Ng:

More information

F-SECURE S UNIQUE CAPABILITIES IN DETECTION & RESPONSE

F-SECURE S UNIQUE CAPABILITIES IN DETECTION & RESPONSE TECHNOLOGY F-SECURE S UNIQUE CAPABILITIES IN DETECTION & RESPONSE Jyrki Tulokas, EVP, Cyber security products & services UNDERSTANDING THE THREAT LANDSCAPE Human orchestration NATION STATE ATTACKS Nation

More information

More on Learning. Neural Nets Support Vectors Machines Unsupervised Learning (Clustering) K-Means Expectation-Maximization

More on Learning. Neural Nets Support Vectors Machines Unsupervised Learning (Clustering) K-Means Expectation-Maximization More on Learning Neural Nets Support Vectors Machines Unsupervised Learning (Clustering) K-Means Expectation-Maximization Neural Net Learning Motivated by studies of the brain. A network of artificial

More information

Alex Waibel

Alex Waibel Alex Waibel 815.11.2011 1 16.11.2011 Organisation Literatur: Introduction to The Theory of Neural Computation Hertz, Krogh, Palmer, Santa Fe Institute Neural Network Architectures An Introduction, Judith

More information

Machine Learning Classifiers and Boosting

Machine Learning Classifiers and Boosting Machine Learning Classifiers and Boosting Reading Ch 18.6-18.12, 20.1-20.3.2 Outline Different types of learning problems Different types of learning algorithms Supervised learning Decision trees Naïve

More information

Akarsh Pokkunuru EECS Department Contractive Auto-Encoders: Explicit Invariance During Feature Extraction

Akarsh Pokkunuru EECS Department Contractive Auto-Encoders: Explicit Invariance During Feature Extraction Akarsh Pokkunuru EECS Department 03-16-2017 Contractive Auto-Encoders: Explicit Invariance During Feature Extraction 1 AGENDA Introduction to Auto-encoders Types of Auto-encoders Analysis of different

More information

COMPUTATIONAL NEURAL NETWORKS FOR GEOPHYSICAL DATA PROCESSING

COMPUTATIONAL NEURAL NETWORKS FOR GEOPHYSICAL DATA PROCESSING SEISMIC EXPLORATION Volume 30 COMPUTATIONAL NEURAL NETWORKS FOR GEOPHYSICAL DATA PROCESSING edited by Mary M. POULTON Department of Mining & Geological Engineering Computational Intelligence & Visualization

More information

The exam is closed book, closed notes except your one-page (two-sided) cheat sheet.

The exam is closed book, closed notes except your one-page (two-sided) cheat sheet. CS 189 Spring 2015 Introduction to Machine Learning Final You have 2 hours 50 minutes for the exam. The exam is closed book, closed notes except your one-page (two-sided) cheat sheet. No calculators or

More information

Machine Learning to Select Best Network Access Point

Machine Learning to Select Best Network Access Point Technical Disclosure Commons Defensive Publications Series December 12, 2017 Machine Learning to Select Best Network Access Point Thomas Price Eytan Lerba Follow this and additional works at: http://www.tdcommons.org/dpubs_series

More information

Deep Learning. Architecture Design for. Sargur N. Srihari

Deep Learning. Architecture Design for. Sargur N. Srihari Architecture Design for Deep Learning Sargur N. srihari@cedar.buffalo.edu 1 Topics Overview 1. Example: Learning XOR 2. Gradient-Based Learning 3. Hidden Units 4. Architecture Design 5. Backpropagation

More information

Neural networks for variable star classification

Neural networks for variable star classification Neural networks for variable star classification Vasily Belokurov, IoA, Cambridge Supervised classification Multi-Layer Perceptron (MLP) Neural Networks for Pattern Recognition by C. Bishop Unsupervised

More information

Efficient Object Extraction Using Fuzzy Cardinality Based Thresholding and Hopfield Network

Efficient Object Extraction Using Fuzzy Cardinality Based Thresholding and Hopfield Network Efficient Object Extraction Using Fuzzy Cardinality Based Thresholding and Hopfield Network S. Bhattacharyya U. Maulik S. Bandyopadhyay Dept. of Information Technology Dept. of Comp. Sc. and Tech. Machine

More information

Lecture 20: Neural Networks for NLP. Zubin Pahuja

Lecture 20: Neural Networks for NLP. Zubin Pahuja Lecture 20: Neural Networks for NLP Zubin Pahuja zpahuja2@illinois.edu courses.engr.illinois.edu/cs447 CS447: Natural Language Processing 1 Today s Lecture Feed-forward neural networks as classifiers simple

More information

Fundamentals of Digital Image Processing

Fundamentals of Digital Image Processing \L\.6 Gw.i Fundamentals of Digital Image Processing A Practical Approach with Examples in Matlab Chris Solomon School of Physical Sciences, University of Kent, Canterbury, UK Toby Breckon School of Engineering,

More information

COMPUTATIONAL INTELLIGENCE

COMPUTATIONAL INTELLIGENCE COMPUTATIONAL INTELLIGENCE Fundamentals Adrian Horzyk Preface Before we can proceed to discuss specific complex methods we have to introduce basic concepts, principles, and models of computational intelligence

More information

CSE 5526: Introduction to Neural Networks Radial Basis Function (RBF) Networks

CSE 5526: Introduction to Neural Networks Radial Basis Function (RBF) Networks CSE 5526: Introduction to Neural Networks Radial Basis Function (RBF) Networks Part IV 1 Function approximation MLP is both a pattern classifier and a function approximator As a function approximator,

More information

A Systematic Overview of Data Mining Algorithms

A Systematic Overview of Data Mining Algorithms A Systematic Overview of Data Mining Algorithms 1 Data Mining Algorithm A well-defined procedure that takes data as input and produces output as models or patterns well-defined: precisely encoded as a

More information

2. Neural network basics

2. Neural network basics 2. Neural network basics Next commonalities among different neural networks are discussed in order to get started and show which structural parts or concepts appear in almost all networks. It is presented

More information

Large-Scale Lasso and Elastic-Net Regularized Generalized Linear Models

Large-Scale Lasso and Elastic-Net Regularized Generalized Linear Models Large-Scale Lasso and Elastic-Net Regularized Generalized Linear Models DB Tsai Steven Hillion Outline Introduction Linear / Nonlinear Classification Feature Engineering - Polynomial Expansion Big-data

More information

CPSC 340: Machine Learning and Data Mining. Deep Learning Fall 2018

CPSC 340: Machine Learning and Data Mining. Deep Learning Fall 2018 CPSC 340: Machine Learning and Data Mining Deep Learning Fall 2018 Last Time: Multi-Dimensional Scaling Multi-dimensional scaling (MDS): Non-parametric visualization: directly optimize the z i locations.

More information

Neuron Selectivity as a Biologically Plausible Alternative to Backpropagation

Neuron Selectivity as a Biologically Plausible Alternative to Backpropagation Neuron Selectivity as a Biologically Plausible Alternative to Backpropagation C.J. Norsigian Department of Bioengineering cnorsigi@eng.ucsd.edu Vishwajith Ramesh Department of Bioengineering vramesh@eng.ucsd.edu

More information

Neural Networks (Overview) Prof. Richard Zanibbi

Neural Networks (Overview) Prof. Richard Zanibbi Neural Networks (Overview) Prof. Richard Zanibbi Inspired by Biology Introduction But as used in pattern recognition research, have little relation with real neural systems (studied in neurology and neuroscience)

More information

Machine Learning / Jan 27, 2010

Machine Learning / Jan 27, 2010 Revisiting Logistic Regression & Naïve Bayes Aarti Singh Machine Learning 10-701/15-781 Jan 27, 2010 Generative and Discriminative Classifiers Training classifiers involves learning a mapping f: X -> Y,

More information

Neural Network Weight Selection Using Genetic Algorithms

Neural Network Weight Selection Using Genetic Algorithms Neural Network Weight Selection Using Genetic Algorithms David Montana presented by: Carl Fink, Hongyi Chen, Jack Cheng, Xinglong Li, Bruce Lin, Chongjie Zhang April 12, 2005 1 Neural Networks Neural networks

More information

A Comparative Study of SVM Kernel Functions Based on Polynomial Coefficients and V-Transform Coefficients

A Comparative Study of SVM Kernel Functions Based on Polynomial Coefficients and V-Transform Coefficients www.ijecs.in International Journal Of Engineering And Computer Science ISSN:2319-7242 Volume 6 Issue 3 March 2017, Page No. 20765-20769 Index Copernicus value (2015): 58.10 DOI: 18535/ijecs/v6i3.65 A Comparative

More information

CLASSIFICATION WITH RADIAL BASIS AND PROBABILISTIC NEURAL NETWORKS

CLASSIFICATION WITH RADIAL BASIS AND PROBABILISTIC NEURAL NETWORKS CLASSIFICATION WITH RADIAL BASIS AND PROBABILISTIC NEURAL NETWORKS CHAPTER 4 CLASSIFICATION WITH RADIAL BASIS AND PROBABILISTIC NEURAL NETWORKS 4.1 Introduction Optical character recognition is one of

More information

Analytical model A structure and process for analyzing a dataset. For example, a decision tree is a model for the classification of a dataset.

Analytical model A structure and process for analyzing a dataset. For example, a decision tree is a model for the classification of a dataset. Glossary of data mining terms: Accuracy Accuracy is an important factor in assessing the success of data mining. When applied to data, accuracy refers to the rate of correct values in the data. When applied

More information

ANFIS: ADAPTIVE-NETWORK-BASED FUZZY INFERENCE SYSTEMS (J.S.R. Jang 1993,1995) bell x; a, b, c = 1 a

ANFIS: ADAPTIVE-NETWORK-BASED FUZZY INFERENCE SYSTEMS (J.S.R. Jang 1993,1995) bell x; a, b, c = 1 a ANFIS: ADAPTIVE-NETWORK-ASED FUZZ INFERENCE SSTEMS (J.S.R. Jang 993,995) Membership Functions triangular triangle( ; a, a b, c c) ma min = b a, c b, 0, trapezoidal trapezoid( ; a, b, a c, d d) ma min =

More information

Deep Learning with Tensorflow AlexNet

Deep Learning with Tensorflow   AlexNet Machine Learning and Computer Vision Group Deep Learning with Tensorflow http://cvml.ist.ac.at/courses/dlwt_w17/ AlexNet Krizhevsky, Alex, Ilya Sutskever, and Geoffrey E. Hinton, "Imagenet classification

More information

CHAPTER 3 ADAPTIVE NEURO-FUZZY INFERENCE SYSTEM

CHAPTER 3 ADAPTIVE NEURO-FUZZY INFERENCE SYSTEM 33 CHAPTER 3 ADAPTIVE NEURO-FUZZY INFERENCE SYSTEM The objective of an ANFIS (Jang 1993) is to integrate the best features of Fuzzy Systems and Neural Networks. ANFIS is one of the best tradeoffs between

More information

Neural Networks. Single-layer neural network. CSE 446: Machine Learning Emily Fox University of Washington March 10, /10/2017

Neural Networks. Single-layer neural network. CSE 446: Machine Learning Emily Fox University of Washington March 10, /10/2017 3/0/207 Neural Networks Emily Fox University of Washington March 0, 207 Slides adapted from Ali Farhadi (via Carlos Guestrin and Luke Zettlemoyer) Single-layer neural network 3/0/207 Perceptron as a neural

More information

Intelligent Control. 4^ Springer. A Hybrid Approach Based on Fuzzy Logic, Neural Networks and Genetic Algorithms. Nazmul Siddique.

Intelligent Control. 4^ Springer. A Hybrid Approach Based on Fuzzy Logic, Neural Networks and Genetic Algorithms. Nazmul Siddique. Nazmul Siddique Intelligent Control A Hybrid Approach Based on Fuzzy Logic, Neural Networks and Genetic Algorithms Foreword by Bernard Widrow 4^ Springer Contents 1 Introduction 1 1.1 Intelligent Control

More information