COMPEL 17,1/2/3. This work was supported by the Greek General Secretariat of Research and Technology through the PENED 94 research project.

Size: px
Start display at page:

Download "COMPEL 17,1/2/3. This work was supported by the Greek General Secretariat of Research and Technology through the PENED 94 research project."

Transcription

1 382 Non-destructive testing of layered structures using generalised radial basis function networks trained by the orthogonal least squares learning algorithm I.T. Rekanos, T.V. Yioultsis and T.D. Tsiboukis Department of Electrical and Computer Engineering, Aristotle University of Thessaloniki, Thessaloniki, Greece Keywords Conductivity profile, Electromagnetics, Least squares, Non-destructive testing Abstract The evaluation of the conductivity profile of layered metallic structures is performed via the inversion of the impedance of a circular air cored probe coil of rectangular cross section. The inversion approach is based on the implementation of generalised radial basis function neural networks. The choice of the size of the network and the evaluation of its weights are handled by the orthogonal least squares learning algorithm. The merits of the proposed method are illustrated in the light of two examples concerning non-destructive testing applications. COMPEL The International Journal for Computation and Mathematics in Electrical and Electronic Engineering, Vol. 17 No. 1/2/3, 1998, pp MCB University Press, Introduction The application of neural networks to the inversion of electromagnetic field measurements for the estimation of the geometric or source parameters, that affect the forward electromagnetic field solution, has attracted a lot of interest over the last years. Actually, the most applied neural network architecture that appears in the literature is related to the multilayer perceptrons (MLPs)[1]. Recently, the implementation of radial basis function (RBF) networks for inverse electromagnetic problems has been investigated[2,3]. These networks offer an alternative to the multilayer perceptron neural networks. Their implementation is closely related to the Tikhonov sa regularisation theory and is much simpler and faster compared to the back propagation training algorithm of the MLPs. In this paper, the selection of the RBF network architecture and its training process is approached via the orthogonal least squares algorithm[4]. The applicability of the RBF networks to electromagnetic inversion is investigated in the case of impedance inversion in eddy current testing of layered metallic planar structures[3]. In a first example, the RBF network is trained to identify the unknown thickness of a metallic plate and the lift-off of This work was supported by the Greek General Secretariat of Research and Technology through the PENED 94 research project.

2 the probe coil. This lift-off can simulate a non-conducting coating like paint, that covers the metallic layer. A second example involves a two layer metallic structure separated by air, simulating a double layer skin of an airframe. The RBF network is trained to estimate the corrosion that takes place on the surfaces in the unreachable region between the metallic layers. The training is based on simulated data, involving the impedance of the probe coil, that is measured for various excitation frequencies. The validity of the inversion method is tested using a new set of analogous data. The data that compose the training and the testing sets are obtained numerically. Generalised radial basis function networks orthogonal least squares Let us assume two sets of N points x i R p and y i R q, i = 1,, N, that are related via the function f: R p R q. The objective of a generalised radial basis function network is to estimate the function f, using the knowledge of the pairs of vectors (x i, y i ). The basic assumption concerning the estimate, F(x i ) = Y i, of the function f, is that the values of y i are approximated by weighted sums of M radial basis functions. Thus: where w jm are the weights, u( ) the radial basis functions, and c m the centres of the functions. A very frequently used type of radial basis function is the Gaussian one: The crucial point during the construction of the network is the choice of its size, M, and the location of the centres, whereas the variances σ m of the Gaussian functions are given by: where d = max{ c i c j }. The original RBF network requires as many centres as data points, N, which is impractical. If the number of data is large, this could lead to ill-conditioning in the case where the centres are located close to each other. For this reason, the orthogonal least squares (OLS) algorithm has been applied for the construction of generalised RBF networks, where the number of centres is much lower than the number of available data points. The OLS method can be employed as a forward regression procedure to select an appropriate set of centres from a large set of candidates. At each step of the algorithm a new centre is selected, based on the requirement that the explained variance of the desired output is (1) (2) (3) Non-destructive testing of layered structures 383

3 384 maximised. The desired output of the RBF network can be written in a matrix form as follows: (4) where: y (j) = [y 1j y 2j y Nj ]T, Y (j) = [Y 1j Y 2j Y Nj ]T, U = [u 1 u 2 u M ], u m = [u m1 u m2 u mn ]T, u mi = u( x i c m ), w (j) = [w j1 w j2 w jm ]T, e (j) = ]e 1j e 2j e Nj ]T represents the error vector of the estimation, and I is the N N unitary matrix. By setting w j0 equal to the mean value of the jth component of the desired output, and d (j) = y (j) w j0 I we obtain: d = Uw + e 1 j q (5) The objective of the OLS algorithm is to transform the columns u m of the matrix U into a set of orthogonal basis vectors, in other words to decompose U into: (6) where the columns of V are orthogonal and A is an M M upper triangular matrix with units on its diagonal. This decomposition is obtained using the classical or the modified Gram-Schmidt orthogonalisation algorithm. Since the columns of V are orthogonal we have: and: where: According to (7), the summed variance of the output vector, with respect to all the q components, is given by: where: ( j) ( j) ( j ), The term: (7) (8) (9) (10) (11) (12)

4 represents the reduction of the approximation error after the choice of the centre c m for the construction of the network. The vector v m and its corresponding centre c m should be selected in such a way that the term z m is maximised during the mth iteration of the orthogonalisation algorithm. Thus, if ρ is the threshold of the approximation error, the centres are selected from the large set of candidates, by successive decompositions of U, until: Finally, the weights of the RBF network are given by: (13) (14) Non-destructive testing of layered structures 385 Applications The general configuration of the non-destructive problems that have been investigated consists of an air-cored probe coil located over a layered conducting structure (Figure 1). The complex impedance of the coil, Z, is a function of the parameters of the structure and the coil itself: Z = F(r 1, r 2, l 1, l 2, σ 1, µ 1, d 1, σ 2, µ 2, d 2,, σ L, µ L, f ), (15) where r 1 is the inner radius of the coil, r 2 its outer radius, l 1 the lift-off, l 2 the length of the coil, σ n, µ n, d n the conductivity, the relative permeability and the thickness respectively of the nth layer and f the excitation frequency. The impedance difference of the probe coil Z produced due to presence of the metallic layers can be evaluated numerically [3]. In the first application, the layered structure was composed of only one layer. The parameters were set (r 1 = 5.35mm, r 2 = 7.7mm, l 2 = 2.3mm, σ =1.39MS/m, µ = µ 0 ), whereas l 1 was allowed to vary from 0 to 1.5mm and d from 0.5 to 3.0mm. For a variety of frequencies (10, 20, 40KHz), training sets of 1,000 input-output Figure 1. Geometric configuration

5 386 vectors were created. The input and output vectors were [Re{ Z} Im{ Z}] T and [l 1 d] T respectively. The threshold of the approximation error, ρ, was set equal to Testing sets of new 500 input-output vectors were used to validate the generalisation ability of the RBF networks. Results of the RBF network construction procedure and its generalisation ability are presented in Table I. For an excitation frequency equal to 10KHz, the estimated versus the real values of the outputs over the testing set are illustrated in Figures 2 and 3. In the second application, the layered structure consisted of two metallic layers 1 and 3, separated by air (layer 2). The thicknesses of the conducting Table I. Results of the training and the generalisation procedures for the two applications First application Second application Excitation frequency f (KHz) Number of centres M Mean square error Figure 2. thickness d Figure 3. lift-off l 1

6 layers d 1, d 3 are supposed to decrease due to corrosion. The corrosion takes place at the lower surface of layer 1 and at the upper surface of layer 3. The known parameters were r 1 = 5.35mm, r 2 = 7.7mm, l 1 = 0.5mm, l 2 = 2.3mm, σ = 35.4MS/m, µ = µ 0, whereas the initial thicknesses of the layers (without corrosion) were d 1 = 2mm, d 2 = 1mm, d 3 = 2mm. The corrosions δd 1, δd 3 of the conducting layers could vary from 0 to 0.5d 1 and 0 to 0.5d 3 respectively. Similarly, training and testing sets were created for a variety of excitation frequencies (0.5, 1.0, 5.0KHz). The output vectors had the form of [δd 1 δd 3 ] T, whereas the error threshold, ρ, was set equal to Results of the training and validation procedures are shown in Table I. For an excitation frequency of 0.5KHz, estimated versus real values of the corrosions, over the testing set, are illustrated in Figures 4 and 5. Conclusions The generalised radial basis function networks have been applied to the evaluation of the conductivity profile of layered metallic structures. The Non-destructive testing of layered structures 387 Figure 4. corrosion δ d 1 Figure 5. corrosion δ d 3

7 388 networks were constructed using the orthogonal least squares algorithm that enhances their efficiency. The proposed approach could provide a robust tool for other classes of inverse problems as well. References 1. Hoole, S.R.H., Artificial neural networks in the solution of inverse electromagnetic field problems, IEEE Trans. Magnetics, Vol. 29 No. 2, March 1993, pp Ishikawa, T. and Matsunami, M., An optimization method based on radial basis function, IEEE Trans. Magnetics, Vol. 33 No. 2, March 1997, pp Rekanos, I.T. and Tsiboukis, T.D., Electromagnetic field inversion based on generalized radial basis functions, The 4th Int. Workshop on Optimization and Inverse Problems in Electromagnetism, Brno, Czech Republic, June 1996, p Chen, S., Cowan, C.F.N. and Grant, P.M., Orthogonal least squares learning algorithm for radial basis function networks, IEEE Trans. Neural Networks, Vol. 2 No. 2, March 1991, pp

Facial expression recognition using shape and texture information

Facial expression recognition using shape and texture information 1 Facial expression recognition using shape and texture information I. Kotsia 1 and I. Pitas 1 Aristotle University of Thessaloniki pitas@aiia.csd.auth.gr Department of Informatics Box 451 54124 Thessaloniki,

More information

Ultrasonic Multi-Skip Tomography for Pipe Inspection

Ultrasonic Multi-Skip Tomography for Pipe Inspection 18 th World Conference on Non destructive Testing, 16-2 April 212, Durban, South Africa Ultrasonic Multi-Skip Tomography for Pipe Inspection Arno VOLKER 1, Rik VOS 1 Alan HUNTER 1 1 TNO, Stieltjesweg 1,

More information

DEVELOPMENT OF PREVENTIVE MAINTENANCE SYSTEM ARISING IN ADVANCED EDDY CURRENT TESTING USING NETWORK TOMOGRAPHY

DEVELOPMENT OF PREVENTIVE MAINTENANCE SYSTEM ARISING IN ADVANCED EDDY CURRENT TESTING USING NETWORK TOMOGRAPHY DEVELOPMENT OF PREVENTIVE MAINTENANCE SYSTEM ARISING IN ADVANCED EDDY CURRENT TESTING USING NETWORK TOMOGRAPHY F. Kojima 1, F.Kobayashi 1, A. Nishimizu 2, M. Koike 2, T. Matsui 2, H. Endo 3, T. Uchimoto

More information

Analysis of Two-dimensional Scattering by a Periodic Array of Conducting Cylinders Using the Method of Auxiliary Sources

Analysis of Two-dimensional Scattering by a Periodic Array of Conducting Cylinders Using the Method of Auxiliary Sources PIERS ONLINE, VOL. 4, NO. 5, 8 51 Analysis of Two-dimensional Scattering by a Periodic Array of Conducting Cylinders Using the Method of Auxiliary Sources Naamen Hichem and Taoufik Aguili Ecole Nationale

More information

FAST EDDY CURRENT FORWARD MODELS USING ARTIFICIAL NEURAL NETWORKS

FAST EDDY CURRENT FORWARD MODELS USING ARTIFICIAL NEURAL NETWORKS FAST EDDY CURRENT FORWARD MODELS USING ARTIFICIAL NEURAL NETWORKS INTRODUCTION Bing Wang, John P. Basart and John C. Moulder Department of Electrical and Computer Engineering and Center for NDE Iowa State

More information

CHAPTER IX Radial Basis Function Networks

CHAPTER IX Radial Basis Function Networks CHAPTER IX Radial Basis Function Networks Radial basis function (RBF) networks are feed-forward networks trained using a supervised training algorithm. They are typically configured with a single hidden

More information

Learning from Data: Adaptive Basis Functions

Learning from Data: Adaptive Basis Functions Learning from Data: Adaptive Basis Functions November 21, 2005 http://www.anc.ed.ac.uk/ amos/lfd/ Neural Networks Hidden to output layer - a linear parameter model But adapt the features of the model.

More information

Two Dimensional Microwave Imaging Using a Divide and Unite Algorithm

Two Dimensional Microwave Imaging Using a Divide and Unite Algorithm Two Dimensional Microwave Imaging Using a Divide and Unite Algorithm Disha Shur 1, K. Yaswanth 2, and Uday K. Khankhoje 2 1 Indian Institute of Engineering Science and Technology, Shibpur, India 2 Indian

More information

Research on Evaluation Method of Product Style Semantics Based on Neural Network

Research on Evaluation Method of Product Style Semantics Based on Neural Network Research Journal of Applied Sciences, Engineering and Technology 6(23): 4330-4335, 2013 ISSN: 2040-7459; e-issn: 2040-7467 Maxwell Scientific Organization, 2013 Submitted: September 28, 2012 Accepted:

More information

Radial Basis Function Networks: Algorithms

Radial Basis Function Networks: Algorithms Radial Basis Function Networks: Algorithms Neural Computation : Lecture 14 John A. Bullinaria, 2015 1. The RBF Mapping 2. The RBF Network Architecture 3. Computational Power of RBF Networks 4. Training

More information

Neural Network based textural labeling of images in multimedia applications

Neural Network based textural labeling of images in multimedia applications Neural Network based textural labeling of images in multimedia applications S.A. Karkanis +, G.D. Magoulas +, and D.A. Karras ++ + University of Athens, Dept. of Informatics, Typa Build., Panepistimiopolis,

More information

LINEAR AND NONLINEAR IMAGE RESTORATION METHODS FOR EDDY

LINEAR AND NONLINEAR IMAGE RESTORATION METHODS FOR EDDY LINEAR AND NONLINEAR IMAGE RESTORATION METHODS FOR EDDY CURRENT NONDESTRUCTIVE EVALUATION Bing Wang:12 John P. Basart,12 and John C. Moulderl lcenter for NDE 2Department of Electrical and Computer Engineering

More information

Simulation Supported POD Methodology and Validation for Automated Eddy Current Procedures

Simulation Supported POD Methodology and Validation for Automated Eddy Current Procedures 4th International Symposium on NDT in Aerospace 2012 - Th.1.A.1 Simulation Supported POD Methodology and Validation for Automated Eddy Current Procedures Anders ROSELL, Gert PERSSON Volvo Aero Corporation,

More information

Pattern Recognition. Kjell Elenius. Speech, Music and Hearing KTH. March 29, 2007 Speech recognition

Pattern Recognition. Kjell Elenius. Speech, Music and Hearing KTH. March 29, 2007 Speech recognition Pattern Recognition Kjell Elenius Speech, Music and Hearing KTH March 29, 2007 Speech recognition 2007 1 Ch 4. Pattern Recognition 1(3) Bayes Decision Theory Minimum-Error-Rate Decision Rules Discriminant

More information

Channel Performance Improvement through FF and RBF Neural Network based Equalization

Channel Performance Improvement through FF and RBF Neural Network based Equalization Channel Performance Improvement through FF and RBF Neural Network based Equalization Manish Mahajan 1, Deepak Pancholi 2, A.C. Tiwari 3 Research Scholar 1, Asst. Professor 2, Professor 3 Lakshmi Narain

More information

Image reconstruction based on back propagation learning in Compressed Sensing theory

Image reconstruction based on back propagation learning in Compressed Sensing theory Image reconstruction based on back propagation learning in Compressed Sensing theory Gaoang Wang Project for ECE 539 Fall 2013 Abstract Over the past few years, a new framework known as compressive sampling

More information

COMPUTATIONAL INTELLIGENCE

COMPUTATIONAL INTELLIGENCE COMPUTATIONAL INTELLIGENCE Radial Basis Function Networks Adrian Horzyk Preface Radial Basis Function Networks (RBFN) are a kind of artificial neural networks that use radial basis functions (RBF) as activation

More information

Torque Ripple Minimization in PM Synchronous Motors Using Tooth Shape Optimization

Torque Ripple Minimization in PM Synchronous Motors Using Tooth Shape Optimization 27 Torque Ripple Minimization in PM Synchronous Motors Using Tooth Shape Optimization Ali Jabbari* Department of Mechanical Engineering, E-mail: Jabbari84@gmail.com *Corresponding author Mohsen Shakeri

More information

Recent advances in Metamodel of Optimal Prognosis. Lectures. Thomas Most & Johannes Will

Recent advances in Metamodel of Optimal Prognosis. Lectures. Thomas Most & Johannes Will Lectures Recent advances in Metamodel of Optimal Prognosis Thomas Most & Johannes Will presented at the Weimar Optimization and Stochastic Days 2010 Source: www.dynardo.de/en/library Recent advances in

More information

Three-dimensional nondestructive evaluation of cylindrical objects (pipe) using an infrared camera coupled to a 3D scanner

Three-dimensional nondestructive evaluation of cylindrical objects (pipe) using an infrared camera coupled to a 3D scanner Three-dimensional nondestructive evaluation of cylindrical objects (pipe) using an infrared camera coupled to a 3D scanner F. B. Djupkep Dizeu, S. Hesabi, D. Laurendeau, A. Bendada Computer Vision and

More information

CLASSIFICATION WITH RADIAL BASIS AND PROBABILISTIC NEURAL NETWORKS

CLASSIFICATION WITH RADIAL BASIS AND PROBABILISTIC NEURAL NETWORKS CLASSIFICATION WITH RADIAL BASIS AND PROBABILISTIC NEURAL NETWORKS CHAPTER 4 CLASSIFICATION WITH RADIAL BASIS AND PROBABILISTIC NEURAL NETWORKS 4.1 Introduction Optical character recognition is one of

More information

Illumination-Robust Face Recognition based on Gabor Feature Face Intrinsic Identity PCA Model

Illumination-Robust Face Recognition based on Gabor Feature Face Intrinsic Identity PCA Model Illumination-Robust Face Recognition based on Gabor Feature Face Intrinsic Identity PCA Model TAE IN SEOL*, SUN-TAE CHUNG*, SUNHO KI**, SEONGWON CHO**, YUN-KWANG HONG*** *School of Electronic Engineering

More information

Globally Stabilized 3L Curve Fitting

Globally Stabilized 3L Curve Fitting Globally Stabilized 3L Curve Fitting Turker Sahin and Mustafa Unel Department of Computer Engineering, Gebze Institute of Technology Cayirova Campus 44 Gebze/Kocaeli Turkey {htsahin,munel}@bilmuh.gyte.edu.tr

More information

WAVELET USE FOR IMAGE RESTORATION

WAVELET USE FOR IMAGE RESTORATION WAVELET USE FOR IMAGE RESTORATION Jiří PTÁČEK and Aleš PROCHÁZKA 1 Institute of Chemical Technology, Prague Department of Computing and Control Engineering Technicka 5, 166 28 Prague 6, Czech Republic

More information

EE613 Machine Learning for Engineers LINEAR REGRESSION. Sylvain Calinon Robot Learning & Interaction Group Idiap Research Institute Nov.

EE613 Machine Learning for Engineers LINEAR REGRESSION. Sylvain Calinon Robot Learning & Interaction Group Idiap Research Institute Nov. EE613 Machine Learning for Engineers LINEAR REGRESSION Sylvain Calinon Robot Learning & Interaction Group Idiap Research Institute Nov. 4, 2015 1 Outline Multivariate ordinary least squares Singular value

More information

Image Denoising Based on Hybrid Fourier and Neighborhood Wavelet Coefficients Jun Cheng, Songli Lei

Image Denoising Based on Hybrid Fourier and Neighborhood Wavelet Coefficients Jun Cheng, Songli Lei Image Denoising Based on Hybrid Fourier and Neighborhood Wavelet Coefficients Jun Cheng, Songli Lei College of Physical and Information Science, Hunan Normal University, Changsha, China Hunan Art Professional

More information

A Coupled 3D/2D Axisymmetric Method for Simulating Magnetic Metal Forming Processes in LS-DYNA

A Coupled 3D/2D Axisymmetric Method for Simulating Magnetic Metal Forming Processes in LS-DYNA A Coupled 3D/2D Axisymmetric Method for Simulating Magnetic Metal Forming Processes in LS-DYNA P. L Eplattenier *, I. Çaldichoury Livermore Software Technology Corporation, Livermore, CA, USA * Corresponding

More information

Facial Expression Recognition using Principal Component Analysis with Singular Value Decomposition

Facial Expression Recognition using Principal Component Analysis with Singular Value Decomposition ISSN: 2321-7782 (Online) Volume 1, Issue 6, November 2013 International Journal of Advance Research in Computer Science and Management Studies Research Paper Available online at: www.ijarcsms.com Facial

More information

Influence of the Aspect Ratio of Tabular Grains on the Light Scattering

Influence of the Aspect Ratio of Tabular Grains on the Light Scattering 000 International Symposium on Silver 000 Halide International TechnologySymposium on Silver Halide Technology Copyright 000, IS&T Influence of the Aspect Ratio of Tabular Grains on the Light Scattering

More information

Unsupervised learning in Vision

Unsupervised learning in Vision Chapter 7 Unsupervised learning in Vision The fields of Computer Vision and Machine Learning complement each other in a very natural way: the aim of the former is to extract useful information from visual

More information

Investigation on OLSR Routing Protocol Efficiency

Investigation on OLSR Routing Protocol Efficiency Investigation on OLSR Routing Protocol Efficiency JIRI HOSEK 1, KAROL MOLNAR 2 Department of Telecommunications Faculty of Electrical Engineering and Communication, Brno University of Technology Purkynova

More information

THE CLASSICAL method for training a multilayer feedforward

THE CLASSICAL method for training a multilayer feedforward 930 IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 10, NO. 4, JULY 1999 A Fast U-D Factorization-Based Learning Algorithm with Applications to Nonlinear System Modeling and Identification Youmin Zhang and

More information

Research Article Prediction Model of Coating Growth Rate for Varied Dip-Angle Spraying Based on Gaussian Sum Model

Research Article Prediction Model of Coating Growth Rate for Varied Dip-Angle Spraying Based on Gaussian Sum Model Mathematical Problems in Engineering Volume 16, Article ID 93647, 7 pages http://dx.doi.org/.1155/16/93647 Research Article Prediction Model of Coating Growth Rate for Varied Dip-Angle Spraying Based on

More information

A problem - too many features. TDA 231 Dimension Reduction: PCA. Features. Making new features

A problem - too many features. TDA 231 Dimension Reduction: PCA. Features. Making new features A problem - too many features TDA 1 Dimension Reduction: Aim: To build a classifier that can diagnose leukaemia using Gene expression data. Data: 7 healthy samples,11 leukaemia samples (N = 8). Each sample

More information

Radial Basis Function Networks

Radial Basis Function Networks Radial Basis Function Networks As we have seen, one of the most common types of neural network is the multi-layer perceptron It does, however, have various disadvantages, including the slow speed in learning

More information

Neural Networks. CE-725: Statistical Pattern Recognition Sharif University of Technology Spring Soleymani

Neural Networks. CE-725: Statistical Pattern Recognition Sharif University of Technology Spring Soleymani Neural Networks CE-725: Statistical Pattern Recognition Sharif University of Technology Spring 2013 Soleymani Outline Biological and artificial neural networks Feed-forward neural networks Single layer

More information

Automated analysis of rotating probe multi-frequency eddy current data from steam generator tubes

Automated analysis of rotating probe multi-frequency eddy current data from steam generator tubes International Journal of Applied Electromagnetics and Mechanics 12 (00) 151 164 151 IOS Press Automated analysis of rotating probe multi-frequency eddy current data from steam generator tubes P. Xiang

More information

An Improved Measurement Placement Algorithm for Network Observability

An Improved Measurement Placement Algorithm for Network Observability IEEE TRANSACTIONS ON POWER SYSTEMS, VOL. 16, NO. 4, NOVEMBER 2001 819 An Improved Measurement Placement Algorithm for Network Observability Bei Gou and Ali Abur, Senior Member, IEEE Abstract This paper

More information

Recent Developments in Model-based Derivative-free Optimization

Recent Developments in Model-based Derivative-free Optimization Recent Developments in Model-based Derivative-free Optimization Seppo Pulkkinen April 23, 2010 Introduction Problem definition The problem we are considering is a nonlinear optimization problem with constraints:

More information

Assignment 2. Classification and Regression using Linear Networks, Multilayer Perceptron Networks, and Radial Basis Functions

Assignment 2. Classification and Regression using Linear Networks, Multilayer Perceptron Networks, and Radial Basis Functions ENEE 739Q: STATISTICAL AND NEURAL PATTERN RECOGNITION Spring 2002 Assignment 2 Classification and Regression using Linear Networks, Multilayer Perceptron Networks, and Radial Basis Functions Aravind Sundaresan

More information

A New RBF Neural Network With Boundary Value Constraints

A New RBF Neural Network With Boundary Value Constraints 98 IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS PART B: CYBERNETICS, VOL. 39, NO. 1, FEBRUARY 009 A New RBF Neural Network With Boundary Value Constraints Xia Hong, Senior Member, IEEE,and Sheng

More information

THREE PHASE FAULT DIAGNOSIS BASED ON RBF NEURAL NETWORK OPTIMIZED BY PSO ALGORITHM

THREE PHASE FAULT DIAGNOSIS BASED ON RBF NEURAL NETWORK OPTIMIZED BY PSO ALGORITHM THREE PHASE FAULT DIAGNOSIS BASED ON RBF NEURAL NETWORK OPTIMIZED BY PSO ALGORITHM M. Sivakumar 1 and R. M. S. Parvathi 2 1 Anna University, Tamilnadu, India 2 Sengunthar College of Engineering, Tamilnadu,

More information

Artificial Neural Network-Based Prediction of Human Posture

Artificial Neural Network-Based Prediction of Human Posture Artificial Neural Network-Based Prediction of Human Posture Abstract The use of an artificial neural network (ANN) in many practical complicated problems encourages its implementation in the digital human

More information

Optimum Array Processing

Optimum Array Processing Optimum Array Processing Part IV of Detection, Estimation, and Modulation Theory Harry L. Van Trees WILEY- INTERSCIENCE A JOHN WILEY & SONS, INC., PUBLICATION Preface xix 1 Introduction 1 1.1 Array Processing

More information

Chapter 1 A New Parallel Algorithm for Computing the Singular Value Decomposition

Chapter 1 A New Parallel Algorithm for Computing the Singular Value Decomposition Chapter 1 A New Parallel Algorithm for Computing the Singular Value Decomposition Nicholas J. Higham Pythagoras Papadimitriou Abstract A new method is described for computing the singular value decomposition

More information

Smith et al. [6] developed a text detection algorithm by using vertical edge. In this method, vertical edges are first detected with a predefined temp

Smith et al. [6] developed a text detection algorithm by using vertical edge. In this method, vertical edges are first detected with a predefined temp COMPARISON OF SUPPORT VECTOR MACHINE AND NEURAL NETWORK FOR TEXT TEXTURE VERIFICATION Datong Chen and Jean-Marc Odobez IDIAP, Switzerland chen, odobez@idiap.ch Abstract. In this paper we propose a method

More information

THE objective of modeling from data is not that the model

THE objective of modeling from data is not that the model 898 IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS PART B: CYBERNETICS, VOL. 34, NO. 2, APRIL 2004 Sparse Modeling Using Orthogonal Forward Regression With PRESS Statistic and Regularization Sheng

More information

Performance Evaluation of a Radial Basis Function Neural Network Learning Algorithm for Function Approximation.

Performance Evaluation of a Radial Basis Function Neural Network Learning Algorithm for Function Approximation. Performance Evaluation of a Radial Basis Function Neural Network Learning Algorithm for Function Approximation. A.A. Khurshid PCEA, Nagpur, India A.P.Gokhale VNIT, Nagpur, India Abstract: This paper presents

More information

Accurate modeling of SiGe HBT using artificial neural networks: Performance Comparison of the MLP and RBF Networks

Accurate modeling of SiGe HBT using artificial neural networks: Performance Comparison of the MLP and RBF Networks Accurate modeling of SiGe HBT using artificial neural networks: Performance Comparison of the MLP and RBF etworks Malek Amiri Abdeboochali Department of Electrical Engineering Razi University Kermanshah,

More information

COMPUTATIONAL NEURAL NETWORKS FOR GEOPHYSICAL DATA PROCESSING

COMPUTATIONAL NEURAL NETWORKS FOR GEOPHYSICAL DATA PROCESSING SEISMIC EXPLORATION Volume 30 COMPUTATIONAL NEURAL NETWORKS FOR GEOPHYSICAL DATA PROCESSING edited by Mary M. POULTON Department of Mining & Geological Engineering Computational Intelligence & Visualization

More information

Chapter 1 A New Parallel Algorithm for Computing the Singular Value Decomposition

Chapter 1 A New Parallel Algorithm for Computing the Singular Value Decomposition Chapter 1 A New Parallel Algorithm for Computing the Singular Value Decomposition Nicholas J. Higham Pythagoras Papadimitriou Abstract A new method is described for computing the singular value decomposition

More information

Radial Basis Function (RBF) Neural Networks Based on the Triple Modular Redundancy Technology (TMR)

Radial Basis Function (RBF) Neural Networks Based on the Triple Modular Redundancy Technology (TMR) Radial Basis Function (RBF) Neural Networks Based on the Triple Modular Redundancy Technology (TMR) Yaobin Qin qinxx143@umn.edu Supervisor: Pro.lilja Department of Electrical and Computer Engineering Abstract

More information

Fast Orthogonal Search For Training Radial Basis. Function Neural Networks. By Wahid Ahmed. Thesis Advisor: Donald M. Hummels, Ph.D.

Fast Orthogonal Search For Training Radial Basis. Function Neural Networks. By Wahid Ahmed. Thesis Advisor: Donald M. Hummels, Ph.D. Fast Orthogonal Search For Training Radial Basis Function Neural Networks By Wahid Ahmed Thesis Advisor: Donald M. Hummels, Ph.D. An Abstract of the Thesis Presented in Partial Fulllment of the Requirements

More information

DIGITAL COLOR RESTORATION OF OLD PAINTINGS. Michalis Pappas and Ioannis Pitas

DIGITAL COLOR RESTORATION OF OLD PAINTINGS. Michalis Pappas and Ioannis Pitas DIGITAL COLOR RESTORATION OF OLD PAINTINGS Michalis Pappas and Ioannis Pitas Department of Informatics Aristotle University of Thessaloniki, Box 451, GR-54006 Thessaloniki, GREECE phone/fax: +30-31-996304

More information

Performance Degradation Assessment and Fault Diagnosis of Bearing Based on EMD and PCA-SOM

Performance Degradation Assessment and Fault Diagnosis of Bearing Based on EMD and PCA-SOM Performance Degradation Assessment and Fault Diagnosis of Bearing Based on EMD and PCA-SOM Lu Chen and Yuan Hang PERFORMANCE DEGRADATION ASSESSMENT AND FAULT DIAGNOSIS OF BEARING BASED ON EMD AND PCA-SOM.

More information

Comparison of TLM and FDTD Methods in RCS Estimation

Comparison of TLM and FDTD Methods in RCS Estimation International Journal of Electrical Engineering. ISSN 0974-2158 Volume 4, Number 3 (2011), pp. 283-287 International Research Publication House http://www.irphouse.com Comparison of TLM and FDTD Methods

More information

A Novel Method for Power-Flow Solution of Radial Distribution Networks

A Novel Method for Power-Flow Solution of Radial Distribution Networks A Novel Method for Power-Flow Solution of Radial Distribution Networks 1 Narinder Singh, 2 Prof. Rajni Bala 1 Student-M.Tech(Power System), 2 Professor(Power System) BBSBEC, Fatehgarh Sahib, Punjab Abstract

More information

SINCE the radial basis function (RBF) is first introduced

SINCE the radial basis function (RBF) is first introduced IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, VOL. 24, NO., NOVEMBER 203 785 A New Discrete-Continuous Algorithm for Radial Basis Function Networks Construction Long Zhang, Student Member,

More information

Robustness of Selective Desensitization Perceptron Against Irrelevant and Partially Relevant Features in Pattern Classification

Robustness of Selective Desensitization Perceptron Against Irrelevant and Partially Relevant Features in Pattern Classification Robustness of Selective Desensitization Perceptron Against Irrelevant and Partially Relevant Features in Pattern Classification Tomohiro Tanno, Kazumasa Horie, Jun Izawa, and Masahiko Morita University

More information

Computational Methods in Statistics with Applications A Numerical Point of View. Large Data Sets. L. Eldén. March 2016

Computational Methods in Statistics with Applications A Numerical Point of View. Large Data Sets. L. Eldén. March 2016 Computational Methods in Statistics with Applications A Numerical Point of View L. Eldén SeSe March 2016 Large Data Sets IDA Machine Learning Seminars, September 17, 2014. Sequential Decision Making: Experiment

More information

Rule Base Reduction: Some Comments on the Use of Orthogonal Transforms

Rule Base Reduction: Some Comments on the Use of Orthogonal Transforms IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS PART C: APPLICATIONS AND REVIEWS, VOL. 31, NO. 2, MAY 2001 199 Rule Base Reduction: Some Comments on the Use of Orthogonal Transforms Magne Setnes, Member,

More information

Sketchable Histograms of Oriented Gradients for Object Detection

Sketchable Histograms of Oriented Gradients for Object Detection Sketchable Histograms of Oriented Gradients for Object Detection No Author Given No Institute Given Abstract. In this paper we investigate a new representation approach for visual object recognition. The

More information

Department of Electronics and Telecommunication Engineering 1 PG Student, JSPM s Imperial College of Engineering and Research, Pune (M.H.

Department of Electronics and Telecommunication Engineering 1 PG Student, JSPM s Imperial College of Engineering and Research, Pune (M.H. Volume 5, Issue 4, 2015 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Introduction to Probabilistic

More information

Comparative Study of ROI Extraction of Palmprint

Comparative Study of ROI Extraction of Palmprint 251 Comparative Study of ROI Extraction of Palmprint 1 Milind E. Rane, 2 Umesh S Bhadade 1,2 SSBT COE&T, North Maharashtra University Jalgaon, India Abstract - The Palmprint region segmentation is an important

More information

On JAM of Triangular Fuzzy Number Matrices

On JAM of Triangular Fuzzy Number Matrices 117 On JAM of Triangular Fuzzy Number Matrices C.Jaisankar 1 and R.Durgadevi 2 Department of Mathematics, A. V. C. College (Autonomous), Mannampandal 609305, India ABSTRACT The fuzzy set theory has been

More information

IN RECENT years, neural network techniques have been recognized

IN RECENT years, neural network techniques have been recognized IEEE TRANSACTIONS ON MICROWAVE THEORY AND TECHNIQUES, VOL. 56, NO. 4, APRIL 2008 867 Neural Network Inverse Modeling and Applications to Microwave Filter Design Humayun Kabir, Student Member, IEEE, Ying

More information

Sparse Distributed Memory Pattern Data Analysis

Sparse Distributed Memory Pattern Data Analysis Sparse Distributed Memory Pattern Data Analysis František Grebeníček * grebenic@dcse.fee.vutbr.cz Abstract: This paper discusses, how some statistical properties of pattern data can affect efficiency of

More information

Simulation of NDT Inspection in 3D Elastic Waveguide Involving Arbitrary Defect

Simulation of NDT Inspection in 3D Elastic Waveguide Involving Arbitrary Defect 19 th World Conference on Non-Destructive Testing 2016 Simulation of NDT Inspection in 3D Elastic Waveguide Involving Arbitrary Defect Vahan BARONIAN 1, Karim JEZZINE 2 1 CEA LIST, Gif-sur-Yvette, France

More information

A STRUCTURAL OPTIMIZATION METHODOLOGY USING THE INDEPENDENCE AXIOM

A STRUCTURAL OPTIMIZATION METHODOLOGY USING THE INDEPENDENCE AXIOM Proceedings of ICAD Cambridge, MA June -3, ICAD A STRUCTURAL OPTIMIZATION METHODOLOGY USING THE INDEPENDENCE AXIOM Kwang Won Lee leekw3@yahoo.com Research Center Daewoo Motor Company 99 Cheongchon-Dong

More information

CHAPTER 6 IMPLEMENTATION OF RADIAL BASIS FUNCTION NEURAL NETWORK FOR STEGANALYSIS

CHAPTER 6 IMPLEMENTATION OF RADIAL BASIS FUNCTION NEURAL NETWORK FOR STEGANALYSIS 95 CHAPTER 6 IMPLEMENTATION OF RADIAL BASIS FUNCTION NEURAL NETWORK FOR STEGANALYSIS 6.1 INTRODUCTION The concept of distance measure is used to associate the input and output pattern values. RBFs use

More information

AN EFFICIENT BINARIZATION TECHNIQUE FOR FINGERPRINT IMAGES S. B. SRIDEVI M.Tech., Department of ECE

AN EFFICIENT BINARIZATION TECHNIQUE FOR FINGERPRINT IMAGES S. B. SRIDEVI M.Tech., Department of ECE AN EFFICIENT BINARIZATION TECHNIQUE FOR FINGERPRINT IMAGES S. B. SRIDEVI M.Tech., Department of ECE sbsridevi89@gmail.com 287 ABSTRACT Fingerprint identification is the most prominent method of biometric

More information

Preconditioning for linear least-squares problems

Preconditioning for linear least-squares problems Preconditioning for linear least-squares problems Miroslav Tůma Institute of Computer Science Academy of Sciences of the Czech Republic tuma@cs.cas.cz joint work with Rafael Bru, José Marín and José Mas

More information

Interpolation is a basic tool used extensively in tasks such as zooming, shrinking, rotating, and geometric corrections.

Interpolation is a basic tool used extensively in tasks such as zooming, shrinking, rotating, and geometric corrections. Image Interpolation 48 Interpolation is a basic tool used extensively in tasks such as zooming, shrinking, rotating, and geometric corrections. Fundamentally, interpolation is the process of using known

More information

Efficient computation of source magnetic scalar potential

Efficient computation of source magnetic scalar potential Adv. Radio Sci., 4, 59 63, 2006 Author(s) 2006. This work is licensed under a Creative Commons License. Advances in Radio Science Efficient computation of source magnetic scalar potential W. Hafla, A.

More information

AN ALGORITHM FOR BLIND RESTORATION OF BLURRED AND NOISY IMAGES

AN ALGORITHM FOR BLIND RESTORATION OF BLURRED AND NOISY IMAGES AN ALGORITHM FOR BLIND RESTORATION OF BLURRED AND NOISY IMAGES Nader Moayeri and Konstantinos Konstantinides Hewlett-Packard Laboratories 1501 Page Mill Road Palo Alto, CA 94304-1120 moayeri,konstant@hpl.hp.com

More information

SNIWD: Simultaneous Weight Noise Injection With Weight Decay for MLP Training

SNIWD: Simultaneous Weight Noise Injection With Weight Decay for MLP Training SNIWD: Simultaneous Weight Noise Injection With Weight Decay for MLP Training John Sum and Kevin Ho Institute of Technology Management, National Chung Hsing University Taichung 4, Taiwan. pfsum@nchu.edu.tw

More information

Title: Advanced Methods for Time-Of-Flight Estimation with Application to Lamb Wave Structural Health Monitoring

Title: Advanced Methods for Time-Of-Flight Estimation with Application to Lamb Wave Structural Health Monitoring Title: Advanced Methods for Time-Of-Flight Estimation with Application to Lamb Wave Structural Health Monitoring Authors: Buli Xu Lingyu Yu Victor Giurgiutiu Paper to be presented at: The 7 th International

More information

Classification and Regression using Linear Networks, Multilayer Perceptrons and Radial Basis Functions

Classification and Regression using Linear Networks, Multilayer Perceptrons and Radial Basis Functions ENEE 739Q SPRING 2002 COURSE ASSIGNMENT 2 REPORT 1 Classification and Regression using Linear Networks, Multilayer Perceptrons and Radial Basis Functions Vikas Chandrakant Raykar Abstract The aim of the

More information

Basis Functions. Volker Tresp Summer 2016

Basis Functions. Volker Tresp Summer 2016 Basis Functions Volker Tresp Summer 2016 1 I am an AI optimist. We ve got a lot of work in machine learning, which is sort of the polite term for AI nowadays because it got so broad that it s not that

More information

MULTI-OUTPUT LEAST SQUARE SUPPORT VECTOR MACHINE FOR THE RECONSTRUCTION OF PERFECT ELECTRIC CONDUCTOR BELOW ROUGH SURFACE

MULTI-OUTPUT LEAST SQUARE SUPPORT VECTOR MACHINE FOR THE RECONSTRUCTION OF PERFECT ELECTRIC CONDUCTOR BELOW ROUGH SURFACE Progress In Electromagnetics Research M, Vol. 30, 117 128, 2013 MULTI-OUTPUT LEAST SQUARE SUPPORT VECTOR MACHINE FOR THE RECONSTRUCTION OF PERFECT ELECTRIC CONDUCTOR BELOW ROUGH SURFACE Jiliang Cai 1,

More information

Excerpt from the Proceedings of the COMSOL Conference 2010 Paris

Excerpt from the Proceedings of the COMSOL Conference 2010 Paris Excerpt from the Proceedings of the COMSOL Conference 2010 Paris Simulation of Flaw Signals in a Magnetic Flux Leakage Inspection Procedure O. Nemitz * and T. Schmitte Salzgitter Mannesmann Forschung GmbH

More information

EE613 Machine Learning for Engineers LINEAR REGRESSION. Sylvain Calinon Robot Learning & Interaction Group Idiap Research Institute Nov.

EE613 Machine Learning for Engineers LINEAR REGRESSION. Sylvain Calinon Robot Learning & Interaction Group Idiap Research Institute Nov. EE613 Machine Learning for Engineers LINEAR REGRESSION Sylvain Calinon Robot Learning & Interaction Group Idiap Research Institute Nov. 9, 2017 1 Outline Multivariate ordinary least squares Matlab code:

More information

Image Processing and Image Representations for Face Recognition

Image Processing and Image Representations for Face Recognition Image Processing and Image Representations for Face Recognition 1 Introduction Face recognition is an active area of research in image processing and pattern recognition. Since the general topic of face

More information

Uncertainties: Representation and Propagation & Line Extraction from Range data

Uncertainties: Representation and Propagation & Line Extraction from Range data 41 Uncertainties: Representation and Propagation & Line Extraction from Range data 42 Uncertainty Representation Section 4.1.3 of the book Sensing in the real world is always uncertain How can uncertainty

More information

International Journal of Industrial Engineering Computations

International Journal of Industrial Engineering Computations International Journal of Industrial Engineering Computations 4 (2013) 325 336 Contents lists available at GrowingScience International Journal of Industrial Engineering Computations homepage: www.growingscience.com/ijiec

More information

We are IntechOpen, the world s leading publisher of Open Access books Built by scientists, for scientists. International authors and editors

We are IntechOpen, the world s leading publisher of Open Access books Built by scientists, for scientists. International authors and editors We are IntechOpen, the world s leading publisher of Open Access books Built by scientists, for scientists 3,00,000 M Open access books available International authors and editors Downloads Our authors

More information

ABASIC principle in nonlinear system modelling is the

ABASIC principle in nonlinear system modelling is the 78 IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, VOL. 16, NO. 1, JANUARY 2008 NARX-Based Nonlinear System Identification Using Orthogonal Least Squares Basis Hunting S. Chen, X. X. Wang, and C. J. Harris

More information

Classification of Printed Chinese Characters by Using Neural Network

Classification of Printed Chinese Characters by Using Neural Network Classification of Printed Chinese Characters by Using Neural Network ATTAULLAH KHAWAJA Ph.D. Student, Department of Electronics engineering, Beijing Institute of Technology, 100081 Beijing, P.R.CHINA ABDUL

More information

CS 565 Computer Vision. Nazar Khan PUCIT Lectures 15 and 16: Optic Flow

CS 565 Computer Vision. Nazar Khan PUCIT Lectures 15 and 16: Optic Flow CS 565 Computer Vision Nazar Khan PUCIT Lectures 15 and 16: Optic Flow Introduction Basic Problem given: image sequence f(x, y, z), where (x, y) specifies the location and z denotes time wanted: displacement

More information

Divide and Conquer Kernel Ridge Regression

Divide and Conquer Kernel Ridge Regression Divide and Conquer Kernel Ridge Regression Yuchen Zhang John Duchi Martin Wainwright University of California, Berkeley COLT 2013 Yuchen Zhang (UC Berkeley) Divide and Conquer KRR COLT 2013 1 / 15 Problem

More information

Central Manufacturing Technology Institute, Bangalore , India,

Central Manufacturing Technology Institute, Bangalore , India, 5 th International & 26 th All India Manufacturing Technology, Design and Research Conference (AIMTDR 2014) December 12 th 14 th, 2014, IIT Guwahati, Assam, India Investigation on the influence of cutting

More information

Comparison of Experimental and Model Based POD in a Simplified Eddy Current Procedure

Comparison of Experimental and Model Based POD in a Simplified Eddy Current Procedure 18th World Conference on Nondestructive Testing, 16-2 April 212, Durban, South Africa Comparison of Experimental and Model Based POD in a Simplified Eddy Current Procedure Anders ROSELL 1, Gert PERSSON

More information

Basis Functions. Volker Tresp Summer 2017

Basis Functions. Volker Tresp Summer 2017 Basis Functions Volker Tresp Summer 2017 1 Nonlinear Mappings and Nonlinear Classifiers Regression: Linearity is often a good assumption when many inputs influence the output Some natural laws are (approximately)

More information

A 3D-2D AGILD EM Modeling and Inversion Imaging

A 3D-2D AGILD EM Modeling and Inversion Imaging PIERS ONLINE, VOL. 3, NO. 4, 2007 423 A 3D-2D AGILD EM Modeling and Inversion Imaging J. Li 1, G. Xie 1, M. Oristaglio 2, L. Xie 1, and F. Xie 1 1 GL Geophysical Laboratory, USA 2 Schlumberger-Doll Research,

More information

Hydraulic pump fault diagnosis with compressed signals based on stagewise orthogonal matching pursuit

Hydraulic pump fault diagnosis with compressed signals based on stagewise orthogonal matching pursuit Hydraulic pump fault diagnosis with compressed signals based on stagewise orthogonal matching pursuit Zihan Chen 1, Chen Lu 2, Hang Yuan 3 School of Reliability and Systems Engineering, Beihang University,

More information

Dynamic Analysis of Structures Using Neural Networks

Dynamic Analysis of Structures Using Neural Networks Dynamic Analysis of Structures Using Neural Networks Alireza Lavaei Academic member, Islamic Azad University, Boroujerd Branch, Iran Alireza Lohrasbi Academic member, Islamic Azad University, Boroujerd

More information

RECOVERY OF PARTIALLY OBSERVED DATA APPEARING IN CLUSTERS. Sunrita Poddar, Mathews Jacob

RECOVERY OF PARTIALLY OBSERVED DATA APPEARING IN CLUSTERS. Sunrita Poddar, Mathews Jacob RECOVERY OF PARTIALLY OBSERVED DATA APPEARING IN CLUSTERS Sunrita Poddar, Mathews Jacob Department of Electrical and Computer Engineering The University of Iowa, IA, USA ABSTRACT We propose a matrix completion

More information

Fluid structure interaction analysis: vortex shedding induced vibrations

Fluid structure interaction analysis: vortex shedding induced vibrations Fluid structure interaction analysis: vortex shedding induced vibrations N. Di Domenico, M. E. * University of Rome «Tor Vergata», Department of Enterprise Engineering «Mario Lucertini» A. Wade, T. Berg,

More information

Image Enhancement Techniques for Fingerprint Identification

Image Enhancement Techniques for Fingerprint Identification March 2013 1 Image Enhancement Techniques for Fingerprint Identification Pankaj Deshmukh, Siraj Pathan, Riyaz Pathan Abstract The aim of this paper is to propose a new method in fingerprint enhancement

More information

DD2429 Computational Photography :00-19:00

DD2429 Computational Photography :00-19:00 . Examination: DD2429 Computational Photography 202-0-8 4:00-9:00 Each problem gives max 5 points. In order to pass you need about 0-5 points. You are allowed to use the lecture notes and standard list

More information