Spatial Variation of Sea-Level Sea level reconstruction

Size: px
Start display at page:

Download "Spatial Variation of Sea-Level Sea level reconstruction"

Transcription

1 Spatial Variation of Sea-Level Sea level reconstruction Biao Chang Multimedia Environmental Simulation Laboratory School of Civil and Environmental Engineering Georgia Institute of Technology Advisor: Dr. Mustafa M. Aral April 8, 213

2 Problem definition Recap of last presentation Fuzzy C-Means Non-spherical shapes in the attribute domain Spatial contiguity in the geographic domain Mean silhoutte value number of clusters Subsequent work Semi-empirical modeling Definition of empirical : adj. based on, concerned with, or verifiable by observation or experience rather than theory or pure logic ( Observation shortage Temporal coverage of spatial sea level data: 19 to 21 Tide gauge stations (observational data):

3 Methodology of reconstruction The basic ideas Filter out noise Capture spatial pattern Fill data gaps Review of previous methods Originated from Singular Value Decomposition (SVD)

4 Methodology of reconstruction The basic ideas Filter out noise Capture spatial pattern Fill data gaps Review of previous methods Originated from Singular Value Decomposition (SVD) t: 1-T (temporal) n: 1-N (spatial) Sea level data matrix H: N T

5 Methodology of reconstruction The basic ideas Filter out noise Capture spatial pattern Fill data gaps Review of previous methods Originated from Singular Value Decomposition (SVD) t: 1-T (temporal) n: 1-N (spatial) (Modified from internet resources)

6 Methodology of reconstruction The basic ideas Filter out noise Capture spatial pattern Fill data gaps Review of previous methods Reduced SVD H U' S V T N T N p p p p T U ' N p H U' Α ht ( ) U' α ( t) N T N p p T N p N 1 p 1 Reconstruction: going beyond T At time t, only R observations, data at N-R points need to be reconstructed ( ') ' α ( ') α ( t ') hr t Ur t R p R 1 p 1 p 1 ( ') U' α ( t ') N p N 1 p 1 Alternative names in climate studies: empirical orthogonal functions (EOFs), reduced space optimal interpolation (Smith et al., 1996; Kaplan et al., 2; Church et al., 24) ht

7 Methodology of reconstruction Our method of data reconstruction Why not reduced SVD (Church et al., 24)? different tasks Data gap vs data famine Construction of spatial pattern Uncertainty issue ( ) ' α ( ) ht U t N p N 1 p 1 Ideas in reduced SVD to serve in the development of new methods Certain spatial relationships do not change over time U Magnitudes of major spatial components can be calibrated during reconstruction The basic ideas Filter out noise Capture spatial pattern Fill data gaps ' N p

8 Methodology of reconstruction Our approach to realize the basic ideas Filter out noise clustering and subsequent spatial averaging within clusters Capture spatial pattern artificial neural network (NN) Fill data gaps utilizing global mean sea level and spatial SST data Neural network architecture Starting from the black box perspective 6 SST 1 Latitude (degree) Indian Pacific Atlantic SST 2 H Longitude (degree) H global H 2 SST 3 H 3 Temporal coverage: Temporal coverage:

9 Methodology of reconstruction Neural network architecture Inside the black box Type of neural network: feedforward Neurons: layer and number Within neuron: weight, bias, transfer function Pre- and post- processing H global H 1 SST 1 H 2 SST 2 H 3 SST 3

10 Methodology of reconstruction Mathematics of NN Weights and biases M 1 H global N W 1 W 1 M1 M2 N1 N1 M 2 2 M 2 1 ( X ) A = TransFcn1 W + B N T M Y 2 T ( W A B ) = TransFcn X M T 1 SST 1 H 1 H 2 M Y 2 T SST 2 H 3 SST Transfer functions 1 2 Log-Sigmoid : y = Tan-Sigmoid : y = 1 x 1 + 2x 1+ e B 1 N B 2 M 1 e Linear transfer : y = x

11 Methodology of reconstruction Training and validating NN NN training is first an optimization problem Gradient descent and related Conjugate gradient and related Levenberg-Marquardt algorithm Other ( ) T 1 T k+ 1 = k Jk J k + I Jk Y f k β β λ β 1 ( ) Y f ( ) T T T βk+ 1 = βk k k λdiag J J + Jk Jk Jk βk Validating NN to improve generalization The best training vs. the best generalization Mean Squared Error (mse) Best Validation Performance is.1461 at epoch Train Validation Best Epochs

12 Results of reconstruction Training and validation: example SLR-199 (cm) SLR-199 (cm) SLR-199 (cm) - Observation: validation Reconstruction Observation: training Instances Output ~=.97*Target Error Histogram with 2 Bins Data Fit Y = T Errors = Targets - Outputs Training: R=.9872 Training Zero Error Target

13 Results of reconstruction Issue 1: local minimum + initial weights/biases zero initialization Error Histogram with 2 Bins random [-1, 1] initialization Error Histogram with 2 Bins Training Zero Error Training Zero Error 4 4 Instances 3 2 Instances Errors = Targets - Outputs Errors = Targets - Outputs Solution: Multiple trainings with random initial weights/biases (1 reps)

14 Results of reconstruction Issue 2: generalization Training without validation check 1 Best Training Performance is.2627 at epoch 2 Train Best Goal Training with validation check 1 Best Validation Performance is.149 at epoch 11 Mean Squared Error (mse) Mean Squared Error (mse) Train Validation Best Goal Epochs Epochs

15 Results of reconstruction Issue 2: generalization Training without validation check Training with validation check SLR-199 (cm) - SLR-199 (cm) SLR-199 (cm) -1 SLR-199 (cm) SLR-199 (cm) -1 SLR-199 (cm)

16 Results of reconstruction Issue 2: generalization Training without validation check : reconstructed regional means vs global observation Training with validation check : reconstructed regional means vs global observation 1 Sea level relative to 199 (cm) -1-2 Reconstructed mean of Cluster 1-3 Reconstructed mean of Cluster 2 Reconstructed mean of Cluster 3 Global mean of observations Year Sea level relative to 199 (cm) - -1 Reconstructed mean of Cluster 1-1 Reconstructed mean of Cluster 2 Reconstructed mean of Cluster 3 Global mean of observations Year

17 Results of reconstruction Issue 2: generalization Validation dataset used as training data : reconstructed regional means vs global observation Training with validation check : reconstructed regional means vs global observation Sea level relative to 199 (cm) - -1 Reconstructed mean of Cluster 1-1 Reconstructed mean of Cluster 2 Reconstructed mean of Cluster 3 Global mean of observations Year Solution: Training with validation check (1%) Sea level relative to 199 (cm) - -1 Reconstructed mean of Cluster 1-1 Reconstructed mean of Cluster 2 Reconstructed mean of Cluster 3 Global mean of observations Year

18 Results of reconstruction Impact of region division Division based on ocean basins Division based on clustering SLR-199 (cm) - SLR-199 (cm) SLR-199 (cm) - SLR-199 (cm) SLR-199 (cm) - SLR-199 (cm)

19 Results of reconstruction Impact of SST as input: clustering H global and 3 SST s as inputs H global as the only input SLR-199 (cm) - Reconstruction Observation: training Observation: validation SLR-199 (cm) SLR-199 (cm) - SLR-199 (cm) SLR-199 (cm) - SLR-199 (cm)

20 Results of reconstruction Impact of SST as input: ocean basin H global and 3 SST s as inputs H global as the only input SLR-199 (cm) - SLR-199 (cm) SLR-199 (cm) - SLR-199 (cm) SLR-199 (cm) - SLR-199 (cm)

21 Results of reconstruction Final results: clustering : reconstructed regional means vs global observation SLR-199 (cm) SLR-199 (cm) SLR-199 (cm) - Reconstruction Observation: training Observation: validation Sea level relative to 199 (cm) Sea level relative to 199 (cm) Reconstructed mean of Cluster 1 Reconstructed mean of Cluster 2 Reconstructed mean of Cluster Year : global mean - observation vs reconstruction Global mean of observations Area-weighted mean of 3 reconstructed regions Year

22 Results of reconstruction Final results: ocean basin : reconstructed regional means vs global observation SLR-199 (cm) SLR-199 (cm) - Reconstruction Observation: training Observation: validation Sea level relative to 199 (cm) Year 4 2 Reconstructed mean of Cluster 1 Reconstructed mean of Cluster 2 Reconstructed mean of Cluster : global mean - observation vs reconstruction Global mean of observations Area-weighted mean of 3 reconstructed regions SLR-199 (cm) Sea level relative to 199 (cm) Year

23 The End Thanks!

Spatial Distributions of Precipitation Events from Regional Climate Models

Spatial Distributions of Precipitation Events from Regional Climate Models Spatial Distributions of Precipitation Events from Regional Climate Models N. Lenssen September 2, 2010 1 Scientific Reason The Institute of Mathematics Applied to Geosciences (IMAGe) and the National

More information

Analysis of Functional MRI Timeseries Data Using Signal Processing Techniques

Analysis of Functional MRI Timeseries Data Using Signal Processing Techniques Analysis of Functional MRI Timeseries Data Using Signal Processing Techniques Sea Chen Department of Biomedical Engineering Advisors: Dr. Charles A. Bouman and Dr. Mark J. Lowe S. Chen Final Exam October

More information

Time Series Prediction as a Problem of Missing Values: Application to ESTSP2007 and NN3 Competition Benchmarks

Time Series Prediction as a Problem of Missing Values: Application to ESTSP2007 and NN3 Competition Benchmarks Series Prediction as a Problem of Missing Values: Application to ESTSP7 and NN3 Competition Benchmarks Antti Sorjamaa and Amaury Lendasse Abstract In this paper, time series prediction is considered as

More information

Calibration and emulation of TIE-GCM

Calibration and emulation of TIE-GCM Calibration and emulation of TIE-GCM Serge Guillas School of Mathematics Georgia Institute of Technology Jonathan Rougier University of Bristol Big Thanks to Crystal Linkletter (SFU-SAMSI summer school)

More information

Akarsh Pokkunuru EECS Department Contractive Auto-Encoders: Explicit Invariance During Feature Extraction

Akarsh Pokkunuru EECS Department Contractive Auto-Encoders: Explicit Invariance During Feature Extraction Akarsh Pokkunuru EECS Department 03-16-2017 Contractive Auto-Encoders: Explicit Invariance During Feature Extraction 1 AGENDA Introduction to Auto-encoders Types of Auto-encoders Analysis of different

More information

Collaborative Filtering Applied to Educational Data Mining

Collaborative Filtering Applied to Educational Data Mining Collaborative Filtering Applied to Educational Data Mining KDD Cup 200 July 25 th, 200 BigChaos @ KDD Team Dataset Solution Overview Michael Jahrer, Andreas Töscher from commendo research Dataset Team

More information

MODELLING OF ARTIFICIAL NEURAL NETWORK CONTROLLER FOR ELECTRIC DRIVE WITH LINEAR TORQUE LOAD FUNCTION

MODELLING OF ARTIFICIAL NEURAL NETWORK CONTROLLER FOR ELECTRIC DRIVE WITH LINEAR TORQUE LOAD FUNCTION MODELLING OF ARTIFICIAL NEURAL NETWORK CONTROLLER FOR ELECTRIC DRIVE WITH LINEAR TORQUE LOAD FUNCTION Janis Greivulis, Anatoly Levchenkov, Mikhail Gorobetz Riga Technical University, Faculty of Electrical

More information

Project RECOLOUR (REconstruction of COLOUR scenes) - SR/00/111 RESEARCH PROGRAMME FOR EARTH OBSERVATION STEREO II - BELGIAN SCIENCE POLICY

Project RECOLOUR (REconstruction of COLOUR scenes) - SR/00/111 RESEARCH PROGRAMME FOR EARTH OBSERVATION STEREO II - BELGIAN SCIENCE POLICY MUMM - RBINS Cloud filling of TSM, CHL and SST remote sensing products by the Data Interpolation with Empirical Orthogonal Functions methodology (DINEOF), application to the BELCOLOUR-1 database. Damien

More information

Image Compression: An Artificial Neural Network Approach

Image Compression: An Artificial Neural Network Approach Image Compression: An Artificial Neural Network Approach Anjana B 1, Mrs Shreeja R 2 1 Department of Computer Science and Engineering, Calicut University, Kuttippuram 2 Department of Computer Science and

More information

FMA901F: Machine Learning Lecture 3: Linear Models for Regression. Cristian Sminchisescu

FMA901F: Machine Learning Lecture 3: Linear Models for Regression. Cristian Sminchisescu FMA901F: Machine Learning Lecture 3: Linear Models for Regression Cristian Sminchisescu Machine Learning: Frequentist vs. Bayesian In the frequentist setting, we seek a fixed parameter (vector), with value(s)

More information

SOM+EOF for Finding Missing Values

SOM+EOF for Finding Missing Values SOM+EOF for Finding Missing Values Antti Sorjamaa 1, Paul Merlin 2, Bertrand Maillet 2 and Amaury Lendasse 1 1- Helsinki University of Technology - CIS P.O. Box 5400, 02015 HUT - Finland 2- Variances and

More information

INVESTIGATING DATA MINING BY ARTIFICIAL NEURAL NETWORK: A CASE OF REAL ESTATE PROPERTY EVALUATION

INVESTIGATING DATA MINING BY ARTIFICIAL NEURAL NETWORK: A CASE OF REAL ESTATE PROPERTY EVALUATION http:// INVESTIGATING DATA MINING BY ARTIFICIAL NEURAL NETWORK: A CASE OF REAL ESTATE PROPERTY EVALUATION 1 Rajat Pradhan, 2 Satish Kumar 1,2 Dept. of Electronics & Communication Engineering, A.S.E.T.,

More information

Images Reconstruction using an iterative SOM based algorithm.

Images Reconstruction using an iterative SOM based algorithm. Images Reconstruction using an iterative SOM based algorithm. M.Jouini 1, S.Thiria 2 and M.Crépon 3 * 1- LOCEAN, MMSA team, CNAM University, Paris, France 2- LOCEAN, MMSA team, UVSQ University Paris, France

More information

COMPUTATIONAL INTELLIGENCE

COMPUTATIONAL INTELLIGENCE COMPUTATIONAL INTELLIGENCE Radial Basis Function Networks Adrian Horzyk Preface Radial Basis Function Networks (RBFN) are a kind of artificial neural networks that use radial basis functions (RBF) as activation

More information

CS 664 Structure and Motion. Daniel Huttenlocher

CS 664 Structure and Motion. Daniel Huttenlocher CS 664 Structure and Motion Daniel Huttenlocher Determining 3D Structure Consider set of 3D points X j seen by set of cameras with projection matrices P i Given only image coordinates x ij of each point

More information

Opening the Black Box Data Driven Visualizaion of Neural N

Opening the Black Box Data Driven Visualizaion of Neural N Opening the Black Box Data Driven Visualizaion of Neural Networks September 20, 2006 Aritificial Neural Networks Limitations of ANNs Use of Visualization (ANNs) mimic the processes found in biological

More information

Hartley - Zisserman reading club. Part I: Hartley and Zisserman Appendix 6: Part II: Zhengyou Zhang: Presented by Daniel Fontijne

Hartley - Zisserman reading club. Part I: Hartley and Zisserman Appendix 6: Part II: Zhengyou Zhang: Presented by Daniel Fontijne Hartley - Zisserman reading club Part I: Hartley and Zisserman Appendix 6: Iterative estimation methods Part II: Zhengyou Zhang: A Flexible New Technique for Camera Calibration Presented by Daniel Fontijne

More information

COMBINING NEURAL NETWORKS FOR SKIN DETECTION

COMBINING NEURAL NETWORKS FOR SKIN DETECTION COMBINING NEURAL NETWORKS FOR SKIN DETECTION Chelsia Amy Doukim 1, Jamal Ahmad Dargham 1, Ali Chekima 1 and Sigeru Omatu 2 1 School of Engineering and Information Technology, Universiti Malaysia Sabah,

More information

Training of Neural Networks. Q.J. Zhang, Carleton University

Training of Neural Networks. Q.J. Zhang, Carleton University Training of Neural Networks Notation: x: input of the original modeling problem or the neural network y: output of the original modeling problem or the neural network w: internal weights/parameters of

More information

Comparison of variable learning rate and Levenberg-Marquardt back-propagation training algorithms for detecting attacks in Intrusion Detection Systems

Comparison of variable learning rate and Levenberg-Marquardt back-propagation training algorithms for detecting attacks in Intrusion Detection Systems Comparison of variable learning rate and Levenberg-Marquardt back-propagation training algorithms for detecting attacks in Intrusion Detection Systems Tummala Pradeep 1 IV th Year Student, Department of

More information

A neural network that classifies glass either as window or non-window depending on the glass chemistry.

A neural network that classifies glass either as window or non-window depending on the glass chemistry. A neural network that classifies glass either as window or non-window depending on the glass chemistry. Djaber Maouche Department of Electrical Electronic Engineering Cukurova University Adana, Turkey

More information

Optimizing Number of Hidden Nodes for Artificial Neural Network using Competitive Learning Approach

Optimizing Number of Hidden Nodes for Artificial Neural Network using Competitive Learning Approach Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology IJCSMC, Vol. 4, Issue. 5, May 2015, pg.358

More information

An Algorithm For Training Multilayer Perceptron (MLP) For Image Reconstruction Using Neural Network Without Overfitting.

An Algorithm For Training Multilayer Perceptron (MLP) For Image Reconstruction Using Neural Network Without Overfitting. An Algorithm For Training Multilayer Perceptron (MLP) For Image Reconstruction Using Neural Network Without Overfitting. Mohammad Mahmudul Alam Mia, Shovasis Kumar Biswas, Monalisa Chowdhury Urmi, Abubakar

More information

Supervised Learning in Neural Networks (Part 2)

Supervised Learning in Neural Networks (Part 2) Supervised Learning in Neural Networks (Part 2) Multilayer neural networks (back-propagation training algorithm) The input signals are propagated in a forward direction on a layer-bylayer basis. Learning

More information

Bathymetry estimation from multi-spectral satellite images using a neuro-fuzzy technique

Bathymetry estimation from multi-spectral satellite images using a neuro-fuzzy technique Bathymetry estimation from multi-spectral satellite Linda Corucci a, Andrea Masini b, Marco Cococcioni a a Dipartimento di Ingegneria dell Informazione: Elettronica, Informatica, Telecomunicazioni. University

More information

Simulation of Zhang Suen Algorithm using Feed- Forward Neural Networks

Simulation of Zhang Suen Algorithm using Feed- Forward Neural Networks Simulation of Zhang Suen Algorithm using Feed- Forward Neural Networks Ritika Luthra Research Scholar Chandigarh University Gulshan Goyal Associate Professor Chandigarh University ABSTRACT Image Skeletonization

More information

Feature selection. Term 2011/2012 LSI - FIB. Javier Béjar cbea (LSI - FIB) Feature selection Term 2011/ / 22

Feature selection. Term 2011/2012 LSI - FIB. Javier Béjar cbea (LSI - FIB) Feature selection Term 2011/ / 22 Feature selection Javier Béjar cbea LSI - FIB Term 2011/2012 Javier Béjar cbea (LSI - FIB) Feature selection Term 2011/2012 1 / 22 Outline 1 Dimensionality reduction 2 Projections 3 Attribute selection

More information

Quaternions & Rotation in 3D Space

Quaternions & Rotation in 3D Space Quaternions & Rotation in 3D Space 1 Overview Quaternions: definition Quaternion properties Quaternions and rotation matrices Quaternion-rotation matrices relationship Spherical linear interpolation Concluding

More information

Evaluation of Neural Networks in the Subject of Prognostics As Compared To Linear Regression Model

Evaluation of Neural Networks in the Subject of Prognostics As Compared To Linear Regression Model International Journal of Engineering & Technology IJET-IJENS Vol:10 No:06 50 Evaluation of Neural Networks in the Subject of Prognostics As Compared To Linear Regression Model A. M. Riad, Hamdy K. Elminir,

More information

The Mathematics Behind Neural Networks

The Mathematics Behind Neural Networks The Mathematics Behind Neural Networks Pattern Recognition and Machine Learning by Christopher M. Bishop Student: Shivam Agrawal Mentor: Nathaniel Monson Courtesy of xkcd.com The Black Box Training the

More information

Neural Network Neurons

Neural Network Neurons Neural Networks Neural Network Neurons 1 Receives n inputs (plus a bias term) Multiplies each input by its weight Applies activation function to the sum of results Outputs result Activation Functions Given

More information

Sparse & Functional Principal Components Analysis

Sparse & Functional Principal Components Analysis Sparse & Functional Principal Components Analysis Genevera I. Allen Department of Statistics and Electrical and Computer Engineering, Rice University, Department of Pediatrics-Neurology, Baylor College

More information

Supplement of Sea-surface dimethylsulfide (DMS) concentration from satellite data at global and regional scales

Supplement of Sea-surface dimethylsulfide (DMS) concentration from satellite data at global and regional scales Supplement of Biogeosciences, 15, 3497 3519, 2018 https://doi.org/10.5194/bg-15-3497-2018-supplement Author(s) 2018. This work is distributed under the Creative Commons Attribution 4.0 License. Supplement

More information

Multiple-Choice Questionnaire Group C

Multiple-Choice Questionnaire Group C Family name: Vision and Machine-Learning Given name: 1/28/2011 Multiple-Choice naire Group C No documents authorized. There can be several right answers to a question. Marking-scheme: 2 points if all right

More information

3D Visualization through Planar Pattern Based Augmented Reality

3D Visualization through Planar Pattern Based Augmented Reality NATIONAL TECHNICAL UNIVERSITY OF ATHENS SCHOOL OF RURAL AND SURVEYING ENGINEERS DEPARTMENT OF TOPOGRAPHY LABORATORY OF PHOTOGRAMMETRY 3D Visualization through Planar Pattern Based Augmented Reality Dr.

More information

Statistical foundations of machine learning

Statistical foundations of machine learning Statistical foundations of machine learning INFO-F-422 Gianluca Bontempi Machine Learning Group Computer Science Department mlg.ulb.ac.be Some algorithms for nonlinear modeling Feedforward neural network

More information

EE795: Computer Vision and Intelligent Systems

EE795: Computer Vision and Intelligent Systems EE795: Computer Vision and Intelligent Systems Spring 2012 TTh 17:30-18:45 WRI C225 Lecture 04 130131 http://www.ee.unlv.edu/~b1morris/ecg795/ 2 Outline Review Histogram Equalization Image Filtering Linear

More information

A Deeper Insight of Neural Network Spatial Interaction Model s Performance Trained with Different Training Algorithms

A Deeper Insight of Neural Network Spatial Interaction Model s Performance Trained with Different Training Algorithms A Deeper Insight of Neural Network Spatial Interaction Model s Performance Trained with Different Training Algorithms Gusri YALDI Civil Engineering Department, Padang State Polytechnic, Padang, Indonesia

More information

Accelerating the convergence speed of neural networks learning methods using least squares

Accelerating the convergence speed of neural networks learning methods using least squares Bruges (Belgium), 23-25 April 2003, d-side publi, ISBN 2-930307-03-X, pp 255-260 Accelerating the convergence speed of neural networks learning methods using least squares Oscar Fontenla-Romero 1, Deniz

More information

Application of Neural Networks to b-quark jet detection in Z b b

Application of Neural Networks to b-quark jet detection in Z b b Application of Neural Networks to b-quark jet detection in Z b b Stephen Poprocki REU 25 Department of Physics, The College of Wooster, Wooster, Ohio 44691 Advisors: Gustaaf Brooijmans, Andy Haas Nevis

More information

CHAPTER 6 DETECTION OF MASS USING NOVEL SEGMENTATION, GLCM AND NEURAL NETWORKS

CHAPTER 6 DETECTION OF MASS USING NOVEL SEGMENTATION, GLCM AND NEURAL NETWORKS 130 CHAPTER 6 DETECTION OF MASS USING NOVEL SEGMENTATION, GLCM AND NEURAL NETWORKS A mass is defined as a space-occupying lesion seen in more than one projection and it is described by its shapes and margin

More information

Spatial Outlier Detection

Spatial Outlier Detection Spatial Outlier Detection Chang-Tien Lu Department of Computer Science Northern Virginia Center Virginia Tech Joint work with Dechang Chen, Yufeng Kou, Jiang Zhao 1 Spatial Outlier A spatial data point

More information

NN-GVEIN: Neural Network-Based Modeling of Velocity Profile inside Graft-To-Vein Connection

NN-GVEIN: Neural Network-Based Modeling of Velocity Profile inside Graft-To-Vein Connection Proceedings of 5th International Symposium on Intelligent Manufacturing Systems, Ma1y 29-31, 2006: 854-862 Sakarya University, Department of Industrial Engineering1 NN-GVEIN: Neural Network-Based Modeling

More information

CHAPTER 8 COMPOUND CHARACTER RECOGNITION USING VARIOUS MODELS

CHAPTER 8 COMPOUND CHARACTER RECOGNITION USING VARIOUS MODELS CHAPTER 8 COMPOUND CHARACTER RECOGNITION USING VARIOUS MODELS 8.1 Introduction The recognition systems developed so far were for simple characters comprising of consonants and vowels. But there is one

More information

Multiview Stereo COSC450. Lecture 8

Multiview Stereo COSC450. Lecture 8 Multiview Stereo COSC450 Lecture 8 Stereo Vision So Far Stereo and epipolar geometry Fundamental matrix captures geometry 8-point algorithm Essential matrix with calibrated cameras 5-point algorithm Intersect

More information

arxiv: v1 [cs.cv] 2 May 2016

arxiv: v1 [cs.cv] 2 May 2016 16-811 Math Fundamentals for Robotics Comparison of Optimization Methods in Optical Flow Estimation Final Report, Fall 2015 arxiv:1605.00572v1 [cs.cv] 2 May 2016 Contents Noranart Vesdapunt Master of Computer

More information

Using neural nets to recognize hand-written digits. Srikumar Ramalingam School of Computing University of Utah

Using neural nets to recognize hand-written digits. Srikumar Ramalingam School of Computing University of Utah Using neural nets to recognize hand-written digits Srikumar Ramalingam School of Computing University of Utah Reference Most of the slides are taken from the first chapter of the online book by Michael

More information

APPLICATION OF A MULTI- LAYER PERCEPTRON FOR MASS VALUATION OF REAL ESTATES

APPLICATION OF A MULTI- LAYER PERCEPTRON FOR MASS VALUATION OF REAL ESTATES FIG WORKING WEEK 2008 APPLICATION OF A MULTI- LAYER PERCEPTRON FOR MASS VALUATION OF REAL ESTATES Tomasz BUDZYŃSKI, PhD Artificial neural networks the highly sophisticated modelling technique, which allows

More information

Vision par ordinateur

Vision par ordinateur Epipolar geometry π Vision par ordinateur Underlying structure in set of matches for rigid scenes l T 1 l 2 C1 m1 l1 e1 M L2 L1 e2 Géométrie épipolaire Fundamental matrix (x rank 2 matrix) m2 C2 l2 Frédéric

More information

PERFORMANCE COMPARISON OF BACK PROPAGATION AND RADIAL BASIS FUNCTION WITH MOVING AVERAGE FILTERING AND WAVELET DENOISING ON FETAL ECG EXTRACTION

PERFORMANCE COMPARISON OF BACK PROPAGATION AND RADIAL BASIS FUNCTION WITH MOVING AVERAGE FILTERING AND WAVELET DENOISING ON FETAL ECG EXTRACTION I J C T A, 9(28) 2016, pp. 431-437 International Science Press PERFORMANCE COMPARISON OF BACK PROPAGATION AND RADIAL BASIS FUNCTION WITH MOVING AVERAGE FILTERING AND WAVELET DENOISING ON FETAL ECG EXTRACTION

More information

Coordinate Mapping Between an Acoustic and Visual Sensor Network in the Shape Domain for a Joint Self-Calibrating Speaker Tracking

Coordinate Mapping Between an Acoustic and Visual Sensor Network in the Shape Domain for a Joint Self-Calibrating Speaker Tracking Coordinate Mapping Between an Acoustic and Visual Sensor Network in the Shape Domain for a Joint Self-Calibrating Speaker Tracking Florian Jacob and Reinhold Haeb-Umbach Department of Communications Engineering

More information

Large Data Analysis via Interpolation of Functions: Interpolating Polynomials vs Artificial Neural Networks

Large Data Analysis via Interpolation of Functions: Interpolating Polynomials vs Artificial Neural Networks American Journal of Intelligent Systems 2018, 8(1): 6-11 DOI: 10.5923/j.ajis.20180801.02 Large Data Analysis via Interpolation of Functions: Interpolating Polynomials vs Artificial Neural Networks Rohit

More information

Transactions on Information and Communications Technologies vol 16, 1996 WIT Press, ISSN

Transactions on Information and Communications Technologies vol 16, 1996 WIT Press,  ISSN Comparative study of fuzzy logic and neural network methods in modeling of simulated steady-state data M. Järvensivu and V. Kanninen Laboratory of Process Control, Department of Chemical Engineering, Helsinki

More information

CS246: Mining Massive Datasets Jure Leskovec, Stanford University

CS246: Mining Massive Datasets Jure Leskovec, Stanford University CS6: Mining Massive Datasets Jure Leskovec, Stanford University http://cs6.stanford.edu Training data 00 million ratings, 80,000 users, 7,770 movies 6 years of data: 000 00 Test data Last few ratings of

More information

Ship Energy Systems Modelling: a Gray-Box approach

Ship Energy Systems Modelling: a Gray-Box approach MOSES Workshop: Modelling and Optimization of Ship Energy Systems Ship Energy Systems Modelling: a Gray-Box approach 25 October 2017 Dr Andrea Coraddu andrea.coraddu@strath.ac.uk 30/10/2017 Modelling &

More information

Visual object classification by sparse convolutional neural networks

Visual object classification by sparse convolutional neural networks Visual object classification by sparse convolutional neural networks Alexander Gepperth 1 1- Ruhr-Universität Bochum - Institute for Neural Dynamics Universitätsstraße 150, 44801 Bochum - Germany Abstract.

More information

Cursive Handwriting Recognition System Using Feature Extraction and Artificial Neural Network

Cursive Handwriting Recognition System Using Feature Extraction and Artificial Neural Network Cursive Handwriting Recognition System Using Feature Extraction and Artificial Neural Network Utkarsh Dwivedi 1, Pranjal Rajput 2, Manish Kumar Sharma 3 1UG Scholar, Dept. of CSE, GCET, Greater Noida,

More information

Histograms of Sparse Codes for Object Detection

Histograms of Sparse Codes for Object Detection Histograms of Sparse Codes for Object Detection Xiaofeng Ren (Amazon), Deva Ramanan (UC Irvine) Presented by Hossein Azizpour What does the paper do? (learning) a new representation local histograms of

More information

CS246: Mining Massive Datasets Jure Leskovec, Stanford University

CS246: Mining Massive Datasets Jure Leskovec, Stanford University CS6: Mining Massive Datasets Jure Leskovec, Stanford University http://cs6.stanford.edu /6/01 Jure Leskovec, Stanford C6: Mining Massive Datasets Training data 100 million ratings, 80,000 users, 17,770

More information

Workshop - Model Calibration and Uncertainty Analysis Using PEST

Workshop - Model Calibration and Uncertainty Analysis Using PEST About PEST PEST (Parameter ESTimation) is a general-purpose, model-independent, parameter estimation and model predictive uncertainty analysis package developed by Dr. John Doherty. PEST is the most advanced

More information

Bayesian Spherical Wavelet Shrinkage: Applications to Shape Analysis

Bayesian Spherical Wavelet Shrinkage: Applications to Shape Analysis Bayesian Spherical Wavelet Shrinkage: Applications to Shape Analysis Xavier Le Faucheur a, Brani Vidakovic b and Allen Tannenbaum a a School of Electrical and Computer Engineering, b Department of Biomedical

More information

Research of Fault Diagnosis in Flight Control System Based on Fuzzy Neural Network

Research of Fault Diagnosis in Flight Control System Based on Fuzzy Neural Network Available online at www.sciencedirect.com Procedia Engineering 5 (2 ) 7 74 Research of Fault Diagnosis in Flight Control System Based on Fuzzy Neural Network Peng Zhang a, Rui Zhang b, Xiao-xiao Ran b

More information

Deep Generative Models Variational Autoencoders

Deep Generative Models Variational Autoencoders Deep Generative Models Variational Autoencoders Sudeshna Sarkar 5 April 2017 Generative Nets Generative models that represent probability distributions over multiple variables in some way. Directed Generative

More information

House Price Estimation from Visual and Textual Features

House Price Estimation from Visual and Textual Features Eman H. Ahmed and Mohamed Moustafa Computer Science and Engineering Department, The American University in Cairo, Road 90, New Cairo, Cairo, Egypt Keywords: Abstract: Support Vector Regression, Neural

More information

Index. Umberto Michelucci 2018 U. Michelucci, Applied Deep Learning,

Index. Umberto Michelucci 2018 U. Michelucci, Applied Deep Learning, A Acquisition function, 298, 301 Adam optimizer, 175 178 Anaconda navigator conda command, 3 Create button, 5 download and install, 1 installing packages, 8 Jupyter Notebook, 11 13 left navigation pane,

More information

AN NOVEL NEURAL NETWORK TRAINING BASED ON HYBRID DE AND BP

AN NOVEL NEURAL NETWORK TRAINING BASED ON HYBRID DE AND BP AN NOVEL NEURAL NETWORK TRAINING BASED ON HYBRID DE AND BP Xiaohui Yuan ', Yanbin Yuan 2, Cheng Wang ^ / Huazhong University of Science & Technology, 430074 Wuhan, China 2 Wuhan University of Technology,

More information

IMAGE CLASSIFICATION USING COMPETITIVE NEURAL NETWORKS

IMAGE CLASSIFICATION USING COMPETITIVE NEURAL NETWORKS IMAGE CLASSIFICATION USING COMPETITIVE NEURAL NETWORKS V. Musoko, M. Kolı nova, A. Procha zka Institute of Chemical Technology, Department of Computing and Control Engineering Abstract The contribution

More information

Dynamic Analysis of Structures Using Neural Networks

Dynamic Analysis of Structures Using Neural Networks Dynamic Analysis of Structures Using Neural Networks Alireza Lavaei Academic member, Islamic Azad University, Boroujerd Branch, Iran Alireza Lohrasbi Academic member, Islamic Azad University, Boroujerd

More information

APPLICATIONS OF INTELLIGENT HYBRID SYSTEMS IN MATLAB

APPLICATIONS OF INTELLIGENT HYBRID SYSTEMS IN MATLAB APPLICATIONS OF INTELLIGENT HYBRID SYSTEMS IN MATLAB Z. Dideková, S. Kajan Institute of Control and Industrial Informatics, Faculty of Electrical Engineering and Information Technology, Slovak University

More information

Chapters 1 9: Overview

Chapters 1 9: Overview Chapters 1 9: Overview Chapter 1: Introduction Chapters 2 4: Data acquisition Chapters 5 9: Data manipulation Chapter 5: Vertical imagery Chapter 6: Image coordinate measurements and refinements Chapters

More information

Perceptron: This is convolution!

Perceptron: This is convolution! Perceptron: This is convolution! v v v Shared weights v Filter = local perceptron. Also called kernel. By pooling responses at different locations, we gain robustness to the exact spatial location of image

More information

Neural Nets for Adaptive Filter and Adaptive Pattern Recognition

Neural Nets for Adaptive Filter and Adaptive Pattern Recognition Adaptive Pattern btyoung@gmail.com CSCE 636 10 February 2010 Outline Adaptive Combiners and Filters Minimal Disturbance and the Algorithm Madaline Rule II () Published 1988 in IEEE Journals Bernard Widrow

More information

CS6220: DATA MINING TECHNIQUES

CS6220: DATA MINING TECHNIQUES CS6220: DATA MINING TECHNIQUES Image Data: Classification via Neural Networks Instructor: Yizhou Sun yzsun@ccs.neu.edu November 19, 2015 Methods to Learn Classification Clustering Frequent Pattern Mining

More information

Hotel Recommendation Based on Hybrid Model

Hotel Recommendation Based on Hybrid Model Hotel Recommendation Based on Hybrid Model Jing WANG, Jiajun SUN, Zhendong LIN Abstract: This project develops a hybrid model that combines content-based with collaborative filtering (CF) for hotel recommendation.

More information

Artificial Neural Network (ANN) Approach for Predicting Friction Coefficient of Roller Burnishing AL6061

Artificial Neural Network (ANN) Approach for Predicting Friction Coefficient of Roller Burnishing AL6061 International Journal of Machine Learning and Computing, Vol. 2, No. 6, December 2012 Artificial Neural Network (ANN) Approach for Predicting Friction Coefficient of Roller Burnishing AL6061 S. H. Tang,

More information

Robotics Programming Laboratory

Robotics Programming Laboratory Chair of Software Engineering Robotics Programming Laboratory Bertrand Meyer Jiwon Shin Lecture 8: Robot Perception Perception http://pascallin.ecs.soton.ac.uk/challenges/voc/databases.html#caltech car

More information

Neural Network Weight Selection Using Genetic Algorithms

Neural Network Weight Selection Using Genetic Algorithms Neural Network Weight Selection Using Genetic Algorithms David Montana presented by: Carl Fink, Hongyi Chen, Jack Cheng, Xinglong Li, Bruce Lin, Chongjie Zhang April 12, 2005 1 Neural Networks Neural networks

More information

More on Learning. Neural Nets Support Vectors Machines Unsupervised Learning (Clustering) K-Means Expectation-Maximization

More on Learning. Neural Nets Support Vectors Machines Unsupervised Learning (Clustering) K-Means Expectation-Maximization More on Learning Neural Nets Support Vectors Machines Unsupervised Learning (Clustering) K-Means Expectation-Maximization Neural Net Learning Motivated by studies of the brain. A network of artificial

More information

Image Transformation Techniques Dr. Rajeev Srivastava Dept. of Computer Engineering, ITBHU, Varanasi

Image Transformation Techniques Dr. Rajeev Srivastava Dept. of Computer Engineering, ITBHU, Varanasi Image Transformation Techniques Dr. Rajeev Srivastava Dept. of Computer Engineering, ITBHU, Varanasi 1. Introduction The choice of a particular transform in a given application depends on the amount of

More information

Locally Weighted Learning for Control. Alexander Skoglund Machine Learning Course AASS, June 2005

Locally Weighted Learning for Control. Alexander Skoglund Machine Learning Course AASS, June 2005 Locally Weighted Learning for Control Alexander Skoglund Machine Learning Course AASS, June 2005 Outline Locally Weighted Learning, Christopher G. Atkeson et. al. in Artificial Intelligence Review, 11:11-73,1997

More information

Unsupervised learning in Vision

Unsupervised learning in Vision Chapter 7 Unsupervised learning in Vision The fields of Computer Vision and Machine Learning complement each other in a very natural way: the aim of the former is to extract useful information from visual

More information

Camera calibration. Robotic vision. Ville Kyrki

Camera calibration. Robotic vision. Ville Kyrki Camera calibration Robotic vision 19.1.2017 Where are we? Images, imaging Image enhancement Feature extraction and matching Image-based tracking Camera models and calibration Pose estimation Motion analysis

More information

A Multi-Analyzer Machine Learning Model for Marine Heterogeneous Data Schema Mapping

A Multi-Analyzer Machine Learning Model for Marine Heterogeneous Data Schema Mapping A Multi-Analyzer Machine Learning Model for Marine Heterogeneous Data Schema Mapping Wang Yan 1, 2 Le Jiajin 3, Zhang Yun 2 1 Glorious Sun School of Business and Management Donghua University 2 College

More information

Parallel Stochastic Gradient Descent

Parallel Stochastic Gradient Descent University of Montreal August 11th, 2007 CIAR Summer School - Toronto Stochastic Gradient Descent Cost to optimize: E z [C(θ, z)] with θ the parameters and z a training point. Stochastic gradient: θ t+1

More information

Artificial Neural Network Methodology for Modelling and Forecasting Maize Crop Yield

Artificial Neural Network Methodology for Modelling and Forecasting Maize Crop Yield Agricultural Economics Research Review Vol. 21 January-June 2008 pp 5-10 Artificial Neural Network Methodology for Modelling and Forecasting Maize Crop Yield Rama Krishna Singh and Prajneshu * Biometrics

More information

Solar Radiation Data Modeling with a Novel Surface Fitting Approach

Solar Radiation Data Modeling with a Novel Surface Fitting Approach Solar Radiation Data Modeling with a Novel Surface Fitting Approach F. Onur Hocao glu, Ömer Nezih Gerek, Mehmet Kurban Anadolu University, Dept. of Electrical and Electronics Eng., Eskisehir, Turkey {fohocaoglu,ongerek,mkurban}

More information

Practice Exam Sample Solutions

Practice Exam Sample Solutions CS 675 Computer Vision Instructor: Marc Pomplun Practice Exam Sample Solutions Note that in the actual exam, no calculators, no books, and no notes allowed. Question 1: out of points Question 2: out of

More information

Algorithm Collections for Digital Signal Processing Applications Using Matlab

Algorithm Collections for Digital Signal Processing Applications Using Matlab Algorithm Collections for Digital Signal Processing Applications Using Matlab Algorithm Collections for Digital Signal Processing Applications Using Matlab E.S. Gopi National Institute of Technology, Tiruchi,

More information

Neural Networks Laboratory EE 329 A

Neural Networks Laboratory EE 329 A Neural Networks Laboratory EE 329 A Introduction: Artificial Neural Networks (ANN) are widely used to approximate complex systems that are difficult to model using conventional modeling techniques such

More information

Dimension reduction : PCA and Clustering

Dimension reduction : PCA and Clustering Dimension reduction : PCA and Clustering By Hanne Jarmer Slides by Christopher Workman Center for Biological Sequence Analysis DTU The DNA Array Analysis Pipeline Array design Probe design Question Experimental

More information

3D Point Cloud Processing

3D Point Cloud Processing 3D Point Cloud Processing The image depicts how our robot Irma3D sees itself in a mirror. The laser looking into itself creates distortions as well as changes in intensity that give the robot a single

More information

Proceedings of the 2016 International Conference on Industrial Engineering and Operations Management Detroit, Michigan, USA, September 23-25, 2016

Proceedings of the 2016 International Conference on Industrial Engineering and Operations Management Detroit, Michigan, USA, September 23-25, 2016 Neural Network Viscosity Models for Multi-Component Liquid Mixtures Adel Elneihoum, Hesham Alhumade, Ibrahim Alhajri, Walid El Garwi, Ali Elkamel Department of Chemical Engineering, University of Waterloo

More information

Robust Image Watermarking based on Discrete Wavelet Transform, Discrete Cosine Transform & Singular Value Decomposition

Robust Image Watermarking based on Discrete Wavelet Transform, Discrete Cosine Transform & Singular Value Decomposition Advance in Electronic and Electric Engineering. ISSN 2231-1297, Volume 3, Number 8 (2013), pp. 971-976 Research India Publications http://www.ripublication.com/aeee.htm Robust Image Watermarking based

More information

Slides adapted from Marshall Tappen and Bryan Russell. Algorithms in Nature. Non-negative matrix factorization

Slides adapted from Marshall Tappen and Bryan Russell. Algorithms in Nature. Non-negative matrix factorization Slides adapted from Marshall Tappen and Bryan Russell Algorithms in Nature Non-negative matrix factorization Dimensionality Reduction The curse of dimensionality: Too many features makes it difficult to

More information

Extreme Learning Machine: A New Learning Scheme of Feedforward Neural Networks

Extreme Learning Machine: A New Learning Scheme of Feedforward Neural Networks Extreme Learning Machine: A New Learning Scheme of Feedforward Neural Networks Guang-Bin Huang, Qin-Yu Zhu, and Chee-Kheong Siew School of Electrical and Electronic Engineering Nanyang Technological University

More information

P-spline ANOVA-type interaction models for spatio-temporal smoothing

P-spline ANOVA-type interaction models for spatio-temporal smoothing P-spline ANOVA-type interaction models for spatio-temporal smoothing Dae-Jin Lee and María Durbán Universidad Carlos III de Madrid Department of Statistics IWSM Utrecht 2008 D.-J. Lee and M. Durban (UC3M)

More information

Machine Learning / Jan 27, 2010

Machine Learning / Jan 27, 2010 Revisiting Logistic Regression & Naïve Bayes Aarti Singh Machine Learning 10-701/15-781 Jan 27, 2010 Generative and Discriminative Classifiers Training classifiers involves learning a mapping f: X -> Y,

More information

Recommendation System Using Yelp Data CS 229 Machine Learning Jia Le Xu, Yingran Xu

Recommendation System Using Yelp Data CS 229 Machine Learning Jia Le Xu, Yingran Xu Recommendation System Using Yelp Data CS 229 Machine Learning Jia Le Xu, Yingran Xu 1 Introduction Yelp Dataset Challenge provides a large number of user, business and review data which can be used for

More information

CHAPTER VI BACK PROPAGATION ALGORITHM

CHAPTER VI BACK PROPAGATION ALGORITHM 6.1 Introduction CHAPTER VI BACK PROPAGATION ALGORITHM In the previous chapter, we analysed that multiple layer perceptrons are effectively applied to handle tricky problems if trained with a vastly accepted

More information

Artificial Neural Network Based Byzantine Agreement Protocol

Artificial Neural Network Based Byzantine Agreement Protocol P Artificial Neural Network Based Byzantine Agreement Protocol K.W. Lee and H.T. Ewe 2 Faculty of Engineering & Technology 2 Faculty of Information Technology Multimedia University Multimedia University

More information