Selection and objective comparison of actuator models

Similar documents
Neural network multi-model based method of fault diagnostics of actuators

Neural Networks. CE-725: Statistical Pattern Recognition Sharif University of Technology Spring Soleymani

Ship Energy Systems Modelling: a Gray-Box approach

Identification of Multisensor Conversion Characteristic Using Neural Networks

Simulation of Back Propagation Neural Network for Iris Flower Classification

Liquefaction Analysis in 3D based on Neural Network Algorithm

Keras: Handwritten Digit Recognition using MNIST Dataset

MODELLING OF ARTIFICIAL NEURAL NETWORK CONTROLLER FOR ELECTRIC DRIVE WITH LINEAR TORQUE LOAD FUNCTION

Spatial Variation of Sea-Level Sea level reconstruction

APPLICATION OF A MULTI- LAYER PERCEPTRON FOR MASS VALUATION OF REAL ESTATES

ADVANCED OPERATOR PANEL (AOP)

Artificial Neural Network and Multi-Response Optimization in Reliability Measurement Approximation and Redundancy Allocation Problem

Neural Networks in Statistica

Neuro-Fuzzy Computing

Opening the Black Box Data Driven Visualizaion of Neural N

JOURNAL BEARING OPTIMIZATION FOR MINIMUM LUBRICANT VISCOSITY

PERFORMANCE OF GRID COMPUTING FOR DISTRIBUTED NEURAL NETWORK. Submitted By:Mohnish Malviya & Suny Shekher Pankaj [CSE,7 TH SEM]

Neural Network Approach for Automatic Landuse Classification of Satellite Images: One-Against-Rest and Multi-Class Classifiers

Implementation of Deep Convolutional Neural Net on a Digital Signal Processor

A Data Classification Algorithm of Internet of Things Based on Neural Network

Advances in Parallel Branch and Bound

Data Mining on Agriculture Data using Neural Networks

1. Approximation and Prediction Problems

Establishing Virtual Private Network Bandwidth Requirement at the University of Wisconsin Foundation

Clustering algorithms and autoencoders for anomaly detection

NNIGnets, Neural Networks Software

Fast Learning for Big Data Using Dynamic Function

4. Feedforward neural networks. 4.1 Feedforward neural network structure

A *69>H>N6 #DJGC6A DG C<>C::G>C<,8>:C8:H /DA 'D 2:6G, ()-"&"3 -"(' ( +-" " " % '.+ % ' -0(+$,

THREE PHASE FAULT DIAGNOSIS BASED ON RBF NEURAL NETWORK OPTIMIZED BY PSO ALGORITHM

The Application Research of Neural Network in Embedded Intelligent Detection

Neural Network Neurons

Neural Network Based Eye Tracking

Ensembles of Neural Networks for Forecasting of Time Series of Spacecraft Telemetry

NN-GVEIN: Neural Network-Based Modeling of Velocity Profile inside Graft-To-Vein Connection

What is machine learning?

International Journal of Electrical and Computer Engineering 4: Application of Neural Network in User Authentication for Smart Home System

OMBP: Optic Modified BackPropagation training algorithm for fast convergence of Feedforward Neural Network

Application of Artificial Neural Network for the Inversion of Electrical Resistivity Data

Exploiting Hidden Layer Modular Redundancy for Fault-Tolerance in Neural Network Accelerators

CS 4510/9010 Applied Machine Learning. Neural Nets. Paula Matuszek Fall copyright Paula Matuszek 2016

Surface roughness prediction during grinding: A Comparison of ANN and RBFNN models

ELECTRICAL, INSTRUMENTATION & CONTROL SYSTEMS

Introduction to Neural Networks: Structure and Training

DAME Web Application REsource Plugin Creator User Manual

Developing a Robot Model using System-Level Design

A faster model selection criterion for OP-ELM and OP-KNN: Hannan-Quinn criterion

Research of Fault Diagnosis in Flight Control System Based on Fuzzy Neural Network

Prediction of False Twist Textured Yarn Properties by Artificial Neural Network Methodology

LECTURE NOTES Professor Anita Wasilewska NEURAL NETWORKS

CHAPTER 8 COMPOUND CHARACTER RECOGNITION USING VARIOUS MODELS

Date 18/05/17. Operation and maintenance instructions for driver configurator QSet

Establishing a Power Quality Monitoring System On Board

Index. Umberto Michelucci 2018 U. Michelucci, Applied Deep Learning,

Central Manufacturing Technology Institute, Bangalore , India,

Reservoir Computing with Emphasis on Liquid State Machines

Artificial Neural Network-Based Prediction of Human Posture

Assignment # 5. Farrukh Jabeen Due Date: November 2, Neural Networks: Backpropation

A Dendrogram. Bioinformatics (Lec 17)

Package FCNN4R. March 9, 2016

Traffic Signs Recognition using HP and HOG Descriptors Combined to MLP and SVM Classifiers

Quantifying Data Needs for Deep Feed-forward Neural Network Application in Reservoir Property Predictions

Neural Networks (pp )

COMP 551 Applied Machine Learning Lecture 14: Neural Networks

Inverse Analysis of Soil Parameters Based on Deformation of a Bank Protection Structure

The Automation of the Feature Selection Process. Ronen Meiri & Jacob Zahavi

Keras: Handwritten Digit Recognition using MNIST Dataset

Notes on Multilayer, Feedforward Neural Networks

Introduction to ANSYS DesignXplorer

Acoustic to Articulatory Mapping using Memory Based Regression and Trajectory Smoothing

A systematic approach for estimation of reservoir rock properties using Ant Colony Optimization

Cross-validation for detecting and preventing overfitting

Artificial Neural Networks MLP, RBF & GMDH

Lecture 17: Neural Networks and Deep Learning. Instructor: Saravanan Thirumuruganathan

Operating instructions Manual Control Unit Type: MMI

Digital Signal Processing. Soma Biswas

In this assignment, we investigated the use of neural networks for supervised classification

3D Wafer Scale Integration: A Scaling Path to an Intelligent Machine

Predicting Web Service Levels During VM Live Migrations

SNIWD: Simultaneous Weight Noise Injection With Weight Decay for MLP Training

Research Article Forecasting SPEI and SPI Drought Indices Using the Integrated Artificial Neural Networks

PROGRAM EFFICIENCY & COMPLEXITY ANALYSIS

Lecture 16: High-dimensional regression, non-linear regression

Neural Network Architecture Selection Analysis With Application to Cryptography Location

CONTROLO E DECISÃO INTELIGENTE 08/09

DEEP NEURAL NETWORKS FOR OBJECT DETECTION

Machine Learning in Biology

A Probabilistic Graphical Model-based Approach for Minimizing Energy under Performance Constraints

A Publish-Subscribe Scheme Based Open Architecture for Crowd-Sourcing

I/O Systems (3): Clocks and Timers. CSE 2431: Introduction to Operating Systems

VT System Smart HIL Testing

Neural Network Assisted Tile Size Selection

Research on the New Image De-Noising Methodology Based on Neural Network and HMM-Hidden Markov Models

Pattern Recognition. Kjell Elenius. Speech, Music and Hearing KTH. March 29, 2007 Speech recognition

100% electricity. Automatic transfer switch controllers ATL series

Optimizing Number of Hidden Nodes for Artificial Neural Network using Competitive Learning Approach

An Algorithm For Training Multilayer Perceptron (MLP) For Image Reconstruction Using Neural Network Without Overfitting.

Tri Tr t i e t x e Expert Softwar Softwar O verview Overview

An Integer Recurrent Artificial Neural Network for Classifying Feature Vectors

Machine Learning Lecture 3

Transcription:

Selection and objective comparison of actuator models Ernő Kovács 1, Viktor Füvesi 2 1,2 University of Miskolc 1 Department of Electrical and Electronic Engineering 2 Research Institute of Applied Earth Sciences, Department of Research Instrumentation and Informatics 1 HU-3515 Miskolc-Egyetemváros 2 HU-3515 Miskolc-Egyetemváros, POB. 2 1 elkke@uni-miskolc.hu; 2 fuvesi@afki.hu International Scientific Conference 21-22 march 2013

Outlines Brief introduction of starter motor Measurement arrangement Hardware, software ANN modeling of starter motor Structure of ANN Training process Model selection Lookup table model Structure Model selection Comparison of models 2/24

Measurement arrangement 1 - starter motor 2 clutch 3 powder brake 1 2 4 controller of the brake Shaft torque Velocity 3 4 Current Battery voltage Control the break Measure different parameters 500 Hz sample frequency 3/24

Measurements Constant load with different value Different characteristic of load 4/24 Parameters unit lower range upper range Armature current (I) A 0 300 Voltage of the battery (U) V 9.5 13 Velocity of the motor (ω) rpm 0 5000 Shaft torque (T shaft ) % 0 100

Transformation Transformation Developed observers Current Battery voltage Estimation of velocity Black Box model Current Battery voltage Estimation of torque of shaft 5/24

Developed models NN based model Lookup table based model 6/24

Datasets Measurement data were formatted Filtered with low-pass filter Scaled and normalised to 0,1-0,9 interval Different datasets were developed for training and validating Type Size of epoch Training dataset 55500 Validation dataset 7300 7/24

Virtual inputs (m) Virtual inputs (m) Applied NN structure and dynamics Feedforward neural network was used One hidden layer Perceptron neuron structure Elliott transfer function In hidden and output layer Bias neurons u(t) Z -1 u(t-d) MISO Multi Input Single Output System FIR external dynamics was applied Input layer Hidden Layer Output Layer ~ y ( t 1) v(t) Z -1 v(t-d) Z -1 u(t-md) Z -1 v(t-md) ~ y( t 1) f ut, ut d,..., ut md, v( t), v( t d),..., v( t md) m 1,...,4 d 10,..., 220 (1) 8/24

Number of virt. inputs (m+1) 2,, 5 Training process Setting up the number of inputs (Changing from 1 to 5 by 1 during the simulation series) Setting the training and validating datasets (Changing the size of delay between virt. inputs) Setting up the number of hidden neurons (Size: Double of the iactual nputs ) Training the configured neural network Initialization: Nguyen-Widrow method Training algoritm: Rprop BP algorithm Activation function: Elliott function Maximal iteration number: 4000 epochs Performance critirea: MSE, AIC, BIC, FPE for validating sets N 10, 20, 30,, 220 Y End of building ANN Delay between virt. inputs (d) 9/24

Number of virt. inputs (m+1) 2,, 5 Training process Results 88 velocity observer model 88 torque observer model 10, 20, 30,, 220 Delay between virt. inputs (d) 10/24

MSE AIC Compare models MSE 1 n n y ~ y i1 2 (2) Delay between virt. inputs (d) Delay between virt. inputs (d) AIC MSE w b nlog 2 (3) 11/24

BIC FPE Compare models BIC nlog MSE w blogn (4) Delay between virt. inputs (d) Delay between virt. inputs (d) FPE nlog n w b n w b MSE nlog (5) 12/24

Best NN models Model Number of virtual inputs Number of delays between regressors Velicity observer MSE for validation dataset PCC for validation dataset Torque observer MSE for validation dataset PCC for validation dataset NN1 5 50 26598.72 0.992 0.071 0.961 NN2 5 60 32055.84 0.990 0.055 0.967 NN3 4 80 15769.38 0.995 0.059 0.965 NN4 5 110 37488.74 0.988 0.032 0.981 Pearson s correlation coefficient: PCC n i1 n i1 y y~ y ~ y n 2 y y ~ y ~ y i i i i1 i 2 (6) 13/24

Developed models NN based model Lookup table based model 14/24

Lookup table based models Measurement data were formatted Filtered with low-pass filter Different datasets were used to developed the reference database (lookup table) and different for validation ~ z( t) ( d1z4 d2z3 d3z2 d4z1)/( d1 d2 d3 d 4 ) (6) d i 2 ( x x) ( y y) i i 2 (7) 15/24

Number of used reference points 2,, 5 Current Find the best model Voltage Using brute force algorithm Changed the size of lookup table Changed the number of used reference points to calculate the actual estimation value 50, 150, 200,, 1750 Number of reference points on one side of the database 16/24

Normalised Totalised MSE for validation datasets Influence of grid density Close to regressive exponential function can be found between the Totalizes MSE and the number of divisions The number of used reference points has not so significant influence to the result Number of divisions in one side of the lookup table 17/24

Computation time [s] Influence of grid density Computation time is close to exponential in the function of grid density 400 Comp. time vs grid density of database 350 300 250 200 150 100 50 0 50 100 150 200 250 300 350 400 450 500 550 Number of divisions in one side of the lookup table CPU: Core2Duo E8400 3GHz Memory: 4GB OS: Fedora 16 C compiler: GCC 18/24

Best lookup based models Model Number of divisions Number of used reference points Velicity observer MSE for validation dataset PCC for validation dataset Torque observer MSE for validation dataset PCC for validation dataset LU1 1750 2 224439,95 0,929 0,298 0,815 LU2 1550 3 256034,58 0,919 0,341 0,790 LU3 1550 4 268877,10 0,915 0,367 0,776 LU4 1250 5 283690,91 0,911 0,40 0,760 19/24

Comparison of models NN1 NN2 Velocity S. Torque Velocity S. Torque MSE 26598,72 0,071 32055,84 0,055 PCC 0,992 0,961 0,990 0,967 LU1 LU2 Velocity S. Torque Velocity S. Torque MSE 224439,95 0,298 256034,58 0,341 PCC 0,929 0,815 0,919 0,790 NN3 NN4 Velocity S. Torque Velocity S. Torque MSE 15769,38 0,059 37488,74 0,032 PCC 0,995 0,965 0,988 0,981 LU3 LU4 Velocity S. Torque Velocity S. Torque MSE 268877,10 0,367 283690,91 0,40 PCC 0,915 0,776 0,911 0,760 20/24

Usage of the models Model-based fault detection tasks Detect different additive faults in analysed system Model-based fault diagnostic tasks More than detection Establish some parameter the fault Separation of the different faults 21/24

Summary Using measurements 4 black box models were developed Programs were developed in C++ Data pre-processing, filtering Simulations NN trainning Data post-processing Compare different models using MSE, PCC 22/24

Acknowledgement The described work was carried out as part of the TÁMOP 4.2.1.B-10/2/KONV-0001-2010 project in the framework of the Hungarian Development Plan. The realization of this project is supported by the European Union, co-financed by the European Social Found. 23/24

Thank you for your kind attention! 24/24