Network traffic anomaly prediction using Artificial Neural Network

Size: px
Start display at page:

Download "Network traffic anomaly prediction using Artificial Neural Network"

Transcription

1 Network traffic anomaly prediction using Artificial Neural Network Hening Titi Ciptaningtyas, Chastine Fatichah, and Altea Sabila Citation: AIP Conference Proceedings 1818, (2017); View online: View Table of Contents: Published by the American Institute of Physics Articles you may be interested in Evaluation of bolted connections in wood-plastic composites AIP Conference Proceedings 1818, (2017); / Technical skills requirement of Indonesian construction labors to work in Malaysia AIP Conference Proceedings 1818, (2017); / Factors on green service industry: Case study at AirAsia AIP Conference Proceedings 1818, (2017); / A study on the static and impact structural behavior of concrete filled steel tubular members under Tsunami flotsam collision AIP Conference Proceedings 1818, (2017); / An application of traveling salesman problem using the improved genetic algorithm on android google maps AIP Conference Proceedings 1818, (2017); / Competence assessment for vocational school students based on business and industry chamber to improve graduate entrepreneurship AIP Conference Proceedings 1818, (2017); /

2 Network Traffic Anomaly Prediction Using Artificial Neural Network Hening Titi Ciptaningtyas 1, a) Chastine Fatichah 2, Altea Sabila 3 1,2,3 Department of Informatics, Faculty of Information Technology, Institut Teknologi Sepuluh Nopember, Surabaya, Indonesia a) Corresponding author: henning.its@gmail.com Abstract.As the excessive increase of internet usage, the malicious software (malware) has also increase significantly. Malware is software developed by hacker for illegal purpose(s), such as stealing data and identity, causing computer damage, or denying service to other user[1]. Malware which attack computer or server often triggers network traffic anomaly phenomena. Based on Sophos s report[2], Indonesia is the riskiest country of malware attack and it also has high network traffic anomaly. This research uses Artificial Neural Network (ANN) to predict network traffic anomaly based on malware attack in Indonesia which is recorded by Id-SIRTII/CC (Indonesia Security Incident Response Team on Internet Infrastructure/Coordination Center). The case study is the highest malware attack (SQL injection) which has happened in three consecutive years: 2012, 2013, and 2014[4]. The data series is preprocessed first, then the network traffic anomaly is predicted using Artificial Neural Network and using two weight update algorithms: and. Error of prediction is calculated using (MSE) [7]. The experimental result shows that MSE for SQL Injection is 856. So, this approach can be used to predict network traffic anomaly. INTRODUCTION As the excessive increase of internet usage, the malicious software (malware) has also increase significantly. Malware is software developed by hacker for illegal purpose(s), such as stealing data and identity, causing computer damage, or denying service to other user [1]. Malware attacking computer or server often triggers network traffic anomaly phenomena [2]. Based on Sophos s report, Indonesia is the riskiest country of malware attack and it also has high network traffic anomaly. Indonesia has 23.54% Threat Exposure Rate (TER), which means 23.54% of computer in Indonesia has been infected by Malware [3]. Security on the computer network system can be interpreted as an attempt to make the protection of data and resources from unauthorized access, vandalism and malfunction. The computer network is a valuable asset that must be protected, both physical and non-physical [4]. The traffic network anomaly data focused on SQL Injection attack which obtained from ID-SIRTII / CC (Indonesia Security Incident Response Team on Internet Infrastructure/Coordination Center) research data in three consecutive year: 2012, 2013 and 2014 [5]. It forms time series data which organized by time, has random value and statistically interconnected [6]. This research tries to forecast the amount of network traffic anomaly data in the future. Forecasting is a process to predict events or changes in the future. Time series model is often associated with the process of forecasting a value of particular characteristics in the next period, controlling a process or to identify patterns of behavior of the system. There are various ways in predicting the time series data, such as Backpropagation, Hybrid, Artificial Neural Networks, Fuzzy and Genetic algorithm. In this study, we use Artificial Neural Network (ANN). ANN has been widely implemented in various scientific fields to make predictions or forecasting since 1940 and has become an interesting object of research [7]. ANN is a mathematical model of the structure and function inspired by the organization and function of the human brain. ANN can handle nonlinear data, more tolerance to noise ratio of the system, and tend to produce lower prediction error. ANN with the type of Feed-Forward Network Engineering International Conference (EIC) 2016 AIP Conf. Proc. 1818, ; doi: / Published by AIP Publishing /$

3 or Backpropagation has proven to give good results for prediction [8]. While other research is detecting network traffic anomaly, this research is forecasting network traffic anomaly based on previous time series data. This research objective is to forecast the amount of network traffic anomaly data in the future. If the attack can be predicted, then network traffic anomalies can be avoided. METHODOLOGY This research tries to predict the amount of network traffic anomaly data which is caused by SQL Injection. Data is processed using Artificial Neural Network (ANN), the output is data prediction and (MSE) of the data testing. In this study, there are two training which updates the weights using and. Network Traffic Anomaly Network traffic anomaly is aberration of computer system or computer network which is caused by security incident. It also caused by violation and threat to computer security policy, legal use policy and security standard practices [9]. SQL injection is a technique that exploits a security vulnerability occurring in the database layer of an application and CGI layer [10] [11]. Data Time Series Time series data is a type of observational data that consists of one object but includes some period of time, for example daily, weekly, monthly, yearly in which the observational data were random and statistically interconnected. Time series analysis is used to perform data analysis such as predicting future events since it is believed that a pattern in the past will happen again in the future [6]. Pre-processing Data pre-processing stage try to prepare the data before it is processed further by a method [12]. In this study there are two kind of pre-processing: 1. Data Imputation process Missing value or an empty value is information that is not available to a subject or case. It is occurred because the information about the object is not given, difficult to find or does not exist. 2. Data Normalization Data normalization tries to unify the data interval. Uniformity of data affects the calculation of the matrices in the data. Artificial Neural Network (ANN) Artificial Neural Network (ANN) is a model based on the human brain. ANN consists of a number of very simple and interconnected processors called neurons [13]. Neurons are connected by weighting pass signals from one neuron to other [14] as in Fig.1. ANN model has equation formula (1) where n j is the j neuron from output layer of neural network, n i is the i neuron from input layer of neural network, w ij is the weight between i neuron from input layer and j neuron from output layer (weight score between 1 dan +1), b j is the j bias (Bias score is -1 or +1), and w j is the j bias weight. (1) Error Calculation This calculation is to measure the accuracy of prediction. There are three types of error calculations: Mean Squared Error (MSE), Mean Absolute Error (MAE) and Mean Absolute Percentage Error (MAPE) [15]. This

4 research use MSE since it gives good illustration of model consistency. MSE has equation (2) where is neuron output of neural network method, is target value and is neuron output number. (2) Output Y Output Layer Weight w2 Hidden Layer Weight w1 Input Layer Input X The flow diagram of the process is shown in Fig. 2. Start FIGURE 1. Multilayer Network Architecture DESIGN AND IMPLEMENTATION Input Data (IdSIRTII data) Testing Preprocessing MSE Training Output Data Finish FIGURE 2.Flow Process Input Data The input data is data to be processed by the system to obtain a predetermined output system. In this application, the dataset is the ID-SIRTII/CC research data on network traffic anomaly in three consecutive years: 2012, 2013 and

5 2014. The data training is 2012 and 2013 data, while the data testing is 2014 data. Each training and testing input data has five features (data for five days) and data target is the next data (sixth day). Any blank data will be filled in pre-processing stage by filling missing value and normalizing data. Data imputation is done manually and normalization is done using MATLAB 2015a. Pre-processing There are 2 steps for pre-processing data: Data Imputation and Data Normalization. Data Imputation There are several ways in data imputation process if there is empty or missing value in the data. In this research, we used four types data imputation process to fill out a missing value on a dataset: First, using cumulative average of the four previous data where missing value in the middle of the data is filled with the average of four data above. The upper limit and lower limit of data testing is removed since it is not available. Second, using cumulative average of the four previous data where missing value in the middle of the data and lower limit of the data testing is filled with the average of four nominal above. The upper limit of data testing removed since it is not available Third, using cumulative average of the four previous data where missing value in the middle of the data and lower limit of the data testing is filled with the average of four nominal above. The upper limit of data testing is filled with the top nominal of the dataset. Fourth, using cumulative average of the four previous data where missing value in the middle of the data and lower limit of the data testing is filled with the average of four nominal above. The upper limit of data testing is filled with the average of the whole dataset. Data Normalization There are few methods for data normalization. In this research, we used Min-Max normalization method. In the Min-Max normalization, if MinA and maxa are the value of minimum and maximum value of the attributes A, Min- Max normalization maps a value v of A to v' in the range [new_mina, new_maxa] with equation (3) where v is Dataset, v is Min-Max normalization result, mina is minimum score of A and maxa is maximum score of A. (3) Artificial Neural Network (ANN) Artificial Neural Network (ANN) model is adaptable model and often used to compare each prediction possibility. These are important things to consider in designing ANN model to predict the amount of network traffic anomaly data: 1. The number of input neurons: This number is determined based on the database. In this research, number of neurons is 5 based on the feature number. 2. The number of hidden layer: The number of hidden layer neuron depends on the number of inputs and property data. In general and in this research, the number of hidden layer used is one only. 3. The number of hidden neurons: A commonly used technique in determining the number of hidden neurons is calculated experimentally. In this research, the number of hidden neurons tested based on the determined scenario. So, the number of hidden neurons can be changed dynamically. 4. The number of output neurons: Generally, ANN application and research for predictions use one neuron output. 5. Activation Function: Activation functions are used to determine the output of processed neurons. Mechanical activation function used in this study is sigmoid activation function

6 Training Training on Artificial Neural Network (ANN) includes an iterative process of the input data so the appropriate network and can be used for prediction. The purpose of training is to minimize the error, which indicates that the ANN model is in conformity with the input. In backpropagation there are two major ways of learning rate and update the weights. Learning rate determines how fast the neural networks learn patterns from the training data. This value must be chosen correctly, if it is too small then the learning process will be long and if it is too large, there will be deviations. While the updated weight shows that the weights of the previous iteration affect current weight. In this research, updating the weights is using and momentum. They will be tested on some predefined scenarios. The back propagation algorithm for training[16] is as follows: 1. Start with a set of training data input and output targets. 2. Initialize all network weights with a few small figures random value. 3. For each set of data input, entry the input to the neural network and calculate the output. 4. Compare the results of the network output to the target output and calculate the error. 5. Change the network weight to lower the error, and repeat the process. Those steps can be executed in two ways. First, calculate the error, change the weights for each input and output data target, and move to the next data set. Second, calculate the cumulative error of all input and output data target, then replace the weights and repeat the process. Steps 1 to 3 at the back propagation algorithm is a straightforward step, therefore, steps 4 and 5 will be discussed further in the following paragraph. There are two kinds of training, backpropagation with and. The formula of propagation by is as equation (4) and equation (5) where is the updated hidden weight, is the old hidden weight that is not optimal, is the updated output weight, is the old output weight that is not optimal, is the hidden prediction score, is the output prediction score, is the learning rate (0.25 or 0.5), i s the score from hidden j, and is the score from neuron i. (4) (5) To change the weight is by adding the old weights with. However, the weight of the previous iteration gives major influence on the performance of the neural network. So, it is added to the old weight multiplied by as equation (6) and equation (7) where is the updated hidden weight, is the current hidden weight, is the previous hidden weight, is the updated output weight, is the current output weight, is the previous output weight, is the hidden prediction score, is the output prediction score, is the learning rate (0.25 or 0.5), is the score from hidden j, is the score from neuron I, is the factor (0.5). (6) (7) Testing Artificial Neural Network (ANN) testing aim is to get the predicted results with the parameters obtained from the most optimal training process. Here is the algorithm for testing which have stages like training but without updating the weights [17] 1. Begin testing with a set of input data and output targets. 2. Initialize all network weights with final weights value of the training process which is the most optimum weight. 3. With each set of data input, entry the input data to the neural network and calculate the output

7 4. Compare the results of the network output to the target output and calculate the error. Error Calculation The result of calculation error is not only to determine whether the output is right or wrong, but also to determine the degree of truth or falsity. In this research, we used MSE. RESULTS AND DISCUSSION This experiment tries to obtain the lowest error value. ANN parameter in this experiment can be seen in Table 1. Several scenarios trials that will be conducted as follows: 1. Comparing the results of the MSE data network traffic anomaly prediction in one year. 2. Comparing the results of the MSE data network traffic anomaly prediction in three months. 3. Comparing the results of the MSE data network traffic anomaly prediction in one month. TABLE 1.Artificial Neural NetworkParameter Parameter Description Input layer Network traffic anomalies (5 Features): SQL Injection Hidden Neuron 2 4 neuron Learning rate Activation Function Sigmoid Error (MSE) Output layer Prediction of network traffic anomalies 0.5 Scenario 1 Scenario 1 is comparing the results of the MSE data network traffic anomaly prediction in one year. Parameter in Scenario 1 is described intable 1. The difference between scenario 1.1, 1.2, 1.3, and 1.4 is the data imputation process. Scenario 1.1 using the first data imputation, scenario 1.2 using second data imputation, and so on. The MSE result of Scenario 1.1 can be seen in Fig. 3, Scenario 1.2 can be seen in Fig. 4, Scenario 1.3 can be seen in Fig. 5, and Scenario 1.4 can be seen in Fig.6. The comparison of real data, prediction error value using, and is shown in Fig. 7. The best value of each scenario can be seen in Table 2. TABLE 2. Scenario 1 Experimental Result Missing Value Hidden Neuron Scenario Scenario Scenario Scenario

8 (a) (b) (c) FIGURE 3. Experimental Result Scenario 1.1 (a) Hidden Neuron 2; (b) Hidden Neuron 3; (c) Hidden Neuron

9 (a) (b) 0.07 (c) FIGURE 4. Experimental Result Scenario 1.2 (a) Hidden Neuron 2; (b) Hidden Neuron 3; (c) Hidden Neuron

10 (a) (b) (c) FIGURE 5.Experimental Result Scenario 1.3 (a) Hidden Neuron 2; (b) Hidden Neuron 3; (c) Hidden Neuron

11 (a) (b) (c) FIGURE 6. Experimental Result Scenario 1.4 (a) Hidden Neuron 2; (b) Hidden Neuron 3; (c) Hidden Neuron

12 FIGURE 7. First Scenario: Comparison of Real Data, and Scenario 2 Scenario 2 is comparing the results of the MSE data network traffic anomaly prediction in three months. Parameter in Scenario 2 is described in Table 1. The comparison of real data, prediction error value using, and is shown in Fig. 8. The MSE result of Scenario 2 can be seen in Fig. 9. The best value for Scenario 2 is using 0.1, Hidden Neuron 2, Gradien Descent and FIGURE 8. Second Scenario: Comparison of Real Data, and

13 (a) (b) (c) FIGURE 9. Experimental Result Scenario 2 (a) Hidden Neuron 2; (b) Hidden Neuron 3; (c) Hidden Neuron

14 Scenario 3 Scenario 3 is comparing the results of the MSE data network traffic anomaly prediction in three months. Parameter in Scenario 3 is described in Table 1. The comparison of real data, prediction error value using Gradient Descent, and is shown in Fig. 10. The MSE result of Scenario 3 can be seen in Fig.11. The best value for Scenario 3 is using 0.1, Hidden Neuron 2, Gradien Descent and FIGURE 10. Second Scenario: Comparison of Real Data, and

15 (a) (b) (c) (d) FIGURE 11. Experimental Result Scenario 3 (a) Hidden Neuron 2; (b) Hidden Neuron 3; (c) Hidden Neuron 4 CONCLUSION From the experimental result, it can be concluded as follows: The most optimal way to fill a missing parameter value is by using cumulative average of the four previous data where missing value in the middle of the data, the lower limit of the data testing is filled with the average of four nominal above, and the upper limit of data testing is filled with the average of the whole dataset. The lowest MSE result is Scenario 1 where the prediction is made for a year. Artificial Neural Networks (ANN) method can yield good predictions for traffic network anomaly (SQL Injection attack) by using learning rate 0.1 and hidden neurons 2. The lowest MSE for update weights is 893 and for update weights is

16 ACKNOWLEDGMENTS We would like to thank the Ministry of Research and Higher Education (Kemenristekdikti) for financial support during this study. This research was financed according to Research Implementation Letter of Agreement No / IT2.11 / PN.08 / REFERENCES 1. M. Masud, L. Khan and B. Thuraisingham, Data Mining Tools for Malware Detection, Boca Raton: CRC Press, M. Jakobsson and Z. Ramzan, Crimeware : Understanding New Attacks and Defenses, California: symantec. press, Sophos, "Security Threat Report 2013," Sophos, J. P. Anderson, Computer Security Threat Monitoring and Surveillance, Washington: James P. Anderson Co., Id-SIRTII/CC, "Id-SIRTII/CC," [Online]. Available: [Accessed 01 Desember 2015]. 6. J. D. Cryer, Time Series Analysis, Wadsworth Publ. Co,, J. Williams and Y. Li, "A Case Using Neural Network Algorithms: Horse Racing Predictions in Jamaica," in International Conf. on Artificial Intelligence (ICAI'08), Las Vegas, A. Lapedes and R. Farber, "How Neural Nets Work," in Evolution, Learning and Cognition, World Scientific, 1989, pp CSIRT, Panduan Penanganan Insiden Keamanan Jaringan, BPPT CSIRT, J. Clarke, "Testing for SQL Injection," in SQL Injection Attacks and Defense, Boston, Elsevier Inc., 2009, pp W. G. Halfond and A. Orso, AMNESIA: Analysis and Monitoring for Nuutralizing SQL-Injection, S. K. Patro and K. K. sahu, Normalization: A Preprocessing Stage, India: Department of CSE & IT, VSSUT, Burla, Odisha, India. 13. E. R. Jones, An Introduction to Neural Networks, San Ramon: Visual Numerics, O. Coupelon, Neural Network Modeling for Stock Market Prediction " State of the Art". 15. A. Saikhu, ""Time Series Forcasting"," Teknik Informatika, Fakultas Teknologi Informasi. Institute Teknologi Sepuluh November. 16. A. T. W. Utami and B. S. S. Ulama, JURNAL SAINS DAN SENI ITS, 4 (2) (2015). 17. D. M. Bourg and G. Seeman, "AI for Game Developer", O'Reilly Media,

LECTURE NOTES Professor Anita Wasilewska NEURAL NETWORKS

LECTURE NOTES Professor Anita Wasilewska NEURAL NETWORKS LECTURE NOTES Professor Anita Wasilewska NEURAL NETWORKS Neural Networks Classifier Introduction INPUT: classification data, i.e. it contains an classification (class) attribute. WE also say that the class

More information

Review on Methods of Selecting Number of Hidden Nodes in Artificial Neural Network

Review on Methods of Selecting Number of Hidden Nodes in Artificial Neural Network Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology IJCSMC, Vol. 3, Issue. 11, November 2014,

More information

Fast Learning for Big Data Using Dynamic Function

Fast Learning for Big Data Using Dynamic Function IOP Conference Series: Materials Science and Engineering PAPER OPEN ACCESS Fast Learning for Big Data Using Dynamic Function To cite this article: T Alwajeeh et al 2017 IOP Conf. Ser.: Mater. Sci. Eng.

More information

Optimizing Number of Hidden Nodes for Artificial Neural Network using Competitive Learning Approach

Optimizing Number of Hidden Nodes for Artificial Neural Network using Competitive Learning Approach Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology IJCSMC, Vol. 4, Issue. 5, May 2015, pg.358

More information

International Journal of Advanced Research in Computer Science and Software Engineering

International Journal of Advanced Research in Computer Science and Software Engineering Volume 3, Issue 4, April 203 ISSN: 77 2X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Stock Market Prediction

More information

INTELLIGENT SEISMIC STRUCTURAL HEALTH MONITORING SYSTEM FOR THE SECOND PENANG BRIDGE OF MALAYSIA

INTELLIGENT SEISMIC STRUCTURAL HEALTH MONITORING SYSTEM FOR THE SECOND PENANG BRIDGE OF MALAYSIA INTELLIGENT SEISMIC STRUCTURAL HEALTH MONITORING SYSTEM FOR THE SECOND PENANG BRIDGE OF MALAYSIA Reni Suryanita Faculty of Engineering Civil Engineering Department University of Riau, Pekanbaru reni.suryanita@lecturer.unri.ac.id

More information

Research Article Forecasting SPEI and SPI Drought Indices Using the Integrated Artificial Neural Networks

Research Article Forecasting SPEI and SPI Drought Indices Using the Integrated Artificial Neural Networks Computational Intelligence and Neuroscience Volume 2016, Article ID 3868519, 17 pages http://dx.doi.org/10.1155/2016/3868519 Research Article Forecasting SPEI and SPI Drought Indices Using the Integrated

More information

Assignment # 5. Farrukh Jabeen Due Date: November 2, Neural Networks: Backpropation

Assignment # 5. Farrukh Jabeen Due Date: November 2, Neural Networks: Backpropation Farrukh Jabeen Due Date: November 2, 2009. Neural Networks: Backpropation Assignment # 5 The "Backpropagation" method is one of the most popular methods of "learning" by a neural network. Read the class

More information

A Data Classification Algorithm of Internet of Things Based on Neural Network

A Data Classification Algorithm of Internet of Things Based on Neural Network A Data Classification Algorithm of Internet of Things Based on Neural Network https://doi.org/10.3991/ijoe.v13i09.7587 Zhenjun Li Hunan Radio and TV University, Hunan, China 278060389@qq.com Abstract To

More information

International Research Journal of Computer Science (IRJCS) ISSN: Issue 09, Volume 4 (September 2017)

International Research Journal of Computer Science (IRJCS) ISSN: Issue 09, Volume 4 (September 2017) APPLICATION OF LRN AND BPNN USING TEMPORAL BACKPROPAGATION LEARNING FOR PREDICTION OF DISPLACEMENT Talvinder Singh, Munish Kumar C-DAC, Noida, India talvinder.grewaal@gmail.com,munishkumar@cdac.in Manuscript

More information

CS6220: DATA MINING TECHNIQUES

CS6220: DATA MINING TECHNIQUES CS6220: DATA MINING TECHNIQUES Image Data: Classification via Neural Networks Instructor: Yizhou Sun yzsun@ccs.neu.edu November 19, 2015 Methods to Learn Classification Clustering Frequent Pattern Mining

More information

Comparison of variable learning rate and Levenberg-Marquardt back-propagation training algorithms for detecting attacks in Intrusion Detection Systems

Comparison of variable learning rate and Levenberg-Marquardt back-propagation training algorithms for detecting attacks in Intrusion Detection Systems Comparison of variable learning rate and Levenberg-Marquardt back-propagation training algorithms for detecting attacks in Intrusion Detection Systems Tummala Pradeep 1 IV th Year Student, Department of

More information

Image Compression: An Artificial Neural Network Approach

Image Compression: An Artificial Neural Network Approach Image Compression: An Artificial Neural Network Approach Anjana B 1, Mrs Shreeja R 2 1 Department of Computer Science and Engineering, Calicut University, Kuttippuram 2 Department of Computer Science and

More information

Perceptrons and Backpropagation. Fabio Zachert Cognitive Modelling WiSe 2014/15

Perceptrons and Backpropagation. Fabio Zachert Cognitive Modelling WiSe 2014/15 Perceptrons and Backpropagation Fabio Zachert Cognitive Modelling WiSe 2014/15 Content History Mathematical View of Perceptrons Network Structures Gradient Descent Backpropagation (Single-Layer-, Multilayer-Networks)

More information

Simulation of Back Propagation Neural Network for Iris Flower Classification

Simulation of Back Propagation Neural Network for Iris Flower Classification American Journal of Engineering Research (AJER) e-issn: 2320-0847 p-issn : 2320-0936 Volume-6, Issue-1, pp-200-205 www.ajer.org Research Paper Open Access Simulation of Back Propagation Neural Network

More information

Notes on Multilayer, Feedforward Neural Networks

Notes on Multilayer, Feedforward Neural Networks Notes on Multilayer, Feedforward Neural Networks CS425/528: Machine Learning Fall 2012 Prepared by: Lynne E. Parker [Material in these notes was gleaned from various sources, including E. Alpaydin s book

More information

Improved Information Retrieval Performance on SQL Database Using Data Adapter

Improved Information Retrieval Performance on SQL Database Using Data Adapter IOP Conference Series: Materials Science and Engineering PAPER OPEN ACCESS Improved Information Retrieval Performance on SQL Database Using Data Adapter To cite this article: M Husni et al 2018 IOP Conf.

More information

Classification Lecture Notes cse352. Neural Networks. Professor Anita Wasilewska

Classification Lecture Notes cse352. Neural Networks. Professor Anita Wasilewska Classification Lecture Notes cse352 Neural Networks Professor Anita Wasilewska Neural Networks Classification Introduction INPUT: classification data, i.e. it contains an classification (class) attribute

More information

Climate Precipitation Prediction by Neural Network

Climate Precipitation Prediction by Neural Network Journal of Mathematics and System Science 5 (205) 207-23 doi: 0.7265/259-529/205.05.005 D DAVID PUBLISHING Juliana Aparecida Anochi, Haroldo Fraga de Campos Velho 2. Applied Computing Graduate Program,

More information

Traffic Signs Recognition using HP and HOG Descriptors Combined to MLP and SVM Classifiers

Traffic Signs Recognition using HP and HOG Descriptors Combined to MLP and SVM Classifiers Traffic Signs Recognition using HP and HOG Descriptors Combined to MLP and SVM Classifiers A. Salhi, B. Minaoui, M. Fakir, H. Chakib, H. Grimech Faculty of science and Technology Sultan Moulay Slimane

More information

APPLICATIONS OF INTELLIGENT HYBRID SYSTEMS IN MATLAB

APPLICATIONS OF INTELLIGENT HYBRID SYSTEMS IN MATLAB APPLICATIONS OF INTELLIGENT HYBRID SYSTEMS IN MATLAB Z. Dideková, S. Kajan Institute of Control and Industrial Informatics, Faculty of Electrical Engineering and Information Technology, Slovak University

More information

Research on Evaluation Method of Product Style Semantics Based on Neural Network

Research on Evaluation Method of Product Style Semantics Based on Neural Network Research Journal of Applied Sciences, Engineering and Technology 6(23): 4330-4335, 2013 ISSN: 2040-7459; e-issn: 2040-7467 Maxwell Scientific Organization, 2013 Submitted: September 28, 2012 Accepted:

More information

INVESTIGATING DATA MINING BY ARTIFICIAL NEURAL NETWORK: A CASE OF REAL ESTATE PROPERTY EVALUATION

INVESTIGATING DATA MINING BY ARTIFICIAL NEURAL NETWORK: A CASE OF REAL ESTATE PROPERTY EVALUATION http:// INVESTIGATING DATA MINING BY ARTIFICIAL NEURAL NETWORK: A CASE OF REAL ESTATE PROPERTY EVALUATION 1 Rajat Pradhan, 2 Satish Kumar 1,2 Dept. of Electronics & Communication Engineering, A.S.E.T.,

More information

House Price Prediction Using LSTM

House Price Prediction Using LSTM House Price Prediction Using LSTM Xiaochen Chen Lai Wei The Hong Kong University of Science and Technology Jiaxin Xu ABSTRACT In this paper, we use the house price data ranging from January 2004 to October

More information

A Novel Technique for Optimizing the Hidden Layer Architecture in Artificial Neural Networks N. M. Wagarachchi 1, A. S.

A Novel Technique for Optimizing the Hidden Layer Architecture in Artificial Neural Networks N. M. Wagarachchi 1, A. S. American International Journal of Research in Science, Technology, Engineering & Mathematics Available online at http://www.iasir.net ISSN (Print): 2328-3491, ISSN (Online): 2328-3580, ISSN (CD-ROM): 2328-3629

More information

Artificial Neural Network based Curve Prediction

Artificial Neural Network based Curve Prediction Artificial Neural Network based Curve Prediction LECTURE COURSE: AUSGEWÄHLTE OPTIMIERUNGSVERFAHREN FÜR INGENIEURE SUPERVISOR: PROF. CHRISTIAN HAFNER STUDENTS: ANTHONY HSIAO, MICHAEL BOESCH Abstract We

More information

Optimization Model of K-Means Clustering Using Artificial Neural Networks to Handle Class Imbalance Problem

Optimization Model of K-Means Clustering Using Artificial Neural Networks to Handle Class Imbalance Problem IOP Conference Series: Materials Science and Engineering PAPER OPEN ACCESS Optimization Model of K-Means Clustering Using Artificial Neural Networks to Handle Class Imbalance Problem To cite this article:

More information

COMBINING NEURAL NETWORKS FOR SKIN DETECTION

COMBINING NEURAL NETWORKS FOR SKIN DETECTION COMBINING NEURAL NETWORKS FOR SKIN DETECTION Chelsia Amy Doukim 1, Jamal Ahmad Dargham 1, Ali Chekima 1 and Sigeru Omatu 2 1 School of Engineering and Information Technology, Universiti Malaysia Sabah,

More information

Research Article Optimization of Process Parameters in Injection Moulding of FR Lever Using GRA and DFA and Validated by Ann

Research Article Optimization of Process Parameters in Injection Moulding of FR Lever Using GRA and DFA and Validated by Ann Research Journal of Applied Sciences, Engineering and Technology 11(8): 817-826, 2015 DOI: 10.19026/rjaset.11.2090 ISSN: 2040-7459; e-issn: 2040-7467 2015 Maxwell Scientific Publication Corp. Submitted:

More information

An AI-Assisted Cyber Attack Detection Framework for Software Defined Mobile Networks

An AI-Assisted Cyber Attack Detection Framework for Software Defined Mobile Networks An AI-Assisted Cyber Attack Detection Framework for Software Defined Mobile Networks G. Catania 1, L. Ganga 1, S. Milardo 2, G. Morabito 3, A. Mursia 1 1 Land & Naval Defence Electronics Division - Leonardo

More information

A NEURAL NETWORK BASED TRAFFIC-FLOW PREDICTION MODEL. Bosnia Herzegovina. Denizli 20070, Turkey. Buyukcekmece, Istanbul, Turkey

A NEURAL NETWORK BASED TRAFFIC-FLOW PREDICTION MODEL. Bosnia Herzegovina. Denizli 20070, Turkey. Buyukcekmece, Istanbul, Turkey Mathematical and Computational Applications, Vol. 15, No. 2, pp. 269-278, 2010. Association for Scientific Research A NEURAL NETWORK BASED TRAFFIC-FLOW PREDICTION MODEL B. Gültekin Çetiner 1, Murat Sari

More information

Improving Classification Accuracy for Single-loop Reliability-based Design Optimization

Improving Classification Accuracy for Single-loop Reliability-based Design Optimization , March 15-17, 2017, Hong Kong Improving Classification Accuracy for Single-loop Reliability-based Design Optimization I-Tung Yang, and Willy Husada Abstract Reliability-based design optimization (RBDO)

More information

Proceedings of the 2016 International Conference on Industrial Engineering and Operations Management Detroit, Michigan, USA, September 23-25, 2016

Proceedings of the 2016 International Conference on Industrial Engineering and Operations Management Detroit, Michigan, USA, September 23-25, 2016 Neural Network Viscosity Models for Multi-Component Liquid Mixtures Adel Elneihoum, Hesham Alhumade, Ibrahim Alhajri, Walid El Garwi, Ali Elkamel Department of Chemical Engineering, University of Waterloo

More information

IMPROVEMENTS TO THE BACKPROPAGATION ALGORITHM

IMPROVEMENTS TO THE BACKPROPAGATION ALGORITHM Annals of the University of Petroşani, Economics, 12(4), 2012, 185-192 185 IMPROVEMENTS TO THE BACKPROPAGATION ALGORITHM MIRCEA PETRINI * ABSTACT: This paper presents some simple techniques to improve

More information

Argha Roy* Dept. of CSE Netaji Subhash Engg. College West Bengal, India.

Argha Roy* Dept. of CSE Netaji Subhash Engg. College West Bengal, India. Volume 3, Issue 3, March 2013 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Training Artificial

More information

Research Article International Journals of Advanced Research in Computer Science and Software Engineering ISSN: X (Volume-7, Issue-6)

Research Article International Journals of Advanced Research in Computer Science and Software Engineering ISSN: X (Volume-7, Issue-6) International Journals of Advanced Research in Computer Science and Software Engineering Research Article June 17 Artificial Neural Network in Classification A Comparison Dr. J. Jegathesh Amalraj * Assistant

More information

Simulation of Zhang Suen Algorithm using Feed- Forward Neural Networks

Simulation of Zhang Suen Algorithm using Feed- Forward Neural Networks Simulation of Zhang Suen Algorithm using Feed- Forward Neural Networks Ritika Luthra Research Scholar Chandigarh University Gulshan Goyal Associate Professor Chandigarh University ABSTRACT Image Skeletonization

More information

Digital Image Steganography Using Bit Flipping

Digital Image Steganography Using Bit Flipping BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 18, No 1 Sofia 2018 Print ISSN: 1311-9702; Online ISSN: 1314-4081 DOI: 10.2478/cait-2018-0006 Digital Image Steganography Using

More information

Lecture 17: Neural Networks and Deep Learning. Instructor: Saravanan Thirumuruganathan

Lecture 17: Neural Networks and Deep Learning. Instructor: Saravanan Thirumuruganathan Lecture 17: Neural Networks and Deep Learning Instructor: Saravanan Thirumuruganathan Outline Perceptron Neural Networks Deep Learning Convolutional Neural Networks Recurrent Neural Networks Auto Encoders

More information

Opening the Black Box Data Driven Visualizaion of Neural N

Opening the Black Box Data Driven Visualizaion of Neural N Opening the Black Box Data Driven Visualizaion of Neural Networks September 20, 2006 Aritificial Neural Networks Limitations of ANNs Use of Visualization (ANNs) mimic the processes found in biological

More information

Application of Artificial Neural Network for the Inversion of Electrical Resistivity Data

Application of Artificial Neural Network for the Inversion of Electrical Resistivity Data Journal of Informatics and Mathematical Sciences Vol. 9, No. 2, pp. 297 316, 2017 ISSN 0975-5748 (online); 0974-875X (print) Published by RGN Publications http://www.rgnpublications.com Proceedings of

More information

A Neural Network Model Of Insurance Customer Ratings

A Neural Network Model Of Insurance Customer Ratings A Neural Network Model Of Insurance Customer Ratings Jan Jantzen 1 Abstract Given a set of data on customers the engineering problem in this study is to model the data and classify customers

More information

Artificial Neural Network (ANN) Approach for Predicting Friction Coefficient of Roller Burnishing AL6061

Artificial Neural Network (ANN) Approach for Predicting Friction Coefficient of Roller Burnishing AL6061 International Journal of Machine Learning and Computing, Vol. 2, No. 6, December 2012 Artificial Neural Network (ANN) Approach for Predicting Friction Coefficient of Roller Burnishing AL6061 S. H. Tang,

More information

Performance Analysis of Data Mining Classification Techniques

Performance Analysis of Data Mining Classification Techniques Performance Analysis of Data Mining Classification Techniques Tejas Mehta 1, Dr. Dhaval Kathiriya 2 Ph.D. Student, School of Computer Science, Dr. Babasaheb Ambedkar Open University, Gujarat, India 1 Principal

More information

Linear Separability. Linear Separability. Capabilities of Threshold Neurons. Capabilities of Threshold Neurons. Capabilities of Threshold Neurons

Linear Separability. Linear Separability. Capabilities of Threshold Neurons. Capabilities of Threshold Neurons. Capabilities of Threshold Neurons Linear Separability Input space in the two-dimensional case (n = ): - - - - - - w =, w =, = - - - - - - w = -, w =, = - - - - - - w = -, w =, = Linear Separability So by varying the weights and the threshold,

More information

Seismic regionalization based on an artificial neural network

Seismic regionalization based on an artificial neural network Seismic regionalization based on an artificial neural network *Jaime García-Pérez 1) and René Riaño 2) 1), 2) Instituto de Ingeniería, UNAM, CU, Coyoacán, México D.F., 014510, Mexico 1) jgap@pumas.ii.unam.mx

More information

Artificial Neural Network and Multi-Response Optimization in Reliability Measurement Approximation and Redundancy Allocation Problem

Artificial Neural Network and Multi-Response Optimization in Reliability Measurement Approximation and Redundancy Allocation Problem International Journal of Mathematics and Statistics Invention (IJMSI) E-ISSN: 2321 4767 P-ISSN: 2321-4759 Volume 4 Issue 10 December. 2016 PP-29-34 Artificial Neural Network and Multi-Response Optimization

More information

Use of Artificial Neural Networks to Investigate the Surface Roughness in CNC Milling Machine

Use of Artificial Neural Networks to Investigate the Surface Roughness in CNC Milling Machine Use of Artificial Neural Networks to Investigate the Surface Roughness in CNC Milling Machine M. Vijay Kumar Reddy 1 1 Department of Mechanical Engineering, Annamacharya Institute of Technology and Sciences,

More information

Ensembles of Neural Networks for Forecasting of Time Series of Spacecraft Telemetry

Ensembles of Neural Networks for Forecasting of Time Series of Spacecraft Telemetry ISSN 1060-992X, Optical Memory and Neural Networks, 2017, Vol. 26, No. 1, pp. 47 54. Allerton Press, Inc., 2017. Ensembles of Neural Networks for Forecasting of Time Series of Spacecraft Telemetry E. E.

More information

Volume 1, Issue 3 (2013) ISSN International Journal of Advance Research and Innovation

Volume 1, Issue 3 (2013) ISSN International Journal of Advance Research and Innovation Application of ANN for Prediction of Surface Roughness in Turning Process: A Review Ranganath M S *, Vipin, R S Mishra Department of Mechanical Engineering, Dehli Technical University, New Delhi, India

More information

Analytical model A structure and process for analyzing a dataset. For example, a decision tree is a model for the classification of a dataset.

Analytical model A structure and process for analyzing a dataset. For example, a decision tree is a model for the classification of a dataset. Glossary of data mining terms: Accuracy Accuracy is an important factor in assessing the success of data mining. When applied to data, accuracy refers to the rate of correct values in the data. When applied

More information

A Neuro-Fuzzy Application to Power System

A Neuro-Fuzzy Application to Power System 2009 International Conference on Machine Learning and Computing IPCSIT vol.3 (2011) (2011) IACSIT Press, Singapore A Neuro-Fuzzy Application to Power System Ahmed M. A. Haidar 1, Azah Mohamed 2, Norazila

More information

International Journal of Electrical and Computer Engineering 4: Application of Neural Network in User Authentication for Smart Home System

International Journal of Electrical and Computer Engineering 4: Application of Neural Network in User Authentication for Smart Home System Application of Neural Network in User Authentication for Smart Home System A. Joseph, D.B.L. Bong, and D.A.A. Mat Abstract Security has been an important issue and concern in the smart home systems. Smart

More information

CHAPTER 7 MASS LOSS PREDICTION USING ARTIFICIAL NEURAL NETWORK (ANN)

CHAPTER 7 MASS LOSS PREDICTION USING ARTIFICIAL NEURAL NETWORK (ANN) 128 CHAPTER 7 MASS LOSS PREDICTION USING ARTIFICIAL NEURAL NETWORK (ANN) Various mathematical techniques like regression analysis and software tools have helped to develop a model using equation, which

More information

IN recent years, neural networks have attracted considerable attention

IN recent years, neural networks have attracted considerable attention Multilayer Perceptron: Architecture Optimization and Training Hassan Ramchoun, Mohammed Amine Janati Idrissi, Youssef Ghanou, Mohamed Ettaouil Modeling and Scientific Computing Laboratory, Faculty of Science

More information

Performance Analysis of A Feed-Forward Artifical Neural Network With Small-World Topology

Performance Analysis of A Feed-Forward Artifical Neural Network With Small-World Topology Available online at www.sciencedirect.com Procedia Technology (202 ) 29 296 INSODE 20 Performance Analysis of A Feed-Forward Artifical Neural Network With Small-World Topology Okan Erkaymaz a, Mahmut Özer

More information

POTENTIAL DIFFERENCES AT RISK ASSESSMENT AND RISK TREATMENT PLANNING BETWEEN ISO/IEC 27001:2005 AND ISO/IEC 27001:2013

POTENTIAL DIFFERENCES AT RISK ASSESSMENT AND RISK TREATMENT PLANNING BETWEEN ISO/IEC 27001:2005 AND ISO/IEC 27001:2013 POTENTIAL DIFFERENCES AT RISK ASSESSMENT AND RISK TREATMENT PLANNING BETWEEN ISO/IEC 27001:2005 AND ISO/IEC 27001:2013 Eka Pramudita Purnomo 1) and R. V. Hari Ginardi 2) Master s Program in Management

More information

Implementation of the common phrase index method on the phrase query for information retrieval

Implementation of the common phrase index method on the phrase query for information retrieval Implementation of the common phrase index method on the phrase query for information retrieval Triyah Fatmawati, Badrus Zaman, and Indah Werdiningsih Citation: AIP Conference Proceedings 1867, 020027 (2017);

More information

WHAT TYPE OF NEURAL NETWORK IS IDEAL FOR PREDICTIONS OF SOLAR FLARES?

WHAT TYPE OF NEURAL NETWORK IS IDEAL FOR PREDICTIONS OF SOLAR FLARES? WHAT TYPE OF NEURAL NETWORK IS IDEAL FOR PREDICTIONS OF SOLAR FLARES? Initially considered for this model was a feed forward neural network. Essentially, this means connections between units do not form

More information

Neural Networks Laboratory EE 329 A

Neural Networks Laboratory EE 329 A Neural Networks Laboratory EE 329 A Introduction: Artificial Neural Networks (ANN) are widely used to approximate complex systems that are difficult to model using conventional modeling techniques such

More information

Implementation Of Recurrent Neural Network And Boosting Method For Time-Series Forecasting

Implementation Of Recurrent Neural Network And Boosting Method For Time-Series Forecasting Implementation Of Recurrent Neural Network And Boosting Method For Time-Series Forecasting Rully Soelaiman 1,2, Arief Martoyo 1, Yudhi Purwananto 1, Mauridhi H. Purnomo 2 1 Informatics Department, Faculty

More information

PERFORMANCE OF GRID COMPUTING FOR DISTRIBUTED NEURAL NETWORK. Submitted By:Mohnish Malviya & Suny Shekher Pankaj [CSE,7 TH SEM]

PERFORMANCE OF GRID COMPUTING FOR DISTRIBUTED NEURAL NETWORK. Submitted By:Mohnish Malviya & Suny Shekher Pankaj [CSE,7 TH SEM] PERFORMANCE OF GRID COMPUTING FOR DISTRIBUTED NEURAL NETWORK Submitted By:Mohnish Malviya & Suny Shekher Pankaj [CSE,7 TH SEM] All Saints` College Of Technology, Gandhi Nagar, Bhopal. Abstract: In this

More information

Research Article A New High Order Fuzzy ARMA Time Series Forecasting Method by Using Neural Networks to Define Fuzzy Relations

Research Article A New High Order Fuzzy ARMA Time Series Forecasting Method by Using Neural Networks to Define Fuzzy Relations Mathematical Problems in Engineering Volume 2015, Article ID 128097, 14 pages http://dx.doi.org/10.1155/2015/128097 Research Article A New High Order Fuzzy ARMA Time Series Forecasting Method by Using

More information

Practical Tips for using Backpropagation

Practical Tips for using Backpropagation Practical Tips for using Backpropagation Keith L. Downing August 31, 2017 1 Introduction In practice, backpropagation is as much an art as a science. The user typically needs to try many combinations of

More information

Finding Dominant Parameters For Fault Diagnosis Of a Single Bearing System Using Back Propagation Neural Network

Finding Dominant Parameters For Fault Diagnosis Of a Single Bearing System Using Back Propagation Neural Network International Journal of Mechanical & Mechatronics Engineering IJMME-IJENS Vol:13 No:01 40 Finding Dominant Parameters For Fault Diagnosis Of a Single Bearing System Using Back Propagation Neural Network

More information

Identification of Multisensor Conversion Characteristic Using Neural Networks

Identification of Multisensor Conversion Characteristic Using Neural Networks Sensors & Transducers 3 by IFSA http://www.sensorsportal.com Identification of Multisensor Conversion Characteristic Using Neural Networks Iryna TURCHENKO and Volodymyr KOCHAN Research Institute of Intelligent

More information

Data Mining. Neural Networks

Data Mining. Neural Networks Data Mining Neural Networks Goals for this Unit Basic understanding of Neural Networks and how they work Ability to use Neural Networks to solve real problems Understand when neural networks may be most

More information

Pattern Classification Algorithms for Face Recognition

Pattern Classification Algorithms for Face Recognition Chapter 7 Pattern Classification Algorithms for Face Recognition 7.1 Introduction The best pattern recognizers in most instances are human beings. Yet we do not completely understand how the brain recognize

More information

Applying Supervised Learning

Applying Supervised Learning Applying Supervised Learning When to Consider Supervised Learning A supervised learning algorithm takes a known set of input data (the training set) and known responses to the data (output), and trains

More information

Detecting SIM Box Fraud Using Neural Network

Detecting SIM Box Fraud Using Neural Network Detecting SIM Box Fraud Using Neural Network Abdikarim Hussein Elmi, Subariah Ibrahim and Roselina Sallehuddin Abstract One of the most severe threats to revenue and quality of service in telecom providers

More information

MODELLING OF ARTIFICIAL NEURAL NETWORK CONTROLLER FOR ELECTRIC DRIVE WITH LINEAR TORQUE LOAD FUNCTION

MODELLING OF ARTIFICIAL NEURAL NETWORK CONTROLLER FOR ELECTRIC DRIVE WITH LINEAR TORQUE LOAD FUNCTION MODELLING OF ARTIFICIAL NEURAL NETWORK CONTROLLER FOR ELECTRIC DRIVE WITH LINEAR TORQUE LOAD FUNCTION Janis Greivulis, Anatoly Levchenkov, Mikhail Gorobetz Riga Technical University, Faculty of Electrical

More information

Metaheuristic Optimization with Evolver, Genocop and OptQuest

Metaheuristic Optimization with Evolver, Genocop and OptQuest Metaheuristic Optimization with Evolver, Genocop and OptQuest MANUEL LAGUNA Graduate School of Business Administration University of Colorado, Boulder, CO 80309-0419 Manuel.Laguna@Colorado.EDU Last revision:

More information

Rough Set Approach to Unsupervised Neural Network based Pattern Classifier

Rough Set Approach to Unsupervised Neural Network based Pattern Classifier Rough Set Approach to Unsupervised Neural based Pattern Classifier Ashwin Kothari, Member IAENG, Avinash Keskar, Shreesha Srinath, and Rakesh Chalsani Abstract Early Convergence, input feature space with

More information

International Journal of Scientific & Engineering Research, Volume 8, Issue 1, January ISSN

International Journal of Scientific & Engineering Research, Volume 8, Issue 1, January ISSN International Journal of Scientific & Engineering Research, Volume 8, Issue 1, January-2017 550 Using Neuro Fuzzy and Genetic Algorithm for Image Denoising Shaymaa Rashid Saleh Raidah S. Khaudeyer Abstract

More information

IPS with isensor sees, identifies and blocks more malicious traffic than other IPS solutions

IPS with isensor sees, identifies and blocks more malicious traffic than other IPS solutions IPS Effectiveness IPS with isensor sees, identifies and blocks more malicious traffic than other IPS solutions An Intrusion Prevention System (IPS) is a critical layer of defense that helps you protect

More information

Non-destructive Watermelon Ripeness Determination Using Image Processing and Artificial Neural Network (ANN)

Non-destructive Watermelon Ripeness Determination Using Image Processing and Artificial Neural Network (ANN) Non-destructive Watermelon Ripeness Determination Using Image Processing and Artificial Neural Network (ANN) Shah Rizam M. S. B., Farah Yasmin A.R., Ahmad Ihsan M. Y., and Shazana K. Abstract Agriculture

More information

Dynamic Analysis of Structures Using Neural Networks

Dynamic Analysis of Structures Using Neural Networks Dynamic Analysis of Structures Using Neural Networks Alireza Lavaei Academic member, Islamic Azad University, Boroujerd Branch, Iran Alireza Lohrasbi Academic member, Islamic Azad University, Boroujerd

More information

CS 6501: Deep Learning for Computer Graphics. Training Neural Networks II. Connelly Barnes

CS 6501: Deep Learning for Computer Graphics. Training Neural Networks II. Connelly Barnes CS 6501: Deep Learning for Computer Graphics Training Neural Networks II Connelly Barnes Overview Preprocessing Initialization Vanishing/exploding gradients problem Batch normalization Dropout Additional

More information

Neural Network Neurons

Neural Network Neurons Neural Networks Neural Network Neurons 1 Receives n inputs (plus a bias term) Multiplies each input by its weight Applies activation function to the sum of results Outputs result Activation Functions Given

More information

4.12 Generalization. In back-propagation learning, as many training examples as possible are typically used.

4.12 Generalization. In back-propagation learning, as many training examples as possible are typically used. 1 4.12 Generalization In back-propagation learning, as many training examples as possible are typically used. It is hoped that the network so designed generalizes well. A network generalizes well when

More information

A *69>H>N6 #DJGC6A DG C<>C::G>C<,8>:C8:H /DA 'D 2:6G, ()-"&"3 -"(' ( +-" " " % '.+ % ' -0(+$,

A *69>H>N6 #DJGC6A DG C<>C::G>C<,8>:C8:H /DA 'D 2:6G, ()-&3 -(' ( +-   % '.+ % ' -0(+$, The structure is a very important aspect in neural network design, it is not only impossible to determine an optimal structure for a given problem, it is even impossible to prove that a given structure

More information

Random Search Report An objective look at random search performance for 4 problem sets

Random Search Report An objective look at random search performance for 4 problem sets Random Search Report An objective look at random search performance for 4 problem sets Dudon Wai Georgia Institute of Technology CS 7641: Machine Learning Atlanta, GA dwai3@gatech.edu Abstract: This report

More information

6. NEURAL NETWORK BASED PATH PLANNING ALGORITHM 6.1 INTRODUCTION

6. NEURAL NETWORK BASED PATH PLANNING ALGORITHM 6.1 INTRODUCTION 6 NEURAL NETWORK BASED PATH PLANNING ALGORITHM 61 INTRODUCTION In previous chapters path planning algorithms such as trigonometry based path planning algorithm and direction based path planning algorithm

More information

USING IMAGES PATTERN RECOGNITION AND NEURAL NETWORKS FOR COATING QUALITY ASSESSMENT Image processing for quality assessment

USING IMAGES PATTERN RECOGNITION AND NEURAL NETWORKS FOR COATING QUALITY ASSESSMENT Image processing for quality assessment USING IMAGES PATTERN RECOGNITION AND NEURAL NETWORKS FOR COATING QUALITY ASSESSMENT Image processing for quality assessment L.-M. CHANG and Y.A. ABDELRAZIG School of Civil Engineering, Purdue University,

More information

The McGill University Health Centre (MUHC)

The McGill University Health Centre (MUHC) The McGill University Health Centre (MUHC) Strengthening its security posture with in- depth global intelligence Overview The need MUHC security staff wanted to more quickly identify and assess potential

More information

Multilayer Feed-forward networks

Multilayer Feed-forward networks Multi Feed-forward networks 1. Computational models of McCulloch and Pitts proposed a binary threshold unit as a computational model for artificial neuron. This first type of neuron has been generalized

More information

Cursive Handwriting Recognition System Using Feature Extraction and Artificial Neural Network

Cursive Handwriting Recognition System Using Feature Extraction and Artificial Neural Network Cursive Handwriting Recognition System Using Feature Extraction and Artificial Neural Network Utkarsh Dwivedi 1, Pranjal Rajput 2, Manish Kumar Sharma 3 1UG Scholar, Dept. of CSE, GCET, Greater Noida,

More information

turning data into dollars

turning data into dollars turning data into dollars Tom s Ten Data Tips November 2008 Neural Networks Neural Networks (NNs) are sometimes considered the epitome of data mining algorithms. Loosely modeled after the human brain (hence

More information

Supervised Learning in Neural Networks (Part 2)

Supervised Learning in Neural Networks (Part 2) Supervised Learning in Neural Networks (Part 2) Multilayer neural networks (back-propagation training algorithm) The input signals are propagated in a forward direction on a layer-bylayer basis. Learning

More information

4. Feedforward neural networks. 4.1 Feedforward neural network structure

4. Feedforward neural networks. 4.1 Feedforward neural network structure 4. Feedforward neural networks 4.1 Feedforward neural network structure Feedforward neural network is one of the most common network architectures. Its structure and some basic preprocessing issues required

More information

J. Electrical Systems 13-2 (2017): Regular paper

J. Electrical Systems 13-2 (2017): Regular paper Nor Hazwani Idris 1, *, Nur Ashida Salim 1, Muhammad Murtadha Othman 1 and Zuhaila Mat Yasin 1 Regular paper Prediction of Cascading Collapse Occurrence due to the Effect of Hidden Failure of a Protection

More information

Optimal Design of Steel Columns with Axial Load Using Artificial Neural Networks

Optimal Design of Steel Columns with Axial Load Using Artificial Neural Networks 2017 2nd International Conference on Applied Mechanics and Mechatronics Engineering (AMME 2017) ISBN: 978-1-60595-521-6 Optimal Design of Steel Columns with Axial Load Using Artificial Neural Networks

More information

Adaptive Regularization. in Neural Network Filters

Adaptive Regularization. in Neural Network Filters Adaptive Regularization in Neural Network Filters Course 0455 Advanced Digital Signal Processing May 3 rd, 00 Fares El-Azm Michael Vinther d97058 s97397 Introduction The bulk of theoretical results and

More information

New Non Path Metrics for Evaluating Network Security Based on Vulnerability

New Non Path Metrics for Evaluating Network Security Based on Vulnerability www.ijcsi.org 487 New Non Path Metrics for Evaluating Network Security Based on Vulnerability Tito Waluyo Purboyo 1 and Kuspriyanto 2 1,2 School of Electrical Engineering & Informatics, Institut Teknologi

More information

Feature weighting using particle swarm optimization for learning vector quantization classifier

Feature weighting using particle swarm optimization for learning vector quantization classifier Journal of Physics: Conference Series PAPER OPEN ACCESS Feature weighting using particle swarm optimization for learning vector quantization classifier To cite this article: A Dongoran et al 2018 J. Phys.:

More information

Chapter 4. Adaptive Self-tuning : A Neural Network approach. 4.1 Introduction

Chapter 4. Adaptive Self-tuning : A Neural Network approach. 4.1 Introduction Chapter 4 Adaptive Self-tuning : A Neural Network approach 4.1 Introduction Machine learning is a method of solving real world problems by employing the hidden knowledge present in the past data or data

More information

MULTILAYER PERCEPTRON WITH ADAPTIVE ACTIVATION FUNCTIONS CHINMAY RANE. Presented to the Faculty of Graduate School of

MULTILAYER PERCEPTRON WITH ADAPTIVE ACTIVATION FUNCTIONS CHINMAY RANE. Presented to the Faculty of Graduate School of MULTILAYER PERCEPTRON WITH ADAPTIVE ACTIVATION FUNCTIONS By CHINMAY RANE Presented to the Faculty of Graduate School of The University of Texas at Arlington in Partial Fulfillment of the Requirements for

More information

World Journal of Engineering Research and Technology WJERT

World Journal of Engineering Research and Technology WJERT wjert, 2019, Vol. 5, Issue 1, 128-138. Original Article ISSN 2454-695X Abigo et al. WJERT www.wjert.org SJIF Impact Factor: 5.218 APPLICATION OF ARTIFICIAL NEURAL NETWORK IN OPTIMIZATION OF SOAP PRODUCTION

More information

Automatic Classification of Attacks on IP Telephony

Automatic Classification of Attacks on IP Telephony Automatic Classification of Attacks on IP Telephony Jakub SAFARIK 1, Pavol PARTILA 1, Filip REZAC 1, Lukas MACURA 2, Miroslav VOZNAK 1 1 Department of Telecommunications, Faculty of Electrical Engineering

More information

Predicting User Ratings Using Status Models on Amazon.com

Predicting User Ratings Using Status Models on Amazon.com Predicting User Ratings Using Status Models on Amazon.com Borui Wang Stanford University borui@stanford.edu Guan (Bell) Wang Stanford University guanw@stanford.edu Group 19 Zhemin Li Stanford University

More information