Cluster analysis of 3D seismic data for oil and gas exploration

Size: px
Start display at page:

Download "Cluster analysis of 3D seismic data for oil and gas exploration"

Transcription

1 Data Mining VII: Data, Text and Web Mining and their Business Applications 63 Cluster analysis of 3D seismic data for oil and gas exploration D. R. S. Moraes, R. P. Espíndola, A. G. Evsukoff & N. F. F. Ebecken COPPE/Federal University of Rio de Janeiro, Brazil Abstract Seismic attributes are information extracted from seismic data and constitute important tools to estimate the geological structure of a place, helping the understanding of the subsurface and reducing the uncertainties on interpretations. This comprehension is crucial to tasks such as lithology prediction and reservoir characterization. Seismic attributes are generated by transforming data from a seismic line (two dimensional data) or a seismic volume (three dimensional data). This work presents a study of clustering algorithms to these attributes and the techniques employed follow two distinct approaches: a self organizing map to perform crisp clustering and fuzzy c-means to perform partial clustering. The evaluations of the partitions are performed with the PBM index which indicates the best number of groups. Data from a Brazilian oil field is used to test the algorithms. Keywords: clustering, neural networks, fuzzy sets, cluster validity. Introduction In oil industry, the decision making of exploration and exploitation processes involves dealing with geological, geophysical and geochemical data. The evolution of computer hardware technology and the development of data base management systems (DBMS) allow the data to processed and stored in very huge databases. This fact represents a great opportunity for a company to record all data from its operations. However, it makes the analysis and understanding of such data difficult. Thus, Data Mining techniques may help the experts on their task by automatically discovering useful information from these huge volumes of data. Examples of activities that can be improved by the use of these techniques doi:0.2495/data06007

2 64 Data Mining VII: Data, Text and Web Mining and their Business Applications are reservoir characterization, prediction and classification of rock porosity, optimal placement of wells and detection of oil spills []. In this work, two well known clustering techniques are employed on 3D seismic data. It was expected that the clusters may help geologists to identify different lithologies on the region studied. The quality of the groups formed is assessed using a cluster validation index called PBM [2]. The clustering algorithms are fuzzy c-means [3] and a neural network approach known as selforganizing map [4]. The dataset was obtained from Namorado oil field in Brazil. This paper is organized as follows: the next section presents the clustering methods used in the application. Section 3 describes the PBM index, used to validate the results generated by the clustering methods and section 4 presents details about the data base and how it was treated. Section 5 shows the results obtained and, in last section, some concluding remarks and suggestions of future research are done. 2 Clustering methods Clustering is one of the most usual tasks in the process of data mining, helping the discovery and identification of distributions and patterns of interest. It aims to organize a data set into groups of similar elements by detecting implicit relationships between attributes recorded on data [5]. The algorithms studied on this work perform partitioning clustering. This kind of clustering splits a data set into a pre-defined amount of groups or partitions. From an initial partition, such techniques search for the best possible splitting until some stopping criteria is reached. A good partitioning must yields groups very different among themselves as well as formed by similar objects. Following, the algorithms here studied are presented. 2. Fuzzy c-means On classic partitioning, a data set X = { x, x2,..., xn} with n objects x i R must be allocated into K groups such that each object belongs to only one group. In other words, given G, G2,..., GK groups, it is verified that G i and G i G j = for every i, j =,..., K, i j. The partition matrix U(X) presents the result, such that each element has u ij = if x i G j and u ij = 0 otherwise. In fuzzy clustering algorithms, an object can be assigned to different groups with partial membership grades u ij [ 0,]. Fuzzy c-means splits a data set into K groups and assigns a membership grades for all objects by optimizing the following objective function: p F n K m u ij i= j= = xi w j 2 ()

3 Data Mining VII: Data, Text and Web Mining and their Business Applications 65 in which the fuzzifier m is a real value greater than, u ij is the membership grade of object x i to group G j, and w j is the center of G j. As the optimization process continues, the membership grades and the centers of groups are updated by the following expressions: u ij = K k = x x i i w w j k n m uij xi i= j = n m uij i= 2 m (2) w (3) When no more changes occur on partition matrix, the algorithm is stopped. 2.2 SOM neural networks Artificial neural networks are computing models characterized by systems that remind (in some level) the human brain structure. Self-organizing maps (SOM) is a network model which main characteristic is the neighborhood concept; that is, the network learns to recognize neighbor sections in the training data as well as the topology of the training set [4]. Neurons in the SOM s competition layer are originally arranged in fixed positions according to a topology function. It is possible to arrange the neurons topology into rectangular or hexagonal shapes. This network employs competitive learning and the closest neuron to the input data is the output unit. All the neurons from a certain neighborhood of this winner neuron are updated by Kohonen s rule and the value of radius determines the neighborhood space. The neural network determines the winner neuron by X Gw = min{ X G j }, or w = arg min{ X G j }. (4) j j in which X is the input data vector, G j is the synapses vector and w is the index of the winner neuron. The synapses of the winner neuron are adjusted by means of a linear combination between the preceding and the current weight: G j ( t + ) = G j ( t) + hwj ( t)[ X( t) G j ( t)] (5) in which t is the discrete-time coordinate and h wj (t) is the neighborhood kernel. Usually this kernel is calculated as h ( t) = h( r r, t) (6) wj where r w and r j are the radius of the neuron w and j, respectively. The last expression reflects the general definition of a neighborhood kernel. w j

4 66 Data Mining VII: Data, Text and Web Mining and their Business Applications In this work, it was used the concept of bubble neighborhood, defined by α(t), if neuron j belongs to neuron w neighborhood h wj = (7) 0, otherwise in which α(t) is a monotonically decreasing function of time ( 0 < α ( t) < ). In SOM networks, the number of groups is determined by the network size. In this study, to permit the comparison of the results with the fuzzy c-means clustering, the first SOM layer was formed by only one neuron and the second SOM layer has the number of groups it is applied to. 3 Cluster validation index One of the greatest difficulties of applying a partitioning algorithm is to set the amount of groups and frequently no one knows the correct value with antecedence. Thus, the clustering algorithm is executed with diverse values of groups and the best one can be identified by cluster validation indexes. As mentioned before, a good clustering result exhibits compact and separated groups and these indexes evaluate the groupings based on these features. The measure used here is PBM index: 2 E PBM ( K) = DK, (8) k E in which K is the number of clusters, E K is the sum of intra-cluster distances, E is the sum of distances of all points to the center of data, and D K is the maximum of within-cluster distances. They are given by the following expressions: k n EK = uij d ( x i, w j ), (9) j= i= k DK = max d( w i, w j ). (0) i, j= On these formulas, K u ij is degree of membership of object x i to group with center w j and d is the distance function. The greater is the index value the best is the partition. 4 Seismic data and experiments performed In order to recognize and classify reservoir characteristics, geoscientists analyze the variability in seismic reflections [6]. This activity demands a professional able to identify subtle waveform characteristics and tools to measuring these characteristics are given by seismic attributes. So these attributes are important in reservoir characterization [7] and the correct use of them depends on the experience of a geoscientist, that is, his understanding and interpretation of their behavior. G j

5 Data Mining VII: Data, Text and Web Mining and their Business Applications 67 The 3D seismic data used in this work are from Namorado oil field at Campos basin in Brazil. The seismic attributes used on this research were created using OpendTect software ( which is able to generate and visualize them. The attributes used are amplitude, cosine phase and Hilbert transformation. A dataset with over records was created using these ones. Both clustering algorithms were run from 2 to 0 partitions in order to identify the best number of groups. As they are randomly initiated (centers coordinates and memberships grades), each one was performed 0 times to obtain the mean results. Table shows the algorithms settings. Therefore the data set was approached by one setting of fuzzy c-means and two of SOM network, with rectangular or hexagonal topology. Table : The settings of algorithms. Parameter Value Fuzzy c-means SOM fuzzifier.5 error tolerance 0. neurons on first layer neurons on second layer from 2 to 0 epochs 0 6 learning rate 0. radius 0 neighborhood function Bubble topology rectangular or hexagonal Table 2: Centers coordinates of groups. Algorithm Coordinates Amplitude Cosine phase Hilbert transform. G G2 G3 G G2 G3 G G2 G3 Fuzzy c-means SOM rectangular SOM hexagonal

6 68 Data Mining VII: Data, Text and Web Mining and their Business Applications 5 Results Figures -3 shows the PBM index variations with the number of groups for the three experiments. As it can be noticed, both clustering algorithms found three groups as the best value for partition the data, which suggests that it is the correct one. Moreover, almost all the values of PBM index were very similar, indicating that the groups formed on this data by fuzzy c-means and SOM networks have comparable quality. Table 2 shows the mean values (after normalization) of the centers coordinates of the three groups for each experiment and it can be seen that they are almost the same. Figure 4 shows a clustering result visualized in OpendTect software and it can be seen three groups (black, white and gray). PBM Index Number of groups Exp Exp2 Exp3 Exp4 Exp5 Exp6 Exp7 Exp8 Exp9 Exp0 Figure : Results from fuzzy c-means. PBM Index Number of groups Exp Exp2 Exp3 Exp4 Exp5 Exp6 Exp7 Exp8 Exp9 Exp0 Figure 2: Results from SOM with rectangular topology.

7 Data Mining VII: Data, Text and Web Mining and their Business Applications 69 PBM Index Number of groups Exp Exp2 Exp3 Exp4 Exp5 Exp6 Exp7 Exp8 Exp9 Exp0 Figure 3: Results from SOM with hexagonal topology. Figure 4: Visualization of a clustering result. 6 Conclusions This study aimed to show that clustering seismic data may help geologists understand the lithologies of the subsurface. It was generated a dataset with

8 70 Data Mining VII: Data, Text and Web Mining and their Business Applications thousands records and three relevant seismic attributes and was possible to see that both clustering algorithms, self-organizing maps and fuzzy c-means, achieved very similar partitioning the same number of groups with centers almost coincident. In order to verify the quality of a partitioning, it was employed the PBM cluster validation index. Future works should consider the generation and use of other seismic attributes and the presentation of the results to a specialist to qualify them. Other clustering techniques specific to signal processing will be used too. Acknowledgments This work was partially supported by HP Brazil R&D and the Brazilian research institutions FINEP and CNPq. The authors are also grateful to the Brazilian Petroleum Agency (ANP) who provides the data for this study. References [] Aminzadeh, F., Applications of AI and soft computing for challenging problems in the oil industry. Journal of Petroleum Science and Engineering, 47, pp. 5-4, [2] Pakhiraa, M.K., Bandyopadhyayb, S., Maulikc, U., Validity index for crisp and fuzzy clusters, Pattern Recognition, 37, pp , [3] Bezdek, J.C., Pattern Recognition with Fuzzy Objective Function Algorithms, Plenum Press: New York, 98. [4] Kohonen, T., Self-Organizing Maps, Springer: New York, 200. [5] Jain, A.K., Murty, M.N., Flynn, P.J., Data Clustering: A Review, ACM Computing Surveys, 3(3), pp , 999. [6] Bodine, J.H., Waveform analysis with seismic attributes. Oil & Gas Journal, 84(24), pp , 984. [7] Taner, M.T., Koehler, F., Sheriff, R.E., Complex seismic trace analysis, Geophysics, 44, pp , 979.

Parallel Fuzzy c-means Cluster Analysis

Parallel Fuzzy c-means Cluster Analysis Parallel Fuzzy c-means Cluster Analysis Marta V. Modenesi; Myrian C. A. Costa, Alexandre G. Evsukoff and Nelson F. F. Ebecken COPPE/Federal University of Rio de Janeiro, P.O.Box 6856, 945-97 Rio de Janeiro

More information

Figure (5) Kohonen Self-Organized Map

Figure (5) Kohonen Self-Organized Map 2- KOHONEN SELF-ORGANIZING MAPS (SOM) - The self-organizing neural networks assume a topological structure among the cluster units. - There are m cluster units, arranged in a one- or two-dimensional array;

More information

Chapter 7: Competitive learning, clustering, and self-organizing maps

Chapter 7: Competitive learning, clustering, and self-organizing maps Chapter 7: Competitive learning, clustering, and self-organizing maps António R. C. Paiva EEL 6814 Spring 2008 Outline Competitive learning Clustering Self-Organizing Maps What is competition in neural

More information

SOMSN: An Effective Self Organizing Map for Clustering of Social Networks

SOMSN: An Effective Self Organizing Map for Clustering of Social Networks SOMSN: An Effective Self Organizing Map for Clustering of Social Networks Fatemeh Ghaemmaghami Research Scholar, CSE and IT Dept. Shiraz University, Shiraz, Iran Reza Manouchehri Sarhadi Research Scholar,

More information

CHAPTER 4 FUZZY LOGIC, K-MEANS, FUZZY C-MEANS AND BAYESIAN METHODS

CHAPTER 4 FUZZY LOGIC, K-MEANS, FUZZY C-MEANS AND BAYESIAN METHODS CHAPTER 4 FUZZY LOGIC, K-MEANS, FUZZY C-MEANS AND BAYESIAN METHODS 4.1. INTRODUCTION This chapter includes implementation and testing of the student s academic performance evaluation to achieve the objective(s)

More information

Seismic facies analysis using generative topographic mapping

Seismic facies analysis using generative topographic mapping Satinder Chopra + * and Kurt J. Marfurt + Arcis Seismic Solutions, Calgary; The University of Oklahoma, Norman Summary Seismic facies analysis is commonly carried out by classifying seismic waveforms based

More information

Two-step Modified SOM for Parallel Calculation

Two-step Modified SOM for Parallel Calculation Two-step Modified SOM for Parallel Calculation Two-step Modified SOM for Parallel Calculation Petr Gajdoš and Pavel Moravec Petr Gajdoš and Pavel Moravec Department of Computer Science, FEECS, VŠB Technical

More information

Fuzzy-Kernel Learning Vector Quantization

Fuzzy-Kernel Learning Vector Quantization Fuzzy-Kernel Learning Vector Quantization Daoqiang Zhang 1, Songcan Chen 1 and Zhi-Hua Zhou 2 1 Department of Computer Science and Engineering Nanjing University of Aeronautics and Astronautics Nanjing

More information

Artificial Neural Networks Unsupervised learning: SOM

Artificial Neural Networks Unsupervised learning: SOM Artificial Neural Networks Unsupervised learning: SOM 01001110 01100101 01110101 01110010 01101111 01101110 01101111 01110110 01100001 00100000 01110011 01101011 01110101 01110000 01101001 01101110 01100001

More information

IMPLEMENTATION OF FUZZY C MEANS AND SNAKE MODEL FOR BRAIN TUMOR DETECTION

IMPLEMENTATION OF FUZZY C MEANS AND SNAKE MODEL FOR BRAIN TUMOR DETECTION IMPLEMENTATION OF FUZZY C MEANS AND SNAKE MODEL FOR BRAIN TUMOR DETECTION Salwa Shamis Sulaiyam Al-Mazidi, Shrinidhi Shetty, Soumyanath Datta, P. Vijaya Department of Computer Science & Engg., P.O.Box

More information

A SURVEY ON CLUSTERING ALGORITHMS Ms. Kirti M. Patil 1 and Dr. Jagdish W. Bakal 2

A SURVEY ON CLUSTERING ALGORITHMS Ms. Kirti M. Patil 1 and Dr. Jagdish W. Bakal 2 Ms. Kirti M. Patil 1 and Dr. Jagdish W. Bakal 2 1 P.G. Scholar, Department of Computer Engineering, ARMIET, Mumbai University, India 2 Principal of, S.S.J.C.O.E, Mumbai University, India ABSTRACT Now a

More information

Data Mining. Kohonen Networks. Data Mining Course: Sharif University of Technology 1

Data Mining. Kohonen Networks. Data Mining Course: Sharif University of Technology 1 Data Mining Kohonen Networks Data Mining Course: Sharif University of Technology 1 Self-Organizing Maps Kohonen Networks developed in 198 by Tuevo Kohonen Initially applied to image and sound analysis

More information

Improving interpretability in approximative fuzzy models via multi-objective evolutionary algorithms.

Improving interpretability in approximative fuzzy models via multi-objective evolutionary algorithms. Improving interpretability in approximative fuzzy models via multi-objective evolutionary algorithms. Gómez-Skarmeta, A.F. University of Murcia skarmeta@dif.um.es Jiménez, F. University of Murcia fernan@dif.um.es

More information

Self-Organizing Maps for cyclic and unbounded graphs

Self-Organizing Maps for cyclic and unbounded graphs Self-Organizing Maps for cyclic and unbounded graphs M. Hagenbuchner 1, A. Sperduti 2, A.C. Tsoi 3 1- University of Wollongong, Wollongong, Australia. 2- University of Padova, Padova, Italy. 3- Hong Kong

More information

ECM A Novel On-line, Evolving Clustering Method and Its Applications

ECM A Novel On-line, Evolving Clustering Method and Its Applications ECM A Novel On-line, Evolving Clustering Method and Its Applications Qun Song 1 and Nikola Kasabov 2 1, 2 Department of Information Science, University of Otago P.O Box 56, Dunedin, New Zealand (E-mail:

More information

Final Exam. Controller, F. Expert Sys.., Solving F. Ineq.} {Hopefield, SVM, Comptetive Learning,

Final Exam. Controller, F. Expert Sys.., Solving F. Ineq.} {Hopefield, SVM, Comptetive Learning, Final Exam Question on your Fuzzy presentation {F. Controller, F. Expert Sys.., Solving F. Ineq.} Question on your Nets Presentations {Hopefield, SVM, Comptetive Learning, Winner- take all learning for

More information

International Journal of Scientific Research & Engineering Trends Volume 4, Issue 6, Nov-Dec-2018, ISSN (Online): X

International Journal of Scientific Research & Engineering Trends Volume 4, Issue 6, Nov-Dec-2018, ISSN (Online): X Analysis about Classification Techniques on Categorical Data in Data Mining Assistant Professor P. Meena Department of Computer Science Adhiyaman Arts and Science College for Women Uthangarai, Krishnagiri,

More information

6. Dicretization methods 6.1 The purpose of discretization

6. Dicretization methods 6.1 The purpose of discretization 6. Dicretization methods 6.1 The purpose of discretization Often data are given in the form of continuous values. If their number is huge, model building for such data can be difficult. Moreover, many

More information

USING OF THE K NEAREST NEIGHBOURS ALGORITHM (k-nns) IN THE DATA CLASSIFICATION

USING OF THE K NEAREST NEIGHBOURS ALGORITHM (k-nns) IN THE DATA CLASSIFICATION USING OF THE K NEAREST NEIGHBOURS ALGORITHM (k-nns) IN THE DATA CLASSIFICATION Gîlcă Natalia, Roșia de Amaradia Technological High School, Gorj, ROMANIA Gîlcă Gheorghe, Constantin Brîncuși University from

More information

Machine Learning : Clustering, Self-Organizing Maps

Machine Learning : Clustering, Self-Organizing Maps Machine Learning Clustering, Self-Organizing Maps 12/12/2013 Machine Learning : Clustering, Self-Organizing Maps Clustering The task: partition a set of objects into meaningful subsets (clusters). The

More information

A Short Narrative on the Scope of Work Involved in Data Conditioning and Seismic Reservoir Characterization

A Short Narrative on the Scope of Work Involved in Data Conditioning and Seismic Reservoir Characterization A Short Narrative on the Scope of Work Involved in Data Conditioning and Seismic Reservoir Characterization March 18, 1999 M. Turhan (Tury) Taner, Ph.D. Chief Geophysicist Rock Solid Images 2600 South

More information

Function approximation using RBF network. 10 basis functions and 25 data points.

Function approximation using RBF network. 10 basis functions and 25 data points. 1 Function approximation using RBF network F (x j ) = m 1 w i ϕ( x j t i ) i=1 j = 1... N, m 1 = 10, N = 25 10 basis functions and 25 data points. Basis function centers are plotted with circles and data

More information

AUTOMATED STRUCTURE MAPPING OF ROCK FACES. G.V. Poropat & M.K. Elmouttie CSIRO Exploration & Mining, Brisbane, Australia

AUTOMATED STRUCTURE MAPPING OF ROCK FACES. G.V. Poropat & M.K. Elmouttie CSIRO Exploration & Mining, Brisbane, Australia AUTOMATED STRUCTURE MAPPING OF ROCK FACES G.V. Poropat & M.K. Elmouttie CSIRO Exploration & Mining, Brisbane, Australia ABSTRACT Mapping of exposed rock walls provides data on geological features such

More information

Rough Set Approach to Unsupervised Neural Network based Pattern Classifier

Rough Set Approach to Unsupervised Neural Network based Pattern Classifier Rough Set Approach to Unsupervised Neural based Pattern Classifier Ashwin Kothari, Member IAENG, Avinash Keskar, Shreesha Srinath, and Rakesh Chalsani Abstract Early Convergence, input feature space with

More information

Keywords Clustering, Goals of clustering, clustering techniques, clustering algorithms.

Keywords Clustering, Goals of clustering, clustering techniques, clustering algorithms. Volume 3, Issue 5, May 2013 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com A Survey of Clustering

More information

Fuzzy C-MeansC. By Balaji K Juby N Zacharias

Fuzzy C-MeansC. By Balaji K Juby N Zacharias Fuzzy C-MeansC By Balaji K Juby N Zacharias What is Clustering? Clustering of data is a method by which large sets of data is grouped into clusters of smaller sets of similar data. Example: The balls of

More information

EE 589 INTRODUCTION TO ARTIFICIAL NETWORK REPORT OF THE TERM PROJECT REAL TIME ODOR RECOGNATION SYSTEM FATMA ÖZYURT SANCAR

EE 589 INTRODUCTION TO ARTIFICIAL NETWORK REPORT OF THE TERM PROJECT REAL TIME ODOR RECOGNATION SYSTEM FATMA ÖZYURT SANCAR EE 589 INTRODUCTION TO ARTIFICIAL NETWORK REPORT OF THE TERM PROJECT REAL TIME ODOR RECOGNATION SYSTEM FATMA ÖZYURT SANCAR 1.Introductıon. 2.Multi Layer Perception.. 3.Fuzzy C-Means Clustering.. 4.Real

More information

Unsupervised learning

Unsupervised learning Unsupervised learning Enrique Muñoz Ballester Dipartimento di Informatica via Bramante 65, 26013 Crema (CR), Italy enrique.munoz@unimi.it Enrique Muñoz Ballester 2017 1 Download slides data and scripts:

More information

CLASSIFICATION WITH RADIAL BASIS AND PROBABILISTIC NEURAL NETWORKS

CLASSIFICATION WITH RADIAL BASIS AND PROBABILISTIC NEURAL NETWORKS CLASSIFICATION WITH RADIAL BASIS AND PROBABILISTIC NEURAL NETWORKS CHAPTER 4 CLASSIFICATION WITH RADIAL BASIS AND PROBABILISTIC NEURAL NETWORKS 4.1 Introduction Optical character recognition is one of

More information

Neural Networks. CE-725: Statistical Pattern Recognition Sharif University of Technology Spring Soleymani

Neural Networks. CE-725: Statistical Pattern Recognition Sharif University of Technology Spring Soleymani Neural Networks CE-725: Statistical Pattern Recognition Sharif University of Technology Spring 2013 Soleymani Outline Biological and artificial neural networks Feed-forward neural networks Single layer

More information

Prototype Selection for Handwritten Connected Digits Classification

Prototype Selection for Handwritten Connected Digits Classification 2009 0th International Conference on Document Analysis and Recognition Prototype Selection for Handwritten Connected Digits Classification Cristiano de Santana Pereira and George D. C. Cavalcanti 2 Federal

More information

arxiv: v1 [physics.data-an] 27 Sep 2007

arxiv: v1 [physics.data-an] 27 Sep 2007 Classification of Interest Rate Curves Using Self-Organising Maps arxiv:0709.4401v1 [physics.data-an] 27 Sep 2007 M.Kanevski a,, M.Maignan b, V.Timonin a,1, A.Pozdnoukhov a,1 a Institute of Geomatics and

More information

CHAPTER 3 TUMOR DETECTION BASED ON NEURO-FUZZY TECHNIQUE

CHAPTER 3 TUMOR DETECTION BASED ON NEURO-FUZZY TECHNIQUE 32 CHAPTER 3 TUMOR DETECTION BASED ON NEURO-FUZZY TECHNIQUE 3.1 INTRODUCTION In this chapter we present the real time implementation of an artificial neural network based on fuzzy segmentation process

More information

11/14/2010 Intelligent Systems and Soft Computing 1

11/14/2010 Intelligent Systems and Soft Computing 1 Lecture 8 Artificial neural networks: Unsupervised learning Introduction Hebbian learning Generalised Hebbian learning algorithm Competitive learning Self-organising computational map: Kohonen network

More information

An adjustable p-exponential clustering algorithm

An adjustable p-exponential clustering algorithm An adjustable p-exponential clustering algorithm Valmir Macario 12 and Francisco de A. T. de Carvalho 2 1- Universidade Federal Rural de Pernambuco - Deinfo Rua Dom Manoel de Medeiros, s/n - Campus Dois

More information

Automatic Group-Outlier Detection

Automatic Group-Outlier Detection Automatic Group-Outlier Detection Amine Chaibi and Mustapha Lebbah and Hanane Azzag LIPN-UMR 7030 Université Paris 13 - CNRS 99, av. J-B Clément - F-93430 Villetaneuse {firstname.secondname}@lipn.univ-paris13.fr

More information

PATTERN RECOGNITION USING NEURAL NETWORKS

PATTERN RECOGNITION USING NEURAL NETWORKS PATTERN RECOGNITION USING NEURAL NETWORKS Santaji Ghorpade 1, Jayshree Ghorpade 2 and Shamla Mantri 3 1 Department of Information Technology Engineering, Pune University, India santaji_11jan@yahoo.co.in,

More information

Data Mining Cluster Analysis: Advanced Concepts and Algorithms. Lecture Notes for Chapter 8. Introduction to Data Mining, 2 nd Edition

Data Mining Cluster Analysis: Advanced Concepts and Algorithms. Lecture Notes for Chapter 8. Introduction to Data Mining, 2 nd Edition Data Mining Cluster Analysis: Advanced Concepts and Algorithms Lecture Notes for Chapter 8 Introduction to Data Mining, 2 nd Edition by Tan, Steinbach, Karpatne, Kumar Outline Prototype-based Fuzzy c-means

More information

Machine Learning Reliability Techniques for Composite Materials in Structural Applications.

Machine Learning Reliability Techniques for Composite Materials in Structural Applications. Machine Learning Reliability Techniques for Composite Materials in Structural Applications. Roberto d Ippolito, Keiichi Ito, Silvia Poles, Arnaud Froidmont Noesis Solutions Optimus by Noesis Solutions

More information

Predicting Porosity through Fuzzy Logic from Well Log Data

Predicting Porosity through Fuzzy Logic from Well Log Data International Journal of Petroleum and Geoscience Engineering (IJPGE) 2 (2): 120- ISSN 2289-4713 Academic Research Online Publisher Research paper Predicting Porosity through Fuzzy Logic from Well Log

More information

Seismic regionalization based on an artificial neural network

Seismic regionalization based on an artificial neural network Seismic regionalization based on an artificial neural network *Jaime García-Pérez 1) and René Riaño 2) 1), 2) Instituto de Ingeniería, UNAM, CU, Coyoacán, México D.F., 014510, Mexico 1) jgap@pumas.ii.unam.mx

More information

Automatic Seismic Facies Classification with Kohonen Self Organizing Maps - a Tutorial

Automatic Seismic Facies Classification with Kohonen Self Organizing Maps - a Tutorial Automatic Seismic Facies Classification with Kohonen Self Organizing Maps - a Tutorial Abstract Atish Roy 1, Marcilio Matos 2, Kurt J. Marfurt 1 1 Geology and Geophysics, University of Oklahoma, Norman,

More information

Using Decision Boundary to Analyze Classifiers

Using Decision Boundary to Analyze Classifiers Using Decision Boundary to Analyze Classifiers Zhiyong Yan Congfu Xu College of Computer Science, Zhejiang University, Hangzhou, China yanzhiyong@zju.edu.cn Abstract In this paper we propose to use decision

More information

What is a receptive field? Why a sensory neuron has such particular RF How a RF was developed?

What is a receptive field? Why a sensory neuron has such particular RF How a RF was developed? What is a receptive field? Why a sensory neuron has such particular RF How a RF was developed? x 1 x 2 x 3 y f w 1 w 2 w 3 T x y = f (wx i i T ) i y x 1 x 2 x 3 = = E (y y) (y f( wx T)) 2 2 o o i i i

More information

4. Cluster Analysis. Francesc J. Ferri. Dept. d Informàtica. Universitat de València. Febrer F.J. Ferri (Univ. València) AIRF 2/ / 1

4. Cluster Analysis. Francesc J. Ferri. Dept. d Informàtica. Universitat de València. Febrer F.J. Ferri (Univ. València) AIRF 2/ / 1 Anàlisi d Imatges i Reconeixement de Formes Image Analysis and Pattern Recognition:. Cluster Analysis Francesc J. Ferri Dept. d Informàtica. Universitat de València Febrer 8 F.J. Ferri (Univ. València)

More information

Unsupervised Learning

Unsupervised Learning Networks for Pattern Recognition, 2014 Networks for Single Linkage K-Means Soft DBSCAN PCA Networks for Kohonen Maps Linear Vector Quantization Networks for Problems/Approaches in Machine Learning Supervised

More information

Equi-sized, Homogeneous Partitioning

Equi-sized, Homogeneous Partitioning Equi-sized, Homogeneous Partitioning Frank Klawonn and Frank Höppner 2 Department of Computer Science University of Applied Sciences Braunschweig /Wolfenbüttel Salzdahlumer Str 46/48 38302 Wolfenbüttel,

More information

A Survey on Image Segmentation Using Clustering Techniques

A Survey on Image Segmentation Using Clustering Techniques A Survey on Image Segmentation Using Clustering Techniques Preeti 1, Assistant Professor Kompal Ahuja 2 1,2 DCRUST, Murthal, Haryana (INDIA) Abstract: Image is information which has to be processed effectively.

More information

Preprocessing DWML, /33

Preprocessing DWML, /33 Preprocessing DWML, 2007 1/33 Preprocessing Before you can start on the actual data mining, the data may require some preprocessing: Attributes may be redundant. Values may be missing. The data contains

More information

Semi-Supervised Clustering with Partial Background Information

Semi-Supervised Clustering with Partial Background Information Semi-Supervised Clustering with Partial Background Information Jing Gao Pang-Ning Tan Haibin Cheng Abstract Incorporating background knowledge into unsupervised clustering algorithms has been the subject

More information

Fluid flow modelling with seismic cluster analysis

Fluid flow modelling with seismic cluster analysis Fluid flow modelling with seismic cluster analysis Fluid flow modelling with seismic cluster analysis Laurence R. Bentley, Xuri Huang 1 and Claude Laflamme 2 ABSTRACT Cluster analysis is used to construct

More information

Research on Applications of Data Mining in Electronic Commerce. Xiuping YANG 1, a

Research on Applications of Data Mining in Electronic Commerce. Xiuping YANG 1, a International Conference on Education Technology, Management and Humanities Science (ETMHS 2015) Research on Applications of Data Mining in Electronic Commerce Xiuping YANG 1, a 1 Computer Science Department,

More information

An Improvement of Centroid-Based Classification Algorithm for Text Classification

An Improvement of Centroid-Based Classification Algorithm for Text Classification An Improvement of Centroid-Based Classification Algorithm for Text Classification Zehra Cataltepe, Eser Aygun Istanbul Technical Un. Computer Engineering Dept. Ayazaga, Sariyer, Istanbul, Turkey cataltepe@itu.edu.tr,

More information

MURDOCH RESEARCH REPOSITORY

MURDOCH RESEARCH REPOSITORY MURDOCH RESEARCH REPOSITORY http://dx.doi.org/10.1109/19.668276 Fung, C.C., Wong, K.W. and Eren, H. (1997) Modular artificial neural network for prediction of petrophysical properties from well log data.

More information

Analyzing Outlier Detection Techniques with Hybrid Method

Analyzing Outlier Detection Techniques with Hybrid Method Analyzing Outlier Detection Techniques with Hybrid Method Shruti Aggarwal Assistant Professor Department of Computer Science and Engineering Sri Guru Granth Sahib World University. (SGGSWU) Fatehgarh Sahib,

More information

CHAPTER 8 COMPOUND CHARACTER RECOGNITION USING VARIOUS MODELS

CHAPTER 8 COMPOUND CHARACTER RECOGNITION USING VARIOUS MODELS CHAPTER 8 COMPOUND CHARACTER RECOGNITION USING VARIOUS MODELS 8.1 Introduction The recognition systems developed so far were for simple characters comprising of consonants and vowels. But there is one

More information

The k-means Algorithm and Genetic Algorithm

The k-means Algorithm and Genetic Algorithm The k-means Algorithm and Genetic Algorithm k-means algorithm Genetic algorithm Rough set approach Fuzzy set approaches Chapter 8 2 The K-Means Algorithm The K-Means algorithm is a simple yet effective

More information

Analytical model A structure and process for analyzing a dataset. For example, a decision tree is a model for the classification of a dataset.

Analytical model A structure and process for analyzing a dataset. For example, a decision tree is a model for the classification of a dataset. Glossary of data mining terms: Accuracy Accuracy is an important factor in assessing the success of data mining. When applied to data, accuracy refers to the rate of correct values in the data. When applied

More information

INTERNATIONAL RESEARCH JOURNAL OF MULTIDISCIPLINARY STUDIES

INTERNATIONAL RESEARCH JOURNAL OF MULTIDISCIPLINARY STUDIES STUDIES & SPPP's, Karmayogi Engineering College, Pandharpur Organize National Conference Special Issue March 2016 Neuro-Fuzzy System based Handwritten Marathi System Numerals Recognition 1 Jayashri H Patil(Madane),

More information

University of Florida CISE department Gator Engineering. Clustering Part 5

University of Florida CISE department Gator Engineering. Clustering Part 5 Clustering Part 5 Dr. Sanjay Ranka Professor Computer and Information Science and Engineering University of Florida, Gainesville SNN Approach to Clustering Ordinary distance measures have problems Euclidean

More information

A new hybrid fusion method for diagnostic systems

A new hybrid fusion method for diagnostic systems A new hybrid fusion method for diagnostic systems Zemirline A. ITI Department ENST Bretagne 29285 Brest, France LATIM, INSERM-U650 abdelhamid.zemirline@enstbretagne.fr Lecornu L. ITI Department ENST Bretagne

More information

COMPUTATIONAL NEURAL NETWORKS FOR GEOPHYSICAL DATA PROCESSING

COMPUTATIONAL NEURAL NETWORKS FOR GEOPHYSICAL DATA PROCESSING SEISMIC EXPLORATION Volume 30 COMPUTATIONAL NEURAL NETWORKS FOR GEOPHYSICAL DATA PROCESSING edited by Mary M. POULTON Department of Mining & Geological Engineering Computational Intelligence & Visualization

More information

Unsupervised Learning

Unsupervised Learning Unsupervised Learning Unsupervised learning Until now, we have assumed our training samples are labeled by their category membership. Methods that use labeled samples are said to be supervised. However,

More information

Performance Measure of Hard c-means,fuzzy c-means and Alternative c-means Algorithms

Performance Measure of Hard c-means,fuzzy c-means and Alternative c-means Algorithms Performance Measure of Hard c-means,fuzzy c-means and Alternative c-means Algorithms Binoda Nand Prasad*, Mohit Rathore**, Geeta Gupta***, Tarandeep Singh**** *Guru Gobind Singh Indraprastha University,

More information

Efficient Object Extraction Using Fuzzy Cardinality Based Thresholding and Hopfield Network

Efficient Object Extraction Using Fuzzy Cardinality Based Thresholding and Hopfield Network Efficient Object Extraction Using Fuzzy Cardinality Based Thresholding and Hopfield Network S. Bhattacharyya U. Maulik S. Bandyopadhyay Dept. of Information Technology Dept. of Comp. Sc. and Tech. Machine

More information

Methods for Intelligent Systems

Methods for Intelligent Systems Methods for Intelligent Systems Lecture Notes on Clustering (II) Davide Eynard eynard@elet.polimi.it Department of Electronics and Information Politecnico di Milano Davide Eynard - Lecture Notes on Clustering

More information

CS6220: DATA MINING TECHNIQUES

CS6220: DATA MINING TECHNIQUES CS6220: DATA MINING TECHNIQUES Image Data: Classification via Neural Networks Instructor: Yizhou Sun yzsun@ccs.neu.edu November 19, 2015 Methods to Learn Classification Clustering Frequent Pattern Mining

More information

A Topography-Preserving Latent Variable Model with Learning Metrics

A Topography-Preserving Latent Variable Model with Learning Metrics A Topography-Preserving Latent Variable Model with Learning Metrics Samuel Kaski and Janne Sinkkonen Helsinki University of Technology Neural Networks Research Centre P.O. Box 5400, FIN-02015 HUT, Finland

More information

Images Reconstruction using an iterative SOM based algorithm.

Images Reconstruction using an iterative SOM based algorithm. Images Reconstruction using an iterative SOM based algorithm. M.Jouini 1, S.Thiria 2 and M.Crépon 3 * 1- LOCEAN, MMSA team, CNAM University, Paris, France 2- LOCEAN, MMSA team, UVSQ University Paris, France

More information

HFCT: A Hybrid Fuzzy Clustering Method for Collaborative Tagging

HFCT: A Hybrid Fuzzy Clustering Method for Collaborative Tagging 007 International Conference on Convergence Information Technology HFCT: A Hybrid Fuzzy Clustering Method for Collaborative Tagging Lixin Han,, Guihai Chen Department of Computer Science and Engineering,

More information

Motion Detection. Final project by. Neta Sokolovsky

Motion Detection. Final project by. Neta Sokolovsky Motion Detection Final project by Neta Sokolovsky Introduction The goal of this project is to recognize a motion of objects found in the two given images. This functionality is useful in the video processing

More information

9. Lecture Neural Networks

9. Lecture Neural Networks Soft Control (AT 3, RMA) 9. Lecture Neural Networks Application in Automation Engineering Outline of the lecture 1. Introduction to Soft Control: definition and limitations, basics of "smart" systems 2.

More information

CHAPTER 3 A FAST K-MODES CLUSTERING ALGORITHM TO WAREHOUSE VERY LARGE HETEROGENEOUS MEDICAL DATABASES

CHAPTER 3 A FAST K-MODES CLUSTERING ALGORITHM TO WAREHOUSE VERY LARGE HETEROGENEOUS MEDICAL DATABASES 70 CHAPTER 3 A FAST K-MODES CLUSTERING ALGORITHM TO WAREHOUSE VERY LARGE HETEROGENEOUS MEDICAL DATABASES 3.1 INTRODUCTION In medical science, effective tools are essential to categorize and systematically

More information

Collaborative Rough Clustering

Collaborative Rough Clustering Collaborative Rough Clustering Sushmita Mitra, Haider Banka, and Witold Pedrycz Machine Intelligence Unit, Indian Statistical Institute, Kolkata, India {sushmita, hbanka r}@isical.ac.in Dept. of Electrical

More information

Application of genetic algorithms and Kohonen networks to cluster analysis

Application of genetic algorithms and Kohonen networks to cluster analysis Application of genetic algorithms and Kohonen networks to cluster analysis Marian B. Gorza lczany and Filip Rudziński Department of Electrical and Computer Engineering Kielce University of Technology Al.

More information

Data Mining. Moustafa ElBadry. A thesis submitted in fulfillment of the requirements for the degree of Bachelor of Arts in Mathematics

Data Mining. Moustafa ElBadry. A thesis submitted in fulfillment of the requirements for the degree of Bachelor of Arts in Mathematics Data Mining Moustafa ElBadry A thesis submitted in fulfillment of the requirements for the degree of Bachelor of Arts in Mathematics Department of Mathematics and Computer Science Whitman College 2016

More information

Multiple Classifier Fusion using k-nearest Localized Templates

Multiple Classifier Fusion using k-nearest Localized Templates Multiple Classifier Fusion using k-nearest Localized Templates Jun-Ki Min and Sung-Bae Cho Department of Computer Science, Yonsei University Biometrics Engineering Research Center 134 Shinchon-dong, Sudaemoon-ku,

More information

CAD SYSTEM FOR AUTOMATIC DETECTION OF BRAIN TUMOR THROUGH MRI BRAIN TUMOR DETECTION USING HPACO CHAPTER V BRAIN TUMOR DETECTION USING HPACO

CAD SYSTEM FOR AUTOMATIC DETECTION OF BRAIN TUMOR THROUGH MRI BRAIN TUMOR DETECTION USING HPACO CHAPTER V BRAIN TUMOR DETECTION USING HPACO CHAPTER V BRAIN TUMOR DETECTION USING HPACO 145 CHAPTER 5 DETECTION OF BRAIN TUMOR REGION USING HYBRID PARALLEL ANT COLONY OPTIMIZATION (HPACO) WITH FCM (FUZZY C MEANS) 5.1 PREFACE The Segmentation of

More information

Customer Clustering using RFM analysis

Customer Clustering using RFM analysis Customer Clustering using RFM analysis VASILIS AGGELIS WINBANK PIRAEUS BANK Athens GREECE AggelisV@winbank.gr DIMITRIS CHRISTODOULAKIS Computer Engineering and Informatics Department University of Patras

More information

Keywords - Fuzzy rule-based systems, clustering, system design

Keywords - Fuzzy rule-based systems, clustering, system design CHAPTER 7 Application of Fuzzy Rule Base Design Method Peter Grabusts In many classification tasks the final goal is usually to determine classes of objects. The final goal of fuzzy clustering is also

More information

Machine-learning Based Automated Fault Detection in Seismic Traces

Machine-learning Based Automated Fault Detection in Seismic Traces Machine-learning Based Automated Fault Detection in Seismic Traces Chiyuan Zhang and Charlie Frogner (MIT), Mauricio Araya-Polo and Detlef Hohl (Shell International E & P Inc.) June 9, 24 Introduction

More information

Clustering with Reinforcement Learning

Clustering with Reinforcement Learning Clustering with Reinforcement Learning Wesam Barbakh and Colin Fyfe, The University of Paisley, Scotland. email:wesam.barbakh,colin.fyfe@paisley.ac.uk Abstract We show how a previously derived method of

More information

A Fuzzy C-means Clustering Algorithm Based on Pseudo-nearest-neighbor Intervals for Incomplete Data

A Fuzzy C-means Clustering Algorithm Based on Pseudo-nearest-neighbor Intervals for Incomplete Data Journal of Computational Information Systems 11: 6 (2015) 2139 2146 Available at http://www.jofcis.com A Fuzzy C-means Clustering Algorithm Based on Pseudo-nearest-neighbor Intervals for Incomplete Data

More information

AN IMPROVED MULTI-SOM ALGORITHM

AN IMPROVED MULTI-SOM ALGORITHM AN IMPROVED MULTI-SOM ALGORITHM ABSTRACT Imen Khanchouch 1, Khaddouja Boujenfa 2 and Mohamed Limam 3 1 LARODEC ISG, University of Tunis kh.imen88@gmail.com 2 LARODEC ISG, University of Tunis khadouja.boujenfa@isg.rnu.tn

More information

Keywords Fuzzy, Set Theory, KDD, Data Base, Transformed Database.

Keywords Fuzzy, Set Theory, KDD, Data Base, Transformed Database. Volume 6, Issue 5, May 016 ISSN: 77 18X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Fuzzy Logic in Online

More information

Modification of the Growing Neural Gas Algorithm for Cluster Analysis

Modification of the Growing Neural Gas Algorithm for Cluster Analysis Modification of the Growing Neural Gas Algorithm for Cluster Analysis Fernando Canales and Max Chacón Universidad de Santiago de Chile; Depto. de Ingeniería Informática, Avda. Ecuador No 3659 - PoBox 10233;

More information

International Journal of Mechatronics, Electrical and Computer Technology

International Journal of Mechatronics, Electrical and Computer Technology Identification of Mazandaran Telecommunication Company Fixed phone subscribers using H-Means and W-K-Means Algorithm Abstract Yaser Babagoli Ahangar 1*, Homayon Motameni 2 and Ramzanali Abasnejad Varzi

More information

Extract an Essential Skeleton of a Character as a Graph from a Character Image

Extract an Essential Skeleton of a Character as a Graph from a Character Image Extract an Essential Skeleton of a Character as a Graph from a Character Image Kazuhisa Fujita University of Electro-Communications 1-5-1 Chofugaoka, Chofu, Tokyo, 182-8585 Japan k-z@nerve.pc.uec.ac.jp

More information

A NEW ALGORITHM FOR OPTIMIZING THE SELF- ORGANIZING MAP

A NEW ALGORITHM FOR OPTIMIZING THE SELF- ORGANIZING MAP A NEW ALGORITHM FOR OPTIMIZING THE SELF- ORGANIZING MAP BEN-HDECH Adil, GHANOU Youssef, EL QADI Abderrahim Team TIM, High School of Technology, Moulay Ismail University, Meknes, Morocco E-mail: adilbenhdech@gmail.com,

More information

A Fuzzy Rule Based Clustering

A Fuzzy Rule Based Clustering A Fuzzy Rule Based Clustering Sachin Ashok Shinde 1, Asst.Prof.Y.R.Nagargoje 2 Student, Computer Science & Engineering Department, Everest College of Engineering, Aurangabad, India 1 Asst.Prof, Computer

More information

International Journal Of Engineering And Computer Science ISSN: Volume 5 Issue 11 Nov. 2016, Page No.

International Journal Of Engineering And Computer Science ISSN: Volume 5 Issue 11 Nov. 2016, Page No. www.ijecs.in International Journal Of Engineering And Computer Science ISSN: 2319-7242 Volume 5 Issue 11 Nov. 2016, Page No. 19054-19062 Review on K-Mode Clustering Antara Prakash, Simran Kalera, Archisha

More information

Web page recommendation using a stochastic process model

Web page recommendation using a stochastic process model Data Mining VII: Data, Text and Web Mining and their Business Applications 233 Web page recommendation using a stochastic process model B. J. Park 1, W. Choi 1 & S. H. Noh 2 1 Computer Science Department,

More information

Chapter 4 Fuzzy Logic

Chapter 4 Fuzzy Logic 4.1 Introduction Chapter 4 Fuzzy Logic The human brain interprets the sensory information provided by organs. Fuzzy set theory focus on processing the information. Numerical computation can be performed

More information

Nonlinear dimensionality reduction of large datasets for data exploration

Nonlinear dimensionality reduction of large datasets for data exploration Data Mining VII: Data, Text and Web Mining and their Business Applications 3 Nonlinear dimensionality reduction of large datasets for data exploration V. Tomenko & V. Popov Wessex Institute of Technology,

More information

Knowledge Discovery. Javier Béjar URL - Spring 2019 CS - MIA

Knowledge Discovery. Javier Béjar URL - Spring 2019 CS - MIA Knowledge Discovery Javier Béjar URL - Spring 2019 CS - MIA Knowledge Discovery (KDD) Knowledge Discovery in Databases (KDD) Practical application of the methodologies from machine learning/statistics

More information

Selection of n in K-Means Algorithm

Selection of n in K-Means Algorithm International Journal of Information & Computation Technology. ISSN 0974-2239 Volume 4, Number 6 (2014), pp. 577-582 International Research Publications House http://www. irphouse.com Selection of n in

More information

Slide07 Haykin Chapter 9: Self-Organizing Maps

Slide07 Haykin Chapter 9: Self-Organizing Maps Slide07 Haykin Chapter 9: Self-Organizing Maps CPSC 636-600 Instructor: Yoonsuck Choe Spring 2012 Introduction Self-organizing maps (SOM) is based on competitive learning, where output neurons compete

More information

Supervised vs.unsupervised Learning

Supervised vs.unsupervised Learning Supervised vs.unsupervised Learning In supervised learning we train algorithms with predefined concepts and functions based on labeled data D = { ( x, y ) x X, y {yes,no}. In unsupervised learning we are

More information

Well Analysis: Program psvm_welllogs

Well Analysis: Program psvm_welllogs Proximal Support Vector Machine Classification on Well Logs Overview Support vector machine (SVM) is a recent supervised machine learning technique that is widely used in text detection, image recognition

More information

Cluster Analysis using Spherical SOM

Cluster Analysis using Spherical SOM Cluster Analysis using Spherical SOM H. Tokutaka 1, P.K. Kihato 2, K. Fujimura 2 and M. Ohkita 2 1) SOM Japan Co-LTD, 2) Electrical and Electronic Department, Tottori University Email: {tokutaka@somj.com,

More information