! Introduction. ! Partitioning methods. ! Hierarchical methods. ! Model-based methods. ! Density-based methods. ! Scalability
|
|
- Griffin Carson
- 5 years ago
- Views:
Transcription
1 Preview Lecture Clustering! Introduction! Partitioning methods! Hierarchical methods! Model-based methods! Densit-based methods What is Clustering?! Cluster: a collection of data objects! Similar to one another within the same cluster! Dissimilar to the objects in other clusters! Cluster analsis! Grouping a set of data objects into clusters! Clustering is unsupervised classification: no predefined classes! Tpical applications! As a stand-alone tool to get insight into data distribution! As a preprocessing step for other algorithms Eamples of Clustering Applications! Marketing: Help marketers discover distinct groups in their customer bases, and then use this knowledge to develop targeted marketing programs! Land use: Identification of areas of similar land use in an earth observation database! Insurance: Identifing groups of motor insurance polic holders with a high average claim cost! Urban planning: Identifing groups of houses according to their house tpe, value, and geographical location! Seismolog: Observed earth quake epicenters should be clustered along continent faults What Is a Good Clustering?! A good clustering method will produce clusters with! High intra-class similarit! Low inter-class similarit! Precise definition of clustering qualit is difficult! Application-dependent! Ultimatel subjective Requirements for Clustering in Data Mining! Scalabilit! Abilit to deal with different tpes of attributes! Discover of clusters with arbitrar shape! Minimal domain knowledge required to determine input parameters! Abilit to deal with noise and outliers! Insensitivit to order of input records! Robustness wrt high dimensionalit! Incorporation of user-specified constraints! Interpretabilit and usabilit
2 Similarit and Dissimilarit Between Objects! Same we used for IBL (e.g, Lp norm)! Euclidean distance (p = ): d( i, j) = ( ) i j i j ip jp! Properties of a metric d(i,j):! d(i,j)! d(i,i) =! d(i,j) = d(j,i)! d(i,j) d(i,k) + d(k,j) Major Clustering Approaches! Partitioning: Construct various partitions and then evaluate them b some criterion! Hierarchical: Create a hierarchical decomposition of the set of objects using some criterion! Model-based: Hpothesize a model for each cluster and find best fit of models to data! Densit-based: Guided b connectivit and densit functions Partitioning Algorithms! Partitioning method: Construct a partition of a database D of n objects into a set of k clusters! Given a k, find a partition of k clusters that optimizes the chosen partitioning criterion! Global optimal: ehaustivel enumerate all partitions! Heuristic methods: k-means and k-medoids algorithms! k-means (MacQueen, ): Each cluster is represented b the center of the cluster! k-medoids or PAM (Partition around medoids) (Kaufman & Rousseeuw, ): Each cluster is represented b one of the objects in the cluster K-Means Clustering! Given k, the k-means algorithm consists of four steps:! Select initial centroids at random.! Assign each object to the cluster with the nearest centroid.! Compute each centroid as the mean of the objects assigned to it.! Repeat previous steps until no change. K-Means Clustering (contd.) Comments on the K-Means Method! Eample! Strengths! Relativel efficient: O(tkn), where n is # objects, k is # clusters, and t is # iterations. Normall, k, t << n.! Often terminates at a local optimum. The global optimum ma be found using techniques such as simulated annealing and genetic algorithms! Weaknesses! Applicable onl when mean is defined (what about categorical data?)! Need to specif k, the number of clusters, in advance! Trouble with nois data and outliers! Not suitable to discover clusters with non-conve shapes
3 Hierarchical Clustering AGNES (Agglomerative Nesting)! Use distance matri as clustering criteria. This method does not require the number of clusters k as an input, but needs a termination condition Step Step Step Step Step a b c d e ab de cde abcde Step Step Step Step Step agglomerative (AGNES) divisive (DIANA)! Produces tree of clusters (nodes)! Initiall: each object is a cluster (leaf)! Recursivel merges nodes that have the least dissimilarit! Criteria: min distance, ma distance, avg distance, center distance! Eventuall all nodes belong to the same cluster (root) A Dendrogram Shows How the Clusters are Merged Hierarchicall DIANA (Divisive Analsis) Decompose data objects into several levels of nested partitioning (tree of clusters), called a dendrogram. A clustering ofthedataobjectsisobtainedbcuttingthe dendrogram at the desired level. Then each connected component forms a cluster.! Inverse order of AGNES! Start with root cluster containing all objects! Recursivel divide into subclusters! Eventuall each cluster contains a single object Other Hierarchical Clustering Methods BIRCH! Major weakness of agglomerative clustering methods! Do not scale well: time compleit of at least O(n ), where n is the number of total objects! Can never undo what was done previousl! Integration of hierarchical with distance-based clustering! BIRCH: uses CF-tree and incrementall adjusts the qualit of sub-clusters! CURE: selects well-scattered points from the cluster and then shrinks them towards the center of the cluster b a specified fraction! BIRCH: Balanced Iterative Reducing and Clustering using Hierarchies (Zhang, Ramakrishnan & Livn, )! Incrementall construct a CF (Clustering Feature) tree! Parameters: ma diameter, ma children! Phase : scan DB to build an initial in-memor CF tree (each node: #points, sum, sum of squares)! Phase : use an arbitrar clustering algorithm to cluster the leaf nodes of the CF-tree! Scales linearl: finds a good clustering with a single scan and improves the qualit with a few additional scans! Weaknesses: handles onl numeric data, sensitive to order of data records.
4 Clustering Feature Vector Clustering Feature: CF = (N, LS, SS) N: Number of data points LS: N i= X i SS: N i= X i CF = (, (,),(,)) (,) (,) (,) (,) (,) B= L= CF Tree Root CF CF CF CF child child child child Non-leaf node CF child CF child CF child CF child Leaf node Leaf node prev CF CF CF net prev CF CF CF net CURE (Clustering Using REpresentatives) Drawbacks of Distance-Based Method! CURE: non-spherical clusters, robust wrt outliers! Uses multiple representative points to evaluate the distance between clusters! Stops the creation of a cluster hierarch if a level consists of k clusters! Drawbacks of square-error-based clustering method! Consider onl one point as representative of a cluster! Good onl for conve clusters, of similar size and densit, and if k can be reasonabl estimated Cure: The Algorithm Data Partitioning and Clustering! Draw random sample s! Partition sample to p partitions with size s/p! Partiall cluster partitions into s/pq clusters! s =! p =! s/p =!s/pq =! Cluster partial clusters, shrinking representatives towards centroid! Label data on disk
5 Cure: Shrinking Representative Points Model-Based Clustering! Shrink the multiple representative points towards the gravit center b a fraction of α.! Multiple representatives capture the shape of the cluster! Basic idea: Clustering as probabilit estimation! One model for each cluster! Generative model:! Probabilit of selecting a cluster! Probabilit of generating an object in cluster! Find ma. likelihood or MAP model! Missing information: Cluster membership! Use EM algorithm! Qualit of clustering: Likelihood of test objects Mitures of Gaussians EM Algorithm for Mitures! Cluster model: Normal distribution (mean, covariance)! Assume: diagonal covariance, known variance, same for all clusters! Ma. likelihood: mean = avg. of samples! But what points are samples of a given cluster?! Estimate prob. that point belongs to cluster! Mean = weighted avg. of points, weight = prob.! But to estimate probs. we need model! Chicken and egg problem: use EM algorithm! Initialization: Choose means at random! E step:! For all points and means, compute Prob(point mean)! Prob(mean point) = Prob(mean) Prob(point mean) / Prob(point)! M step:! Each mean = Weighted avg. of points! Weight = Prob(mean point)! Repeat until convergence EM Algorithm (contd.) AutoClass! Guaranteed to converge to local optimum! K-means is special case! Developed at NASA (Cheeseman & Stutz, )! Miture of Naïve Baes models! Variet of possible models for Prob(attribute class)! Missing information: Class of each eample! Appl EM algorithm as before! Special case of learning Baes net with missing values! Widel used in practice
6 COBWEB A COBWEB Tree! Grows tree of clusters (Fisher, )! Each node contains: P(cluster), P(attribute cluster) for each attribute! Objects presented sequentiall! Options: Add to node, new node; merge, split! Qualit measure: Categor utilit: Increase in predictabilit of attributes/#clusters Neural Network Approaches Competitive Learning! Neuron = Cluster = Centroid in instance space! Laer = Level of hierarch! Several competing sets of clusters in each laer! Objects sequentiall presented to network! Within each set, neurons compete to win object! Winning neuron is moved towards object! Can be viewed as mapping from low-level features to high-level ones Self-Organizing Feature Maps! Clustering is also performed b having several units competing for the current object! The unit whose weight vector is closest to the current object wins! The winner and its neighbors learn b having their weights adjusted! SOMs are believed to resemble processing that can occur in the brain! Useful for visualizing high-dimensional data in - or -D space Densit-Based Clustering! Clustering based on densit (local cluster criterion), such as densit-connected points! Major features:! Discover clusters of arbitrar shape! Handle noise! One scan! Need densit parameters as termination condition! Representative algorithms:! DBSCAN (Ester et al., )! DENCLUE (Hinneburg & Keim, )
7 Definitions (I) Definitions (II)! Two parameters:! Eps: Maimum radius of neighborhood! MinPts: Minimum number of points in an Epsneighborhood of a point! N Eps (p) ={q Є D dist(p,q) <= Eps}! Directl densit-reachable: A point p is directl densitreachable from a point q wrt. Eps, MinPts iff! ) p belongs to N Eps (q)! ) q is a core point: p MinPts = q N Eps (q) >= MinPts Eps = cm! Densit-reachable:! A point p is densit-reachable from a point q wrt. Eps, MinPts if there is a chain of points p,, p n, p = q, p n = p such that p i+ is directl densit-reachable from p i! Densit-connected! A point p is densit-connected to a point q wrt. Eps, MinPts if there is a point o such that both, p and q are densit-reachable from o wrt. Eps and MinPts. p q o p p q DBSCAN: Densit Based Spatial Clustering of Applications with Noise DBSCAN: The Algorithm! Relies on a densit-based notion of cluster: A cluster is defined as a maimal set of densit-connected points! Discovers clusters of arbitrar shape in spatial databases with noise! Arbitraril select a point p! Retrieve all points densit-reachable from p wrt Eps and MinPts. Border Core Outlier Eps = cm MinPts =! If p is a core point, a cluster is formed.! If p is a border point, no points are densit-reachable from p and DBSCAN visits the net point of the database.! Continue the process until all of the points have been processed. DENCLUE: Using Densit Functions DENCLUE! DENsit-based CLUstEring (Hinneburg & Keim, )! Major features! Good for data sets with large amounts of noise! Allows a compact mathematical description of arbitraril shaped clusters in high-dimensional data sets! Significantl faster than other algorithms (faster than DBSCAN b a factor of up to )! But needs a large number of parameters! Uses grid cells but onl keeps information about grid cells that do actuall contain data points and manages these cells in a tree-based access structure.! Influence function: describes the impact of a data point within its neighborhood.! Overall densit of the data space can be calculated as the sum of the influence function of all data points.! Clusters can be determined mathematicall b identifing densit attractors.! Densit attractors are local maima of the overall densit function.
8 Influence Functions Densit Attractors! Eample f (, ) e d (, i ) N D σ Gaussian ( ) = i = e d (, i ) N D σ fgaussian(, i ) = = ( i i ) e f Gaussian d(, ) = σ Center-Defined & Arbitrar Clusters Clustering: Summar! Introduction! Partitioning methods! Hierarchical methods! Model-based methods! Densit-based methods
Clustering Techniques
Clustering Techniques Marco BOTTA Dipartimento di Informatica Università di Torino botta@di.unito.it www.di.unito.it/~botta/didattica/clustering.html Data Clustering Outline What is cluster analysis? What
More informationLecture 7 Cluster Analysis: Part A
Lecture 7 Cluster Analysis: Part A Zhou Shuigeng May 7, 2007 2007-6-23 Data Mining: Tech. & Appl. 1 Outline What is Cluster Analysis? Types of Data in Cluster Analysis A Categorization of Major Clustering
More informationClustering part II 1
Clustering part II 1 Clustering What is Cluster Analysis? Types of Data in Cluster Analysis A Categorization of Major Clustering Methods Partitioning Methods Hierarchical Methods 2 Partitioning Algorithms:
More informationNotes. Reminder: HW2 Due Today by 11:59PM. Review session on Thursday. Midterm next Tuesday (10/10/2017)
1 Notes Reminder: HW2 Due Today by 11:59PM TA s note: Please provide a detailed ReadMe.txt file on how to run the program on the STDLINUX. If you installed/upgraded any package on STDLINUX, you should
More informationData Mining: Concepts and Techniques. Chapter March 8, 2007 Data Mining: Concepts and Techniques 1
Data Mining: Concepts and Techniques Chapter 7.1-4 March 8, 2007 Data Mining: Concepts and Techniques 1 1. What is Cluster Analysis? 2. Types of Data in Cluster Analysis Chapter 7 Cluster Analysis 3. A
More informationPAM algorithm. Types of Data in Cluster Analysis. A Categorization of Major Clustering Methods. Partitioning i Methods. Hierarchical Methods
Whatis Cluster Analysis? Clustering Types of Data in Cluster Analysis Clustering part II A Categorization of Major Clustering Methods Partitioning i Methods Hierarchical Methods Partitioning i i Algorithms:
More informationWhat is Cluster Analysis? COMP 465: Data Mining Clustering Basics. Applications of Cluster Analysis. Clustering: Application Examples 3/17/2015
// What is Cluster Analysis? COMP : Data Mining Clustering Basics Slides Adapted From : Jiawei Han, Micheline Kamber & Jian Pei Data Mining: Concepts and Techniques, rd ed. Cluster: A collection of data
More informationUnsupervised Learning. Andrea G. B. Tettamanzi I3S Laboratory SPARKS Team
Unsupervised Learning Andrea G. B. Tettamanzi I3S Laboratory SPARKS Team Table of Contents 1)Clustering: Introduction and Basic Concepts 2)An Overview of Popular Clustering Methods 3)Other Unsupervised
More informationd(2,1) d(3,1 ) d (3,2) 0 ( n, ) ( n ,2)......
Data Mining i Topic: Clustering CSEE Department, e t, UMBC Some of the slides used in this presentation are prepared by Jiawei Han and Micheline Kamber Cluster Analysis What is Cluster Analysis? Types
More informationData Mining: Concepts and Techniques. Chapter 7 Jiawei Han. University of Illinois at Urbana-Champaign. Department of Computer Science
Data Mining: Concepts and Techniques Chapter 7 Jiawei Han Department of Computer Science University of Illinois at Urbana-Champaign www.cs.uiuc.edu/~hanj 6 Jiawei Han and Micheline Kamber, All rights reserved
More informationUNIT V CLUSTERING, APPLICATIONS AND TRENDS IN DATA MINING. Clustering is unsupervised classification: no predefined classes
UNIT V CLUSTERING, APPLICATIONS AND TRENDS IN DATA MINING What is Cluster Analysis? Cluster: a collection of data objects Similar to one another within the same cluster Dissimilar to the objects in other
More informationHierarchy. No or very little supervision Some heuristic quality guidances on the quality of the hierarchy. Jian Pei: CMPT 459/741 Clustering (2) 1
Hierarchy An arrangement or classification of things according to inclusiveness A natural way of abstraction, summarization, compression, and simplification for understanding Typical setting: organize
More informationClustering in Data Mining
Clustering in Data Mining Classification Vs Clustering When the distribution is based on a single parameter and that parameter is known for each object, it is called classification. E.g. Children, young,
More informationClustering Part 4 DBSCAN
Clustering Part 4 Dr. Sanjay Ranka Professor Computer and Information Science and Engineering University of Florida, Gainesville DBSCAN DBSCAN is a density based clustering algorithm Density = number of
More informationCS Data Mining Techniques Instructor: Abdullah Mueen
CS 591.03 Data Mining Techniques Instructor: Abdullah Mueen LECTURE 6: BASIC CLUSTERING Chapter 10. Cluster Analysis: Basic Concepts and Methods Cluster Analysis: Basic Concepts Partitioning Methods Hierarchical
More informationBig Data Analytics! Special Topics for Computer Science CSE CSE Feb 9
Big Data Analytics! Special Topics for Computer Science CSE 4095-001 CSE 5095-005! Feb 9 Fei Wang Associate Professor Department of Computer Science and Engineering fei_wang@uconn.edu Clustering I What
More informationUniversity of Florida CISE department Gator Engineering. Clustering Part 4
Clustering Part 4 Dr. Sanjay Ranka Professor Computer and Information Science and Engineering University of Florida, Gainesville DBSCAN DBSCAN is a density based clustering algorithm Density = number of
More informationCS145: INTRODUCTION TO DATA MINING
CS145: INTRODUCTION TO DATA MINING 09: Vector Data: Clustering Basics Instructor: Yizhou Sun yzsun@cs.ucla.edu October 27, 2017 Methods to Learn Vector Data Set Data Sequence Data Text Data Classification
More informationCluster Analysis. CSE634 Data Mining
Cluster Analysis CSE634 Data Mining Agenda Introduction Clustering Requirements Data Representation Partitioning Methods K-Means Clustering K-Medoids Clustering Constrained K-Means clustering Introduction
More informationLezione 21 CLUSTER ANALYSIS
Lezione 21 CLUSTER ANALYSIS 1 Cluster Analysis What is Cluster Analysis? Types of Data in Cluster Analysis A Categorization of Major Clustering Methods Partitioning Methods Hierarchical Methods Density-Based
More informationCSE 5243 INTRO. TO DATA MINING
CSE 5243 INTRO. TO DATA MINING Cluster Analysis: Basic Concepts and Methods Huan Sun, CSE@The Ohio State University 09/28/2017 Slides adapted from UIUC CS412, Fall 2017, by Prof. Jiawei Han 2 Chapter 10.
More informationUnsupervised Learning. Supervised learning vs. unsupervised learning. What is Cluster Analysis? Applications of Cluster Analysis
7 Supervised learning vs unsupervised learning Unsupervised Learning Supervised learning: discover patterns in the data that relate data attributes with a target (class) attribute These patterns are then
More informationLecture 3 Clustering. January 21, 2003 Data Mining: Concepts and Techniques 1
Lecture 3 Clustering January 21, 2003 Data Mining: Concepts and Techniques 1 What is Cluster Analysis? Cluster: a collection of data objects High intra-class similarity Low inter-class similarity How to
More informationKnowledge Discovery in Databases
Ludwig-Maximilians-Universität München Institut für Informatik Lehr- und Forschungseinheit für Datenbanksysteme Lecture notes Knowledge Discovery in Databases Summer Semester 2012 Lecture 8: Clustering
More informationUnsupervised Learning
Outline Unsupervised Learning Basic concepts K-means algorithm Representation of clusters Hierarchical clustering Distance functions Which clustering algorithm to use? NN Supervised learning vs. unsupervised
More informationData Mining Algorithms
for the original version: -JörgSander and Martin Ester - Jiawei Han and Micheline Kamber Data Management and Exploration Prof. Dr. Thomas Seidl Data Mining Algorithms Lecture Course with Tutorials Wintersemester
More informationCS490D: Introduction to Data Mining Prof. Chris Clifton. Cluster Analysis
CS490D: Introduction to Data Mining Prof. Chris Clifton February, 004 Clustering Cluster Analysis What is Cluster Analysis? Types of Data in Cluster Analysis A Categorization of Major Clustering Methods
More informationClustering Part 2. A Partitional Clustering
Universit of Florida CISE department Gator Engineering Clustering Part Dr. Sanja Ranka Professor Computer and Information Science and Engineering Universit of Florida, Gainesville Universit of Florida
More informationUnsupervised Learning Hierarchical Methods
Unsupervised Learning Hierarchical Methods Road Map. Basic Concepts 2. BIRCH 3. ROCK The Principle Group data objects into a tree of clusters Hierarchical methods can be Agglomerative: bottom-up approach
More informationDATA MINING LECTURE 7. Hierarchical Clustering, DBSCAN The EM Algorithm
DATA MINING LECTURE 7 Hierarchical Clustering, DBSCAN The EM Algorithm CLUSTERING What is a Clustering? In general a grouping of objects such that the objects in a group (cluster) are similar (or related)
More informationClustering in Ratemaking: Applications in Territories Clustering
Clustering in Ratemaking: Applications in Territories Clustering Ji Yao, PhD FIA ASTIN 13th-16th July 2008 INTRODUCTION Structure of talk Quickly introduce clustering and its application in insurance ratemaking
More informationCluster Analysis. Outline. Motivation. Examples Applications. Han and Kamber, ch 8
Outline Cluster Analysis Han and Kamber, ch Partitioning Methods Hierarchical Methods Density-Based Methods Grid-Based Methods Model-Based Methods CS by Rattikorn Hewett Texas Tech University Motivation
More informationClustering CS 550: Machine Learning
Clustering CS 550: Machine Learning This slide set mainly uses the slides given in the following links: http://www-users.cs.umn.edu/~kumar/dmbook/ch8.pdf http://www-users.cs.umn.edu/~kumar/dmbook/dmslides/chap8_basic_cluster_analysis.pdf
More informationTan,Steinbach, Kumar Introduction to Data Mining 4/18/ Tan,Steinbach, Kumar Introduction to Data Mining 4/18/
Data Mining Cluster Analsis: Basic Concepts and Algorithms Lecture Notes for Chapter Introduction to Data Mining b Tan, Steinbach, Kumar What is Cluster Analsis? Finding groups of objects such that the
More informationCS570: Introduction to Data Mining
CS570: Introduction to Data Mining Scalable Clustering Methods: BIRCH and Others Reading: Chapter 10.3 Han, Chapter 9.5 Tan Cengiz Gunay, Ph.D. Slides courtesy of Li Xiong, Ph.D., 2011 Han, Kamber & Pei.
More informationData Mining Chapter 9: Descriptive Modeling Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University
Data Mining Chapter 9: Descriptive Modeling Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University Descriptive model A descriptive model presents the main features of the data
More informationDistance-based Methods: Drawbacks
Distance-based Methods: Drawbacks Hard to find clusters with irregular shapes Hard to specify the number of clusters Heuristic: a cluster must be dense Jian Pei: CMPT 459/741 Clustering (3) 1 How to Find
More informationKapitel 4: Clustering
Ludwig-Maximilians-Universität München Institut für Informatik Lehr- und Forschungseinheit für Datenbanksysteme Knowledge Discovery in Databases WiSe 2017/18 Kapitel 4: Clustering Vorlesung: Prof. Dr.
More informationECLT 5810 Clustering
ECLT 5810 Clustering What is Cluster Analysis? Cluster: a collection of data objects Similar to one another within the same cluster Dissimilar to the objects in other clusters Cluster analysis Grouping
More informationCS249: ADVANCED DATA MINING
CS249: ADVANCED DATA MINING Vector Data: Clustering: Part I Instructor: Yizhou Sun yzsun@cs.ucla.edu April 26, 2017 Methods to Learn Classification Clustering Vector Data Text Data Recommender System Decision
More informationNotes. Reminder: HW2 Due Today by 11:59PM. Review session on Thursday. Midterm next Tuesday (10/09/2018)
1 Notes Reminder: HW2 Due Today by 11:59PM TA s note: Please provide a detailed ReadMe.txt file on how to run the program on the STDLINUX. If you installed/upgraded any package on STDLINUX, you should
More informationData Mining Cluster Analysis: Basic Concepts and Algorithms. Lecture Notes for Chapter 8. Introduction to Data Mining
Data Mining Cluster Analsis: Basic Concepts and Algorithms Lecture Notes for Chapter 8 Introduction to Data Mining b Tan, Steinbach, Kumar What is Cluster Analsis? Finding groups of objects such that the
More informationMultiDimensional Signal Processing Master Degree in Ingegneria delle Telecomunicazioni A.A
MultiDimensional Signal Processing Master Degree in Ingegneria delle Telecomunicazioni A.A. 205-206 Pietro Guccione, PhD DEI - DIPARTIMENTO DI INGEGNERIA ELETTRICA E DELL INFORMAZIONE POLITECNICO DI BARI
More informationDS504/CS586: Big Data Analytics Big Data Clustering II
Welcome to DS504/CS586: Big Data Analytics Big Data Clustering II Prof. Yanhua Li Time: 6pm 8:50pm Thu Location: AK 232 Fall 2016 More Discussions, Limitations v Center based clustering K-means BFR algorithm
More informationECLT 5810 Clustering
ECLT 5810 Clustering What is Cluster Analysis? Cluster: a collection of data objects Similar to one another within the same cluster Dissimilar to the objects in other clusters Cluster analysis Grouping
More informationClustering fundamentals
Elena Baralis, Tania Cerquitelli Politecnico di Torino What is Cluster Analsis? Finding groups of objects such that the objects in a group will be similar (or related) to one another and different from
More informationClustering. CE-717: Machine Learning Sharif University of Technology Spring Soleymani
Clustering CE-717: Machine Learning Sharif University of Technology Spring 2016 Soleymani Outline Clustering Definition Clustering main approaches Partitional (flat) Hierarchical Clustering validation
More informationMetodologie per Sistemi Intelligenti. Clustering. Prof. Pier Luca Lanzi Laurea in Ingegneria Informatica Politecnico di Milano Polo di Milano Leonardo
Metodologie per Sistemi Intelligenti Clustering Prof. Pier Luca Lanzi Laurea in Ingegneria Informatica Politecnico di Milano Polo di Milano Leonardo Outline What is clustering? What are the major issues?
More informationCS6220: DATA MINING TECHNIQUES
CS6220: DATA MINING TECHNIQUES Matrix Data: Clustering: Part 1 Instructor: Yizhou Sun yzsun@ccs.neu.edu October 30, 2013 Announcement Homework 1 due next Monday (10/14) Course project proposal due next
More informationDBSCAN. Presented by: Garrett Poppe
DBSCAN Presented by: Garrett Poppe A density-based algorithm for discovering clusters in large spatial databases with noise by Martin Ester, Hans-peter Kriegel, Jörg S, Xiaowei Xu Slides adapted from resources
More informationCHAPTER 4: CLUSTER ANALYSIS
CHAPTER 4: CLUSTER ANALYSIS WHAT IS CLUSTER ANALYSIS? A cluster is a collection of data-objects similar to one another within the same group & dissimilar to the objects in other groups. Cluster analysis
More informationLesson 3. Prof. Enza Messina
Lesson 3 Prof. Enza Messina Clustering techniques are generally classified into these classes: PARTITIONING ALGORITHMS Directly divides data points into some prespecified number of clusters without a hierarchical
More informationData Mining Cluster Analysis: Basic Concepts and Algorithms. Lecture Notes for Chapter 8. Introduction to Data Mining
Data Mining Cluster Analsis: Basic Concepts and Algorithms Lecture Notes for Chapter 8 Introduction to Data Mining b Tan, Steinbach, Kumar Tan,Steinbach, Kumar Introduction to Data Mining /8/ What is Cluster
More informationA Comparative Study of Various Clustering Algorithms in Data Mining
Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology ISSN 2320 088X IMPACT FACTOR: 6.017 IJCSMC,
More informationTan,Steinbach, Kumar Introduction to Data Mining 4/18/ Tan,Steinbach, Kumar Introduction to Data Mining 4/18/
Data Mining Cluster Analsis: Basic Concepts and Algorithms Lecture Notes for Chapter Introduction to Data Mining b Tan, Steinbach, Kumar What is Cluster Analsis? Finding groups of objects such that the
More informationCluster analysis. Agnieszka Nowak - Brzezinska
Cluster analysis Agnieszka Nowak - Brzezinska Outline of lecture What is cluster analysis? Clustering algorithms Measures of Cluster Validity What is Cluster Analysis? Finding groups of objects such that
More informationDS504/CS586: Big Data Analytics Big Data Clustering II
Welcome to DS504/CS586: Big Data Analytics Big Data Clustering II Prof. Yanhua Li Time: 6pm 8:50pm Thu Location: KH 116 Fall 2017 Updates: v Progress Presentation: Week 15: 11/30 v Next Week Office hours
More informationUnsupervised Data Mining: Clustering. Izabela Moise, Evangelos Pournaras, Dirk Helbing
Unsupervised Data Mining: Clustering Izabela Moise, Evangelos Pournaras, Dirk Helbing Izabela Moise, Evangelos Pournaras, Dirk Helbing 1 1. Supervised Data Mining Classification Regression Outlier detection
More informationCS6220: DATA MINING TECHNIQUES
CS6220: DATA MINING TECHNIQUES Chapter 10: Cluster Analysis: Basic Concepts and Methods Instructor: Yizhou Sun yzsun@ccs.neu.edu April 2, 2013 Chapter 10. Cluster Analysis: Basic Concepts and Methods Cluster
More informationGene Clustering & Classification
BINF, Introduction to Computational Biology Gene Clustering & Classification Young-Rae Cho Associate Professor Department of Computer Science Baylor University Overview Introduction to Gene Clustering
More informationCSE 5243 INTRO. TO DATA MINING
CSE 5243 INTRO. TO DATA MINING Cluster Analysis: Basic Concepts and Methods Huan Sun, CSE@The Ohio State University Slides adapted from UIUC CS412, Fall 2017, by Prof. Jiawei Han 2 Chapter 10. Cluster
More informationCS570: Introduction to Data Mining
CS570: Introduction to Data Mining Cluster Analysis Reading: Chapter 10.4, 10.6, 11.1.3 Han, Chapter 8.4,8.5,9.2.2, 9.3 Tan Anca Doloc-Mihu, Ph.D. Slides courtesy of Li Xiong, Ph.D., 2011 Han, Kamber &
More informationData Mining 4. Cluster Analysis
Data Mining 4. Cluster Analysis 4.5 Spring 2010 Instructor: Dr. Masoud Yaghini Introduction DBSCAN Algorithm OPTICS Algorithm DENCLUE Algorithm References Outline Introduction Introduction Density-based
More informationData Mining. Clustering. Hamid Beigy. Sharif University of Technology. Fall 1394
Data Mining Clustering Hamid Beigy Sharif University of Technology Fall 1394 Hamid Beigy (Sharif University of Technology) Data Mining Fall 1394 1 / 31 Table of contents 1 Introduction 2 Data matrix and
More informationData Informatics. Seon Ho Kim, Ph.D.
Data Informatics Seon Ho Kim, Ph.D. seonkim@usc.edu Clustering Overview Supervised vs. Unsupervised Learning Supervised learning (classification) Supervision: The training data (observations, measurements,
More informationCluster Analysis. Ying Shen, SSE, Tongji University
Cluster Analysis Ying Shen, SSE, Tongji University Cluster analysis Cluster analysis groups data objects based only on the attributes in the data. The main objective is that The objects within a group
More informationCourse Content. What is Classification? Chapter 6 Objectives
Principles of Knowledge Discovery in Data Fall 007 Chapter 6: Data Clustering Dr. Osmar R. Zaïane University of Alberta Course Content Introduction to Data Mining Association Analysis Sequential Pattern
More informationA Review on Cluster Based Approach in Data Mining
A Review on Cluster Based Approach in Data Mining M. Vijaya Maheswari PhD Research Scholar, Department of Computer Science Karpagam University Coimbatore, Tamilnadu,India Dr T. Christopher Assistant professor,
More informationData Mining. Cluster Analysis: Basic Concepts and Algorithms
Data Mining Cluster Analsis: Basic Concepts and Algorithms Tan,Steinbach, Kumar Introduction to Data Mining /8/ What is Cluster Analsis? Finding groups of objects such that the objects in a group will
More informationCourse Content. Classification = Learning a Model. What is Classification?
Lecture 6 Week 0 (May ) and Week (May 9) 459-0 Principles of Knowledge Discovery in Data Clustering Analysis: Agglomerative,, and other approaches Lecture by: Dr. Osmar R. Zaïane Course Content Introduction
More informationand Algorithms Dr. Hui Xiong Rutgers University Introduction to Data Mining 8/30/ Introduction to Data Mining 08/06/2006 1
Cluster Analsis: Basic Concepts and Algorithms Dr. Hui Xiong Rutgers Universit Introduction to Data Mining 8//6 Introduction to Data Mining 8/6/6 What is Cluster Analsis? Finding groups of objects such
More information9/17/2009. Wenyan Li (Emily Li) Sep. 15, Introduction to Clustering Analysis
Introduction ti to K-means Algorithm Wenan Li (Emil Li) Sep. 5, 9 Outline Introduction to Clustering Analsis K-means Algorithm Description Eample of K-means Algorithm Other Issues of K-means Algorithm
More informationData Mining. Dr. Raed Ibraheem Hamed. University of Human Development, College of Science and Technology Department of Computer Science
Data Mining Dr. Raed Ibraheem Hamed University of Human Development, College of Science and Technology Department of Computer Science 2016 201 Road map What is Cluster Analysis? Characteristics of Clustering
More informationCS6220: DATA MINING TECHNIQUES
CS6220: DATA MINING TECHNIQUES Matrix Data: Clustering: Part 1 Instructor: Yizhou Sun yzsun@ccs.neu.edu February 10, 2016 Announcements Homework 1 grades out Re-grading policy: If you have doubts in your
More informationCSE 5243 INTRO. TO DATA MINING
CSE 5243 INTRO. TO DATA MINING Cluster Analysis: Basic Concepts and Methods Huan Sun, CSE@The Ohio State University 09/25/2017 Slides adapted from UIUC CS412, Fall 2017, by Prof. Jiawei Han 2 Chapter 10.
More informationClustering. Supervised vs. Unsupervised Learning
Clustering Supervised vs. Unsupervised Learning So far we have assumed that the training samples used to design the classifier were labeled by their class membership (supervised learning) We assume now
More informationData Mining Cluster Analysis: Basic Concepts and Algorithms. Lecture Notes for Chapter 7. Introduction to Data Mining, 2 nd Edition
Data Mining Cluster Analsis: Basic Concepts and Algorithms Lecture Notes for Chapter 7 Introduction to Data Mining, nd Edition b Tan, Steinbach, Karpatne, Kumar What is Cluster Analsis? Finding groups
More informationUnsupervised Learning and Clustering
Unsupervised Learning and Clustering Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr CS 551, Spring 2009 CS 551, Spring 2009 c 2009, Selim Aksoy (Bilkent University)
More informationUnsupervised Learning. Presenter: Anil Sharma, PhD Scholar, IIIT-Delhi
Unsupervised Learning Presenter: Anil Sharma, PhD Scholar, IIIT-Delhi Content Motivation Introduction Applications Types of clustering Clustering criterion functions Distance functions Normalization Which
More informationMachine Learning 15/04/2015. Supervised learning vs. unsupervised learning. What is Cluster Analysis? Applications of Cluster Analysis
// Supervised learning vs unsupervised learning Machine Learning Unsupervised Learning Supervised learning: discover patterns in the data that relate data attributes with a target (class) attribute These
More informationCHAPTER 4 AN IMPROVED INITIALIZATION METHOD FOR FUZZY C-MEANS CLUSTERING USING DENSITY BASED APPROACH
37 CHAPTER 4 AN IMPROVED INITIALIZATION METHOD FOR FUZZY C-MEANS CLUSTERING USING DENSITY BASED APPROACH 4.1 INTRODUCTION Genes can belong to any genetic network and are also coordinated by many regulatory
More informationCOMP 465: Data Mining Still More on Clustering
3/4/015 Exercise COMP 465: Data Mining Still More on Clustering Slides Adapted From : Jiawei Han, Micheline Kamber & Jian Pei Data Mining: Concepts and Techniques, 3 rd ed. Describe each of the following
More informationBBS654 Data Mining. Pinar Duygulu. Slides are adapted from Nazli Ikizler
BBS654 Data Mining Pinar Duygulu Slides are adapted from Nazli Ikizler 1 Classification Classification systems: Supervised learning Make a rational prediction given evidence There are several methods for
More informationLecture-17: Clustering with K-Means (Contd: DT + Random Forest)
Lecture-17: Clustering with K-Means (Contd: DT + Random Forest) Medha Vidyotma April 24, 2018 1 Contd. Random Forest For Example, if there are 50 scholars who take the measurement of the length of the
More informationBased on Raymond J. Mooney s slides
Instance Based Learning Based on Raymond J. Mooney s slides University of Texas at Austin 1 Example 2 Instance-Based Learning Unlike other learning algorithms, does not involve construction of an explicit
More informationDS504/CS586: Big Data Analytics Big Data Clustering Prof. Yanhua Li
Welcome to DS504/CS586: Big Data Analytics Big Data Clustering Prof. Yanhua Li Time: 6:00pm 8:50pm Thu Location: AK 232 Fall 2016 High Dimensional Data v Given a cloud of data points we want to understand
More informationUnsupervised Learning and Clustering
Unsupervised Learning and Clustering Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr CS 551, Spring 2008 CS 551, Spring 2008 c 2008, Selim Aksoy (Bilkent University)
More informationCSE 347/447: DATA MINING
CSE 347/447: DATA MINING Lecture 6: Clustering II W. Teal Lehigh University CSE 347/447, Fall 2016 Hierarchical Clustering Definition Produces a set of nested clusters organized as a hierarchical tree
More informationClassification. Vladimir Curic. Centre for Image Analysis Swedish University of Agricultural Sciences Uppsala University
Classification Vladimir Curic Centre for Image Analysis Swedish University of Agricultural Sciences Uppsala University Outline An overview on classification Basics of classification How to choose appropriate
More informationCOMP5331: Knowledge Discovery and Data Mining
COMP5331: Knowledge Discovery and Data Mining Acknowledgement: Slides modified by Dr. Lei Chen based on the slides provided by Jiawei Han, Micheline Kamber, and Jian Pei 2012 Han, Kamber & Pei. All rights
More informationCommunity Detection. Jian Pei: CMPT 741/459 Clustering (1) 2
Clustering Community Detection http://image.slidesharecdn.com/communitydetectionitilecturejune0-0609559-phpapp0/95/community-detection-in-social-media--78.jpg?cb=3087368 Jian Pei: CMPT 74/459 Clustering
More informationK-Means. Oct Youn-Hee Han
K-Means Oct. 2015 Youn-Hee Han http://link.koreatech.ac.kr ²K-Means algorithm An unsupervised clustering algorithm K stands for number of clusters. It is typically a user input to the algorithm Some criteria
More informationMachine Learning (BSMC-GA 4439) Wenke Liu
Machine Learning (BSMC-GA 4439) Wenke Liu 01-25-2018 Outline Background Defining proximity Clustering methods Determining number of clusters Other approaches Cluster analysis as unsupervised Learning Unsupervised
More informationData Mining Cluster Analysis: Advanced Concepts and Algorithms. Lecture Notes for Chapter 8. Introduction to Data Mining, 2 nd Edition
Data Mining Cluster Analysis: Advanced Concepts and Algorithms Lecture Notes for Chapter 8 Introduction to Data Mining, 2 nd Edition by Tan, Steinbach, Karpatne, Kumar Outline Prototype-based Fuzzy c-means
More informationData Clustering Hierarchical Clustering, Density based clustering Grid based clustering
Data Clustering Hierarchical Clustering, Density based clustering Grid based clustering Team 2 Prof. Anita Wasilewska CSE 634 Data Mining All Sources Used for the Presentation Olson CF. Parallel algorithms
More informationCS 412 Intro. to Data Mining Chapter 10. Cluster Analysis: Basic Concepts and Methods
CS 412 Intro. to Data Mining Chapter 10. Cluster Analysis: Basic Concepts and Methods Jiawei Han, Computer Science, Univ. Illinois at Urbana -Champaign, 2017 1 2 Chapter 10. Cluster Analysis: Basic Concepts
More informationHard clustering. Each object is assigned to one and only one cluster. Hierarchical clustering is usually hard. Soft (fuzzy) clustering
An unsupervised machine learning problem Grouping a set of objects in such a way that objects in the same group (a cluster) are more similar (in some sense or another) to each other than to those in other
More informationRoad map. Basic concepts
Clustering Basic concepts Road map K-means algorithm Representation of clusters Hierarchical clustering Distance functions Data standardization Handling mixed attributes Which clustering algorithm to use?
More informationCS 2750 Machine Learning. Lecture 19. Clustering. CS 2750 Machine Learning. Clustering. Groups together similar instances in the data sample
Lecture 9 Clustering Milos Hauskrecht milos@cs.pitt.edu 539 Sennott Square Clustering Groups together similar instances in the data sample Basic clustering problem: distribute data into k different groups
More informationUnderstanding Clustering Supervising the unsupervised
Understanding Clustering Supervising the unsupervised Janu Verma IBM T.J. Watson Research Center, New York http://jverma.github.io/ jverma@us.ibm.com @januverma Clustering Grouping together similar data
More information