Stats fest Multivariate analysis. Multivariate analyses. Aims. Multivariate analyses. Objects. Variables

Size: px
Start display at page:

Download "Stats fest Multivariate analysis. Multivariate analyses. Aims. Multivariate analyses. Objects. Variables"

Transcription

1 Stats fest 7 Multivariate analysis murray.logan@sci.monash.edu.au Multivariate analyses ims Data reduction Reduce large numbers of variables into a smaller number that adequately summarize the patterns Reveal patterns in the data that cannot be found using isolated variables Characterize things based on a large number of variables Classify sites Taxonomy Multivariate analyses 3 Objects Things we wish to compare Sampling or experimental units E.g. sites, quadrats Variables Characteristics measured from each object Usually continuous variables counts of many different species (species abundances) Size of body parts (taxonomy)

2 Multivariate analyses R-mode analyses Combine variables based on correlations E.g. Principal components analysis (PC) Q-mode analyses Combine variables based on object dissimilarity E.g. Multidimensional scaling (MDS) nalysis of similarity (NOSIM) utocorrelation Cluster analysis PC 5 ims Data reduction Reveal patterns in the data that cannot be found using isolated variables Data Many predictor variables measured from the same sampling units PC 6 If there are variables that are correlated to oneanother Combine them together xis rotation First component Surface of best fit Explains most variation Next component Perpendicular Explains next most Next.

3 PC 7 Difficult to visualize when more than 3 variables Eigenanalysis Matrix algebra used to do axes rotation in multidimensional space Start with p original variables End with p new completely uncorrelated variables (principal components) PC 8 Eigenanalysis Calculate correlation matrix between all p variables Calculate new principal components (PC) Eigenvalues (latent roots) mount or original variation explained by each new principal component dds up to the number of original variables Component loadings contribution of each original variable to each of the new PC Factor scores PC 9 How many components to keep Eigenvalue > rule The sum of the eigenvalues is always equal to the number of original variables ny PC > must be explaining more than its share of the variation Retain ny PC < not explaining much Do not retain 3

4 PC How many components to keep Scree test Obvious elbow PC Ordination plot PC ssumptions ecause it is based on correlations ssumes linearity

5 Q-mode analyses 3 Distance (dissimilarity) measures Measure of the degree of difference between each pair of objects based on a set of variables How different sites are with respect to species composition How different organisms are with respect to a suit of morphological and/or genetic characteristics Smaller dissimilarities represent higher degree of similarity Dissimilarity Euclidean distance Geometric distance between objects (j and k) in multidimensional space when two objects identical No maximum value Joint absences considered similar Dissimilarity 5 ray-curtis dissimilarity when two objects are identical Reaches a maximum of when two objects have no variables in common Joint absences ignored 5

6 Dissimilarity Distance matrix Site Sp Sp Sp C D E Distance matrix C D E C D E Euclidean distances C D E ray-curtis distances C D E Dissimilarity which is best? 7 Species abundance data Zeros common Max value when quadrats have no species in common ray-curtis preferred > library(vegan) > *.bc <- vegdist(variables, bray ) Measurement/morphological data Zeros rare Euclidean distance OK > library(vegan) > *.euc <- vegdist(variables, euc ) Dissimilarity 8 Other distances Genetic distances from gene frequencies Nei s distance Edward s (ngular) distance Coancestrality coefficient (Reynolds ) distance Classical Euclidean (Rogers ) distance bsolute genetics (Provesti's) distance 6

7 Standardizations 9 im To allow all variables to have an equal influence on patterns voids overweighting by highly abundant species llows rare species to contribute Different environmental variables measured on different scales Scale each variable Divide all observations by max for that variable Scale to a mean of and sd of Standardizations Scale to maximums Raw data Standardized (max) data Site C D E Sp Sp 9 Sp Site C D E Sp..... Sp Sp > library(vegan) > *.stnd <- decostand(*[,:], max ) Standardizations Scale to mean of, sd of Raw data Standardized (max) data Site C D E Sp Sp 9 Sp Site C D E Sp Sp Sp > *.stnd <- scale(*[,:]) 7

8 Multidimensional scaling (MDS) ims Graphical representation of dissimilarity between objects in as few dimensions (axes) as possible xes are new variables MDS 3. Setup data Objects (sites) in rows Variables (species) in columns Site Sp Sp Sp3 Sp 5 Sp5 MDS. Calculate dissimilarity (ray-curtis) > library(vegan) > *.bc <- vegdist(variables, bray ) Site Site Site 3 Site Site 5 Site 6 Site Site Site Site..9.8 Site 5..5 Site 6. 8

9 MDS 5 3. Decide on the number of dimensions for ordination Suspected number of major underlying ecological gradients Minimize new axes (variables) but still retain information Usually between and four dimensions > library(mss) > *.mds <- isomds(*.dist, k=) MDS 6. rrange objects on ordination plot Starting configuration Usually random MDS 7 5. Compare distances on ordination plot with dissimilarity distances Strength of the relationship between ordination distances and dissimilarity distances Kruskal s stress (equivalent to-r ) 9

10 MDS 8 6. Move objects on ordination iteratively Each move improves the match between dissimilarities and ordination distances Lower stress value MDS 9 7. Final configuration When further moving of objects no longer improves the match Stress low as possible MDS 3 Non-metric MDS Rank-based regression Similar to rank based correlation etter for ecological data How low should stress be? >. (%) basically random <.5 (5%) is good match <. (%) is ideal Ordination configuration is close to actual dissimilarities small number of new variables explain most of the patterns contained in all the original variables

11 Hypothesis testing? 3 Is there are difference between the habitats with respect to species composition? Can we use the new axes scores in NOV? NO! (why?) UT Site Sp Sp Sp3 Sp Sp5 5 5 Habitat Habitat nalysis of Similarities (NOSIM) 3 im To compare groups based on similarities of objects Uses dissimilarity matrices Data H : Categorical variable Multiple continuous response variables Dissimilarity matrix verage rank dissimilarities between objects within groups = verage rank dissimilarities between objects between groups No difference in species composition between groups nalysis of Similarities (NOSIM) 33 Habitat Site Sp Sp Sp3 Sp 5 Sp5 Site Site Site 3 Site Site 5 Site 6 Site Site Site Site..9.8 Site 5..5 Site 6. R = r b r w / number of sites

12 nalysis of Similarities (NOSIM) 3 Dissimilarities not normally distributed ased on ranks Dissimilarities not independent Uses randomization procedures to construct a probability distribution Generates own test statistic (called R) Cluster analysis 35 ims Combines similar objects together into clusters which are displayed as a dendogram Cluster analysis 36 Single linkage (Nearest neighbour) method. Calculate dissimilarity matrix. First cluster is formed between two objects with smallest dissimilarity C D E

13 Cluster analysis Next cluster is between the next most similar pairs and so on Length of linkage reflects dissimilarity C D E Cluster analysis Next cluster is between the next most similar pairs and so on C D E Cluster analysis Next cluster is between the next most similar pairs and so on. Procedure continues until all objects are linked in clusters C D E 3

14 Cluster analysis Other linkage methods verage linkage Unweighted Pair-Group Method of rithmetic veraging (UPGM) verage neighbour Complete linkage (Furthest neighbour) Distance between clusters determined by most dissimilar objects in their groups Clustering How well do the cluster groups match the dissimilarity patterns cophenetic correlation.83 Dissimilarity distances C D E C D E C D E C D E Cluster distances C D E Minimum spanning trees Mapped over ordination plots. Find smallest dissimilarity. Join these objects with a line 3. Find the next lowest dissimilarity and join objects. Repeat until all points joined 5. Short lines represent within clusters, long lines between clusters

15 utocorrelation- Mantal test 3 im Investigate association between two distance matrices H : No association between two matrices E.g. no correlation between species abundances and environmental characteristics. Calculate correlation (r) between matrices. Since dissimilarities not independent or normal, use randomization test to reshuffle one of the matrices repeatedly utocorrelation- Mantal test Calculate probability 5

Week 7 Picturing Network. Vahe and Bethany

Week 7 Picturing Network. Vahe and Bethany Week 7 Picturing Network Vahe and Bethany Freeman (2005) - Graphic Techniques for Exploring Social Network Data The two main goals of analyzing social network data are identification of cohesive groups

More information

3. Cluster analysis Overview

3. Cluster analysis Overview Université Laval Analyse multivariable - mars-avril 2008 1 3.1. Overview 3. Cluster analysis Clustering requires the recognition of discontinuous subsets in an environment that is sometimes discrete (as

More information

3. Cluster analysis Overview

3. Cluster analysis Overview Université Laval Multivariate analysis - February 2006 1 3.1. Overview 3. Cluster analysis Clustering requires the recognition of discontinuous subsets in an environment that is sometimes discrete (as

More information

Multivariate analyses in ecology. Cluster (part 2) Ordination (part 1 & 2)

Multivariate analyses in ecology. Cluster (part 2) Ordination (part 1 & 2) Multivariate analyses in ecology Cluster (part 2) Ordination (part 1 & 2) 1 Exercise 9B - solut 2 Exercise 9B - solut 3 Exercise 9B - solut 4 Exercise 9B - solut 5 Multivariate analyses in ecology Cluster

More information

Ecological cluster analysis with Past

Ecological cluster analysis with Past Ecological cluster analysis with Past Øyvind Hammer, Natural History Museum, University of Oslo, 2011-06-26 Introduction Cluster analysis is used to identify groups of items, e.g. samples with counts or

More information

Chapter 1. Using the Cluster Analysis. Background Information

Chapter 1. Using the Cluster Analysis. Background Information Chapter 1 Using the Cluster Analysis Background Information Cluster analysis is the name of a multivariate technique used to identify similar characteristics in a group of observations. In cluster analysis,

More information

Ordination (Guerrero Negro)

Ordination (Guerrero Negro) Ordination (Guerrero Negro) Back to Table of Contents All of the code in this page is meant to be run in R unless otherwise specified. Load data and calculate distance metrics. For more explanations of

More information

Tree Models of Similarity and Association. Clustering and Classification Lecture 5

Tree Models of Similarity and Association. Clustering and Classification Lecture 5 Tree Models of Similarity and Association Clustering and Lecture 5 Today s Class Tree models. Hierarchical clustering methods. Fun with ultrametrics. 2 Preliminaries Today s lecture is based on the monograph

More information

Dimension reduction : PCA and Clustering

Dimension reduction : PCA and Clustering Dimension reduction : PCA and Clustering By Hanne Jarmer Slides by Christopher Workman Center for Biological Sequence Analysis DTU The DNA Array Analysis Pipeline Array design Probe design Question Experimental

More information

Fast, Easy, and Publication-Quality Ecological Analyses with PC-ORD

Fast, Easy, and Publication-Quality Ecological Analyses with PC-ORD Emerging Technologies Fast, Easy, and Publication-Quality Ecological Analyses with PC-ORD JeriLynn E. Peck School of Forest Resources, Pennsylvania State University, University Park, Pennsylvania 16802

More information

Modern Multidimensional Scaling

Modern Multidimensional Scaling Ingwer Borg Patrick Groenen Modern Multidimensional Scaling Theory and Applications With 116 Figures Springer Contents Preface vii I Fundamentals of MDS 1 1 The Four Purposes of Multidimensional Scaling

More information

Chapter 6: Cluster Analysis

Chapter 6: Cluster Analysis Chapter 6: Cluster Analysis The major goal of cluster analysis is to separate individual observations, or items, into groups, or clusters, on the basis of the values for the q variables measured on each

More information

Predict Outcomes and Reveal Relationships in Categorical Data

Predict Outcomes and Reveal Relationships in Categorical Data PASW Categories 18 Specifications Predict Outcomes and Reveal Relationships in Categorical Data Unleash the full potential of your data through predictive analysis, statistical learning, perceptual mapping,

More information

Multivariate Methods

Multivariate Methods Multivariate Methods Cluster Analysis http://www.isrec.isb-sib.ch/~darlene/embnet/ Classification Historically, objects are classified into groups periodic table of the elements (chemistry) taxonomy (zoology,

More information

A technique for constructing monotonic regression splines to enable non-linear transformation of GIS rasters

A technique for constructing monotonic regression splines to enable non-linear transformation of GIS rasters 18 th World IMACS / MODSIM Congress, Cairns, Australia 13-17 July 2009 http://mssanz.org.au/modsim09 A technique for constructing monotonic regression splines to enable non-linear transformation of GIS

More information

Cluster Analysis. Mu-Chun Su. Department of Computer Science and Information Engineering National Central University 2003/3/11 1

Cluster Analysis. Mu-Chun Su. Department of Computer Science and Information Engineering National Central University 2003/3/11 1 Cluster Analysis Mu-Chun Su Department of Computer Science and Information Engineering National Central University 2003/3/11 1 Introduction Cluster analysis is the formal study of algorithms and methods

More information

Scaling Techniques in Political Science

Scaling Techniques in Political Science Scaling Techniques in Political Science Eric Guntermann March 14th, 2014 Eric Guntermann Scaling Techniques in Political Science March 14th, 2014 1 / 19 What you need R RStudio R code file Datasets You

More information

VEGETATION DESCRIPTION AND ANALYSIS

VEGETATION DESCRIPTION AND ANALYSIS VEGETATION DESCRIPTION AND ANALYSIS LABORATORY 5 AND 6 ORDINATIONS USING PC-ORD AND INSTRUCTIONS FOR LAB AND WRITTEN REPORT Introduction LABORATORY 5 (OCT 4, 2017) PC-ORD 1 BRAY & CURTIS ORDINATION AND

More information

Modern Multidimensional Scaling

Modern Multidimensional Scaling Ingwer Borg Patrick J.F. Groenen Modern Multidimensional Scaling Theory and Applications Second Edition With 176 Illustrations ~ Springer Preface vii I Fundamentals of MDS 1 1 The Four Purposes of Multidimensional

More information

Workload Characterization Techniques

Workload Characterization Techniques Workload Characterization Techniques Raj Jain Washington University in Saint Louis Saint Louis, MO 63130 Jain@cse.wustl.edu These slides are available on-line at: http://www.cse.wustl.edu/~jain/cse567-08/

More information

Forestry Applied Multivariate Statistics. Cluster Analysis

Forestry Applied Multivariate Statistics. Cluster Analysis 1 Forestry 531 -- Applied Multivariate Statistics Cluster Analysis Purpose: To group similar entities together based on their attributes. Entities can be variables or observations. [illustration in Class]

More information

CLUSTER ANALYSIS. V. K. Bhatia I.A.S.R.I., Library Avenue, New Delhi

CLUSTER ANALYSIS. V. K. Bhatia I.A.S.R.I., Library Avenue, New Delhi CLUSTER ANALYSIS V. K. Bhatia I.A.S.R.I., Library Avenue, New Delhi-110 012 In multivariate situation, the primary interest of the experimenter is to examine and understand the relationship amongst the

More information

Package optimus. March 24, 2017

Package optimus. March 24, 2017 Type Package Package optimus March 24, 2017 Title Model Based Diagnostics for Multivariate Cluster Analysis Version 0.1.0 Date 2017-03-24 Maintainer Mitchell Lyons Description

More information

IBM SPSS Categories. Predict outcomes and reveal relationships in categorical data. Highlights. With IBM SPSS Categories you can:

IBM SPSS Categories. Predict outcomes and reveal relationships in categorical data. Highlights. With IBM SPSS Categories you can: IBM Software IBM SPSS Statistics 19 IBM SPSS Categories Predict outcomes and reveal relationships in categorical data Highlights With IBM SPSS Categories you can: Visualize and explore complex categorical

More information

Unsupervised Learning

Unsupervised Learning Harvard-MIT Division of Health Sciences and Technology HST.951J: Medical Decision Support, Fall 2005 Instructors: Professor Lucila Ohno-Machado and Professor Staal Vinterbo 6.873/HST.951 Medical Decision

More information

How do microarrays work

How do microarrays work Lecture 3 (continued) Alvis Brazma European Bioinformatics Institute How do microarrays work condition mrna cdna hybridise to microarray condition Sample RNA extract labelled acid acid acid nucleic acid

More information

9/29/13. Outline Data mining tasks. Clustering algorithms. Applications of clustering in biology

9/29/13. Outline Data mining tasks. Clustering algorithms. Applications of clustering in biology 9/9/ I9 Introduction to Bioinformatics, Clustering algorithms Yuzhen Ye (yye@indiana.edu) School of Informatics & Computing, IUB Outline Data mining tasks Predictive tasks vs descriptive tasks Example

More information

8.11 Multivariate regression trees (MRT)

8.11 Multivariate regression trees (MRT) Multivariate regression trees (MRT) 375 8.11 Multivariate regression trees (MRT) Univariate classification tree analysis (CT) refers to problems where a qualitative response variable is to be predicted

More information

Case Study: Attempts at Parametric Reduction

Case Study: Attempts at Parametric Reduction Appendix C Case Study: Attempts at Parametric Reduction C.1 Introduction After the first two studies, we have a better understanding of differences between designers in terms of design processes and use

More information

Step-by-Step Guide to Relatedness and Association Mapping Contents

Step-by-Step Guide to Relatedness and Association Mapping Contents Step-by-Step Guide to Relatedness and Association Mapping Contents OBJECTIVES... 2 INTRODUCTION... 2 RELATEDNESS MEASURES... 2 POPULATION STRUCTURE... 6 Q-K ASSOCIATION ANALYSIS... 10 K MATRIX COMPRESSION...

More information

Learning Compact and Effective Distance Metrics with Diversity Regularization. Pengtao Xie. Carnegie Mellon University

Learning Compact and Effective Distance Metrics with Diversity Regularization. Pengtao Xie. Carnegie Mellon University Learning Compact and Effective Distance Metrics with Diversity Regularization Pengtao Xie Carnegie Mellon University 1 Distance Metric Learning Similar Dissimilar Distance Metric Wide applications in retrieval,

More information

Dimension Reduction CS534

Dimension Reduction CS534 Dimension Reduction CS534 Why dimension reduction? High dimensionality large number of features E.g., documents represented by thousands of words, millions of bigrams Images represented by thousands of

More information

MULTIDIMENSIONAL SCALING: Using SPSS/PROXSCAL

MULTIDIMENSIONAL SCALING: Using SPSS/PROXSCAL MULTIDIMENSIONAL SCALING: Using SPSS/PROXSCAL August 2003 : APMC SPSS uses Forrest Young s ALSCAL (Alternating Least Squares Scaling) as its main MDS program. However, ALSCAL has been shown to be sub-optimal

More information

STATS306B STATS306B. Clustering. Jonathan Taylor Department of Statistics Stanford University. June 3, 2010

STATS306B STATS306B. Clustering. Jonathan Taylor Department of Statistics Stanford University. June 3, 2010 STATS306B Jonathan Taylor Department of Statistics Stanford University June 3, 2010 Spring 2010 Outline K-means, K-medoids, EM algorithm choosing number of clusters: Gap test hierarchical clustering spectral

More information

Chemometrics. Description of Pirouette Algorithms. Technical Note. Abstract

Chemometrics. Description of Pirouette Algorithms. Technical Note. Abstract 19-1214 Chemometrics Technical Note Description of Pirouette Algorithms Abstract This discussion introduces the three analysis realms available in Pirouette and briefly describes each of the algorithms

More information

10701 Machine Learning. Clustering

10701 Machine Learning. Clustering 171 Machine Learning Clustering What is Clustering? Organizing data into clusters such that there is high intra-cluster similarity low inter-cluster similarity Informally, finding natural groupings among

More information

Cluster Analysis and Visualization. Workshop on Statistics and Machine Learning 2004/2/6

Cluster Analysis and Visualization. Workshop on Statistics and Machine Learning 2004/2/6 Cluster Analysis and Visualization Workshop on Statistics and Machine Learning 2004/2/6 Outlines Introduction Stages in Clustering Clustering Analysis and Visualization One/two-dimensional Data Histogram,

More information

Multivariate statistics and geometric morphometrics

Multivariate statistics and geometric morphometrics Multivariate statistics and geometric morphometrics Eigenanalysis i used in several ways in geometric morphometrics: Calculation of partial warps. Use of partial warp scores in PCA, DFA, and CCA. Direct

More information

Smoothing Dissimilarities for Cluster Analysis: Binary Data and Functional Data

Smoothing Dissimilarities for Cluster Analysis: Binary Data and Functional Data Smoothing Dissimilarities for Cluster Analysis: Binary Data and unctional Data David B. University of South Carolina Department of Statistics Joint work with Zhimin Chen University of South Carolina Current

More information

Clustering. Bruno Martins. 1 st Semester 2012/2013

Clustering. Bruno Martins. 1 st Semester 2012/2013 Departamento de Engenharia Informática Instituto Superior Técnico 1 st Semester 2012/2013 Slides baseados nos slides oficiais do livro Mining the Web c Soumen Chakrabarti. Outline 1 Motivation Basic Concepts

More information

MULTIDIMENSIONAL SCALING: MULTIDIMENSIONAL SCALING: Using SPSS/PROXSCAL

MULTIDIMENSIONAL SCALING: MULTIDIMENSIONAL SCALING: Using SPSS/PROXSCAL MULTIDIMENSIONAL SCALING: MULTIDIMENSIONAL SCALING: Using SPSS/PROXSCAL SPSS 10 offers PROXSCAL (PROXimity SCALing) as an alternative to ALSCAL for multidimensional scaling: USE IT!! ALSCAL has been shown

More information

Machine Learning (BSMC-GA 4439) Wenke Liu

Machine Learning (BSMC-GA 4439) Wenke Liu Machine Learning (BSMC-GA 4439) Wenke Liu 01-31-017 Outline Background Defining proximity Clustering methods Determining number of clusters Comparing two solutions Cluster analysis as unsupervised Learning

More information

Chapter 2 Basic Structure of High-Dimensional Spaces

Chapter 2 Basic Structure of High-Dimensional Spaces Chapter 2 Basic Structure of High-Dimensional Spaces Data is naturally represented geometrically by associating each record with a point in the space spanned by the attributes. This idea, although simple,

More information

Gene Clustering & Classification

Gene Clustering & Classification BINF, Introduction to Computational Biology Gene Clustering & Classification Young-Rae Cho Associate Professor Department of Computer Science Baylor University Overview Introduction to Gene Clustering

More information

Multivariate morphometrics and its application to monography at specific and infraspecific levels

Multivariate morphometrics and its application to monography at specific and infraspecific levels Chapter 6. Multivariate morphometrics and its application to monography at specific and infraspecific levels Karol Marhold Introduction Multivariate morphometrics is a powerful tool for assessment of patterns

More information

Hierarchical Clustering

Hierarchical Clustering What is clustering Partitioning of a data set into subsets. A cluster is a group of relatively homogeneous cases or observations Hierarchical Clustering Mikhail Dozmorov Fall 2016 2/61 What is clustering

More information

Machine Learning Methods in Visualisation for Big Data 2018

Machine Learning Methods in Visualisation for Big Data 2018 Machine Learning Methods in Visualisation for Big Data 2018 Daniel Archambault1 Ian Nabney2 Jaakko Peltonen3 1 Swansea University 2 University of Bristol 3 University of Tampere, Aalto University Evaluating

More information

Unsupervised Learning

Unsupervised Learning Unsupervised Learning A review of clustering and other exploratory data analysis methods HST.951J: Medical Decision Support Harvard-MIT Division of Health Sciences and Technology HST.951J: Medical Decision

More information

Applying Supervised Learning

Applying Supervised Learning Applying Supervised Learning When to Consider Supervised Learning A supervised learning algorithm takes a known set of input data (the training set) and known responses to the data (output), and trains

More information

Hierarchical Clustering / Dendrograms

Hierarchical Clustering / Dendrograms Chapter 445 Hierarchical Clustering / Dendrograms Introduction The agglomerative hierarchical clustering algorithms available in this program module build a cluster hierarchy that is commonly displayed

More information

SYDE Winter 2011 Introduction to Pattern Recognition. Clustering

SYDE Winter 2011 Introduction to Pattern Recognition. Clustering SYDE 372 - Winter 2011 Introduction to Pattern Recognition Clustering Alexander Wong Department of Systems Design Engineering University of Waterloo Outline 1 2 3 4 5 All the approaches we have learned

More information

Points Lines Connected points X-Y Scatter. X-Y Matrix Star Plot Histogram Box Plot. Bar Group Bar Stacked H-Bar Grouped H-Bar Stacked

Points Lines Connected points X-Y Scatter. X-Y Matrix Star Plot Histogram Box Plot. Bar Group Bar Stacked H-Bar Grouped H-Bar Stacked Plotting Menu: QCExpert Plotting Module graphs offers various tools for visualization of uni- and multivariate data. Settings and options in different types of graphs allow for modifications and customizations

More information

Package fso. February 19, 2015

Package fso. February 19, 2015 Version 2.0-1 Date 2013-02-26 Title Fuzzy Set Ordination Package fso February 19, 2015 Author David W. Roberts Maintainer David W. Roberts Description Fuzzy

More information

Exploratory Data Analysis using Self-Organizing Maps. Madhumanti Ray

Exploratory Data Analysis using Self-Organizing Maps. Madhumanti Ray Exploratory Data Analysis using Self-Organizing Maps Madhumanti Ray Content Introduction Data Analysis methods Self-Organizing Maps Conclusion Visualization of high-dimensional data items Exploratory data

More information

Statistical Analysis of Metabolomics Data. Xiuxia Du Department of Bioinformatics & Genomics University of North Carolina at Charlotte

Statistical Analysis of Metabolomics Data. Xiuxia Du Department of Bioinformatics & Genomics University of North Carolina at Charlotte Statistical Analysis of Metabolomics Data Xiuxia Du Department of Bioinformatics & Genomics University of North Carolina at Charlotte Outline Introduction Data pre-treatment 1. Normalization 2. Centering,

More information

JMP Book Descriptions

JMP Book Descriptions JMP Book Descriptions The collection of JMP documentation is available in the JMP Help > Books menu. This document describes each title to help you decide which book to explore. Each book title is linked

More information

Machine Learning for OR & FE

Machine Learning for OR & FE Machine Learning for OR & FE Unsupervised Learning: Clustering Martin Haugh Department of Industrial Engineering and Operations Research Columbia University Email: martin.b.haugh@gmail.com (Some material

More information

Data Preprocessing. Javier Béjar. URL - Spring 2018 CS - MAI 1/78 BY: $\

Data Preprocessing. Javier Béjar. URL - Spring 2018 CS - MAI 1/78 BY: $\ Data Preprocessing Javier Béjar BY: $\ URL - Spring 2018 C CS - MAI 1/78 Introduction Data representation Unstructured datasets: Examples described by a flat set of attributes: attribute-value matrix Structured

More information

The MDS-GUI: A Graphical User Interface for Comprehensive Multidimensional Scaling Applications

The MDS-GUI: A Graphical User Interface for Comprehensive Multidimensional Scaling Applications Proceedings 59th ISI World Statistics Congress, 25-30 August 2013, Hong Kong (Session CPS029) p.4159 The MDS-GUI: A Graphical User Interface for Comprehensive Multidimensional Scaling Applications Andrew

More information

2016 Stat-Ease, Inc. & CAMO Software

2016 Stat-Ease, Inc. & CAMO Software Multivariate Analysis and Design of Experiments in practice using The Unscrambler X Frank Westad CAMO Software fw@camo.com Pat Whitcomb Stat-Ease pat@statease.com Agenda Goal: Part 1: Part 2: Show how

More information

COMBINED METHOD TO VISUALISE AND REDUCE DIMENSIONALITY OF THE FINANCIAL DATA SETS

COMBINED METHOD TO VISUALISE AND REDUCE DIMENSIONALITY OF THE FINANCIAL DATA SETS COMBINED METHOD TO VISUALISE AND REDUCE DIMENSIONALITY OF THE FINANCIAL DATA SETS Toomas Kirt Supervisor: Leo Võhandu Tallinn Technical University Toomas.Kirt@mail.ee Abstract: Key words: For the visualisation

More information

Chapter 6 Continued: Partitioning Methods

Chapter 6 Continued: Partitioning Methods Chapter 6 Continued: Partitioning Methods Partitioning methods fix the number of clusters k and seek the best possible partition for that k. The goal is to choose the partition which gives the optimal

More information

Linear Methods for Regression and Shrinkage Methods

Linear Methods for Regression and Shrinkage Methods Linear Methods for Regression and Shrinkage Methods Reference: The Elements of Statistical Learning, by T. Hastie, R. Tibshirani, J. Friedman, Springer 1 Linear Regression Models Least Squares Input vectors

More information

Machine Learning and Data Mining. Clustering (1): Basics. Kalev Kask

Machine Learning and Data Mining. Clustering (1): Basics. Kalev Kask Machine Learning and Data Mining Clustering (1): Basics Kalev Kask Unsupervised learning Supervised learning Predict target value ( y ) given features ( x ) Unsupervised learning Understand patterns of

More information

2. Find the smallest element of the dissimilarity matrix. If this is D lm then fuse groups l and m.

2. Find the smallest element of the dissimilarity matrix. If this is D lm then fuse groups l and m. Cluster Analysis The main aim of cluster analysis is to find a group structure for all the cases in a sample of data such that all those which are in a particular group (cluster) are relatively similar

More information

IBM SPSS Categories 23

IBM SPSS Categories 23 IBM SPSS Categories 23 Note Before using this information and the product it supports, read the information in Notices on page 55. Product Information This edition applies to version 23, release 0, modification

More information

Principal Component Analysis

Principal Component Analysis Copyright 2004, Casa Software Ltd. All Rights Reserved. 1 of 16 Principal Component Analysis Introduction XPS is a technique that provides chemical information about a sample that sets it apart from other

More information

DI TRANSFORM. The regressive analyses. identify relationships

DI TRANSFORM. The regressive analyses. identify relationships July 2, 2015 DI TRANSFORM MVstats TM Algorithm Overview Summary The DI Transform Multivariate Statistics (MVstats TM ) package includes five algorithm options that operate on most types of geologic, geophysical,

More information

SELECTION OF A MULTIVARIATE CALIBRATION METHOD

SELECTION OF A MULTIVARIATE CALIBRATION METHOD SELECTION OF A MULTIVARIATE CALIBRATION METHOD 0. Aim of this document Different types of multivariate calibration methods are available. The aim of this document is to help the user select the proper

More information

Basics of Multivariate Modelling and Data Analysis

Basics of Multivariate Modelling and Data Analysis Basics of Multivariate Modelling and Data Analysis Kurt-Erik Häggblom 9. Linear regression with latent variables 9.1 Principal component regression (PCR) 9.2 Partial least-squares regression (PLS) [ mostly

More information

Notes on Fuzzy Set Ordination

Notes on Fuzzy Set Ordination Notes on Fuzzy Set Ordination Umer Zeeshan Ijaz School of Engineering, University of Glasgow, UK Umer.Ijaz@glasgow.ac.uk http://userweb.eng.gla.ac.uk/umer.ijaz May 3, 014 1 Introduction The membership

More information

CSE 6242 A / CS 4803 DVA. Feb 12, Dimension Reduction. Guest Lecturer: Jaegul Choo

CSE 6242 A / CS 4803 DVA. Feb 12, Dimension Reduction. Guest Lecturer: Jaegul Choo CSE 6242 A / CS 4803 DVA Feb 12, 2013 Dimension Reduction Guest Lecturer: Jaegul Choo CSE 6242 A / CS 4803 DVA Feb 12, 2013 Dimension Reduction Guest Lecturer: Jaegul Choo Data is Too Big To Do Something..

More information

Package PCPS. R topics documented: May 24, Type Package

Package PCPS. R topics documented: May 24, Type Package Type Package Package PCPS May 24, 2018 Title Principal Coordinates of Phylogenetic Structure Version 1.0.6 Date 2018-05-24 Author Vanderlei Julio Debastiani Maintainer Vanderlei Julio Debastiani

More information

Clustering. CS294 Practical Machine Learning Junming Yin 10/09/06

Clustering. CS294 Practical Machine Learning Junming Yin 10/09/06 Clustering CS294 Practical Machine Learning Junming Yin 10/09/06 Outline Introduction Unsupervised learning What is clustering? Application Dissimilarity (similarity) of objects Clustering algorithm K-means,

More information

Feature selection. Term 2011/2012 LSI - FIB. Javier Béjar cbea (LSI - FIB) Feature selection Term 2011/ / 22

Feature selection. Term 2011/2012 LSI - FIB. Javier Béjar cbea (LSI - FIB) Feature selection Term 2011/ / 22 Feature selection Javier Béjar cbea LSI - FIB Term 2011/2012 Javier Béjar cbea (LSI - FIB) Feature selection Term 2011/2012 1 / 22 Outline 1 Dimensionality reduction 2 Projections 3 Attribute selection

More information

CIE L*a*b* color model

CIE L*a*b* color model CIE L*a*b* color model To further strengthen the correlation between the color model and human perception, we apply the following non-linear transformation: with where (X n,y n,z n ) are the tristimulus

More information

San Jose State University. Math 285: Selected Topics of High Dimensional Data Modeling

San Jose State University. Math 285: Selected Topics of High Dimensional Data Modeling Project Report on Ordinal MDS and Spectral Clustering on Students Knowledge and Performance Status and Toy Data San Jose State University Math 285: Selected Topics of High Dimensional Data Modeling Submitted

More information

Introduction to machine learning, pattern recognition and statistical data modelling Coryn Bailer-Jones

Introduction to machine learning, pattern recognition and statistical data modelling Coryn Bailer-Jones Introduction to machine learning, pattern recognition and statistical data modelling Coryn Bailer-Jones What is machine learning? Data interpretation describing relationship between predictors and responses

More information

SGN (4 cr) Chapter 10

SGN (4 cr) Chapter 10 SGN-41006 (4 cr) Chapter 10 Feature Selection and Extraction Jussi Tohka & Jari Niemi Department of Signal Processing Tampere University of Technology February 18, 2014 J. Tohka & J. Niemi (TUT-SGN) SGN-41006

More information

Clustering CS 550: Machine Learning

Clustering CS 550: Machine Learning Clustering CS 550: Machine Learning This slide set mainly uses the slides given in the following links: http://www-users.cs.umn.edu/~kumar/dmbook/ch8.pdf http://www-users.cs.umn.edu/~kumar/dmbook/dmslides/chap8_basic_cluster_analysis.pdf

More information

Understanding Clustering Supervising the unsupervised

Understanding Clustering Supervising the unsupervised Understanding Clustering Supervising the unsupervised Janu Verma IBM T.J. Watson Research Center, New York http://jverma.github.io/ jverma@us.ibm.com @januverma Clustering Grouping together similar data

More information

Contents. List of Figures. List of Tables. List of Algorithms. I Clustering, Data, and Similarity Measures 1

Contents. List of Figures. List of Tables. List of Algorithms. I Clustering, Data, and Similarity Measures 1 Contents List of Figures List of Tables List of Algorithms Preface xiii xv xvii xix I Clustering, Data, and Similarity Measures 1 1 Data Clustering 3 1.1 Definition of Data Clustering... 3 1.2 The Vocabulary

More information

AN IMPROVED HYBRIDIZED K- MEANS CLUSTERING ALGORITHM (IHKMCA) FOR HIGHDIMENSIONAL DATASET & IT S PERFORMANCE ANALYSIS

AN IMPROVED HYBRIDIZED K- MEANS CLUSTERING ALGORITHM (IHKMCA) FOR HIGHDIMENSIONAL DATASET & IT S PERFORMANCE ANALYSIS AN IMPROVED HYBRIDIZED K- MEANS CLUSTERING ALGORITHM (IHKMCA) FOR HIGHDIMENSIONAL DATASET & IT S PERFORMANCE ANALYSIS H.S Behera Department of Computer Science and Engineering, Veer Surendra Sai University

More information

Medoid Partitioning. Chapter 447. Introduction. Dissimilarities. Types of Cluster Variables. Interval Variables. Ordinal Variables.

Medoid Partitioning. Chapter 447. Introduction. Dissimilarities. Types of Cluster Variables. Interval Variables. Ordinal Variables. Chapter 447 Introduction The objective of cluster analysis is to partition a set of objects into two or more clusters such that objects within a cluster are similar and objects in different clusters are

More information

Analysis and Latent Semantic Indexing

Analysis and Latent Semantic Indexing 18 Principal Component Analysis and Latent Semantic Indexing Understand the basics of principal component analysis and latent semantic index- Lab Objective: ing. Principal Component Analysis Understanding

More information

Statistical Models for Management. Instituto Superior de Ciências do Trabalho e da Empresa (ISCTE) Lisbon. February 24 26, 2010

Statistical Models for Management. Instituto Superior de Ciências do Trabalho e da Empresa (ISCTE) Lisbon. February 24 26, 2010 Statistical Models for Management Instituto Superior de Ciências do Trabalho e da Empresa (ISCTE) Lisbon February 24 26, 2010 Graeme Hutcheson, University of Manchester Principal Component and Factor Analysis

More information

Recent Research Results. Evolutionary Trees Distance Methods

Recent Research Results. Evolutionary Trees Distance Methods Recent Research Results Evolutionary Trees Distance Methods Indo-European Languages After Tandy Warnow What is the purpose? Understand evolutionary history (relationship between species). Uderstand how

More information

Chapter 13 Multivariate Techniques. Chapter Table of Contents

Chapter 13 Multivariate Techniques. Chapter Table of Contents Chapter 13 Multivariate Techniques Chapter Table of Contents Introduction...279 Principal Components Analysis...280 Canonical Correlation...289 References...298 278 Chapter 13. Multivariate Techniques

More information

INF 4300 Classification III Anne Solberg The agenda today:

INF 4300 Classification III Anne Solberg The agenda today: INF 4300 Classification III Anne Solberg 28.10.15 The agenda today: More on estimating classifier accuracy Curse of dimensionality and simple feature selection knn-classification K-means clustering 28.10.15

More information

Clustering and Visualisation of Data

Clustering and Visualisation of Data Clustering and Visualisation of Data Hiroshi Shimodaira January-March 28 Cluster analysis aims to partition a data set into meaningful or useful groups, based on distances between data points. In some

More information

Year 10 General Mathematics Unit 2

Year 10 General Mathematics Unit 2 Year 11 General Maths Year 10 General Mathematics Unit 2 Bivariate Data Chapter 4 Chapter Four 1 st Edition 2 nd Edition 2013 4A 1, 2, 3, 4, 6, 7, 8, 9, 10, 11 1, 2, 3, 4, 6, 7, 8, 9, 10, 11 2F (FM) 1,

More information

Evgeny Maksakov Advantages and disadvantages: Advantages and disadvantages: Advantages and disadvantages: Advantages and disadvantages:

Evgeny Maksakov Advantages and disadvantages: Advantages and disadvantages: Advantages and disadvantages: Advantages and disadvantages: Today Problems with visualizing high dimensional data Problem Overview Direct Visualization Approaches High dimensionality Visual cluttering Clarity of representation Visualization is time consuming Dimensional

More information

Generalized least squares (GLS) estimates of the level-2 coefficients,

Generalized least squares (GLS) estimates of the level-2 coefficients, Contents 1 Conceptual and Statistical Background for Two-Level Models...7 1.1 The general two-level model... 7 1.1.1 Level-1 model... 8 1.1.2 Level-2 model... 8 1.2 Parameter estimation... 9 1.3 Empirical

More information

DESIGN OF EXPERIMENTS and ROBUST DESIGN

DESIGN OF EXPERIMENTS and ROBUST DESIGN DESIGN OF EXPERIMENTS and ROBUST DESIGN Problems in design and production environments often require experiments to find a solution. Design of experiments are a collection of statistical methods that,

More information

MULTIVARIATE ANALYSIS USING R

MULTIVARIATE ANALYSIS USING R MULTIVARIATE ANALYSIS USING R B N Mandal I.A.S.R.I., Library Avenue, New Delhi 110 012 bnmandal @iasri.res.in 1. Introduction This article gives an exposition of how to use the R statistical software for

More information

Non-linear dimension reduction

Non-linear dimension reduction Sta306b May 23, 2011 Dimension Reduction: 1 Non-linear dimension reduction ISOMAP: Tenenbaum, de Silva & Langford (2000) Local linear embedding: Roweis & Saul (2000) Local MDS: Chen (2006) all three methods

More information

Multiresponse Sparse Regression with Application to Multidimensional Scaling

Multiresponse Sparse Regression with Application to Multidimensional Scaling Multiresponse Sparse Regression with Application to Multidimensional Scaling Timo Similä and Jarkko Tikka Helsinki University of Technology, Laboratory of Computer and Information Science P.O. Box 54,

More information

CPSC 340: Machine Learning and Data Mining. Principal Component Analysis Fall 2016

CPSC 340: Machine Learning and Data Mining. Principal Component Analysis Fall 2016 CPSC 340: Machine Learning and Data Mining Principal Component Analysis Fall 2016 A2/Midterm: Admin Grades/solutions will be posted after class. Assignment 4: Posted, due November 14. Extra office hours:

More information

Trees, Dendrograms and Sensitivity

Trees, Dendrograms and Sensitivity Trees, Dendrograms and Sensitivity R.D. Braddock Cooperative Research Centre for Catchment Hydrology, Griffith University, Nathan, Qld 4111, Australia (r.braddock@mailbo.gu.edu.au) Abstract: Dendrograms

More information

Network Traffic Measurements and Analysis

Network Traffic Measurements and Analysis DEIB - Politecnico di Milano Fall, 2017 Introduction Often, we have only a set of features x = x 1, x 2,, x n, but no associated response y. Therefore we are not interested in prediction nor classification,

More information