MULTIVARIATE ANALYSES WITH fmri DATA

Size: px
Start display at page:

Download "MULTIVARIATE ANALYSES WITH fmri DATA"

Transcription

1 MULTIVARIATE ANALYSES WITH fmri DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) Institute for Biomedical Engineering University of Zurich & ETH Zurich

2 Motivation Modelling Concepts Learning From Data Multivariate Bayes in SPM Generative Embedding

3 Motivation Local activations Univariate approach 1 2 significant not significant

4 Univariate to Multivariate 1 2 not significant not significant 1 2

5 Motivation Modelling Terminology Learning from data Multivariate Bayes in SPM Generative Embedding

6 Steps for analysis Feature Extraction Classification Clustering Modelling Regression Inference Cross validation Performance Prediction Model Selection

7 Feature Space Features F 1 F 2... F P S Data Points S S N Discrete Continuous

8 Feature Space Examples Raw data F 1 F 2... F P S 1 S 2. Data Point or Feature Vector. High dimensionality S N Class/Cluster distributions Interpretation Voxel activity Model parameters GLM regression coefficients DCM connection parameters

9 Model Selection - Generalizability Model Fit Model Complexity Bishop (2006), Pitt & Miyung (2002), TICS

10 Modelling goals Prediction Y h X Predictive Density

11 Modelling goals Model Selection Sparse Coding Distributed Coding Model Evidence

12 Motivation Modelling Concepts Learning From Data Multivariate Bayes in SPM Generative Embedding

13 Learning from Data Supervised Learning Unsupervised Learning Reinforcement Learning Semi-supervised Learning

14 Supervised Learning Independent variables X Function - f Continuous dependent variable Y Categorical

15 Classification X Function - f Y Generative classifier Discriminative classifier Kernel Methods Support Vector Machines φ Kernel Function K x i, x j = φ x i. φ x j Kernel methods for pattern analysis, Taylor, Cristianini, 2004

16 Other popular classifiers Gaussian Processes C. E. Rasmussen & C. K. I. Williams, Gaussian Processes for Machine Learning, the MIT Press, 2006, Deep Belief networks G.E. Hinton, S. Osindero, and Y. Teh, A fast learning algorithm for deep belief nets, Neural Computation, vol 18, 2006

17 K-fold Cross Validation Model Selection Performance evaluation 1 Balanced Accuracy F1 Score Training data Test data Accuracy 87% 2 75% 3 89%

18 Performance Single Subject Binomial Test p = P X k H 0 = 1 B k n, π 0 Brodersen et al. 2013, NeuroImage k=30

19 Performance Multiple Subjects Random effects Fixed effects Brodersen et al. 2013, NeuroImage

20 Using classification for fmri data Whole brain Searchlight classifier Mourao-Miranda et al. (2005) NeuroImage, Marquand et al. (2010) NeuroImage Kriegeskorte et al. (2006) PNAS Pattern localization Word Category Food Building People Pereira et al. (2009) NeuroImage, Mitchell et al. (2004) Machine Learning

21 Confounds GLM vs MVPA Todd et al. 2013, NeuroImage

22 Practicals Classification using SVM Bishop (2006) PRML

23 Unsupervised Learning Building a representation of data Dimensionality Reduction Clustering Time series K-means Mixture models

24 Clustering using K-means Cost function Algorithm 1. Initialize 2. Estimate assignments 3. Estimate cluster centroids 4. Repeat 2,3 until convergence Bishop PRML (2006)

25 Clustering Mixture of Gaussians Bishop PRML (2006)

26 Interpretation Cluster parameters Cluster 1 Cluster 2 Internal Criterion Model Evidence External Criterion - Purity Inferred Labels Subjects External Labels

27 Practicals Clustering K-Means Finite Gaussian mixture model Bishop (2006) PRML

28 Motivation Modelling Learning from Data Multivariate Bayes in SPM Generative Embedding

29 Encoding Vs Decoding Models

30 Encoding Vs Decoding Friston et al NeuroImage

31 Coding hypotheses Sparse vectors Spatial vectors Smooth vectors Distributed vectors Singular vectors of data UUV T = RY T Support vectors U = RY T

32 Coding hypotheses Friston et al NeuroImage

33 VB Inference Friston et al NeuroImage

34 Bayesian decoding of motion Attention to motion dataset - Büchel & Friston 1999 Cerebral Cortex Experimental factors: 1. Photic 2. Motion 3. Attention Friston et al NeuroImage

35 Multivariate Bayes in SPM

36 Results Friston et al NeuroImage

37 Results

38 Laminar activity related to novelty and episodic encoding Maas et al Nature Communications

39 Demo Bayesian decoding of motion in SPM

40 Motivation Modelling Principles Learning from Data Multivariate Bayes in SPM Generative Embedding

41 Voxel activity Subject 1 Subject 2. Dynamic causal model (DCM) High dimensionality Unusual cluster distributions Lack of interpretation Connectivity Subject 1 Subject 2. Subject N Classification Clustering Subject N Group 1 Group 2

42 Generative Embedding - Classification Brodersen et al. plos computation biology 2011.

43 DCM - Speech processing Brodersen et al. plos computation biology 2011.

44 Working memory - fmri 41 Schizophrenia patients (DSM IV,ICD 10), 42 controls Visual numeric n-back working memory task ms ms Deserno, Lorenz et al The Journal of Neuroscience 32 (1). Society for Neuroscience:

45 Model based clustering Brodersen et al 2014 Neuroimage

46 Results Healthy vs Schizophrenic Brodersen et al 2014 Neuroimage

47 Results Schizophrenia patients Brodersen et al 2014 Neuroimage

48 Unified model for identifying subgroups Raman et al A hierarchical model for integrating unsupervised generative embedding and empirical Bayes.Submitted

49 Summary Modelling Principles Learning from Data Multivariate Bayes in SPM Generative Embedding

50 Thank you

Multivariate analyses & decoding

Multivariate analyses & decoding Multivariate analyses & decoding Kay Henning Brodersen Computational Neuroeconomics Group Department of Economics, University of Zurich Machine Learning and Pattern Recognition Group Department of Computer

More information

Bayesian Inference in fmri Will Penny

Bayesian Inference in fmri Will Penny Bayesian Inference in fmri Will Penny Bayesian Approaches in Neuroscience Karolinska Institutet, Stockholm February 2016 Overview Posterior Probability Maps Hemodynamic Response Functions Population

More information

MultiVariate Bayesian (MVB) decoding of brain images

MultiVariate Bayesian (MVB) decoding of brain images MultiVariate Bayesian (MVB) decoding of brain images Alexa Morcom Edinburgh SPM course 2015 With thanks to J. Daunizeau, K. Brodersen for slides stimulus behaviour encoding of sensorial or cognitive state?

More information

Interpreting predictive models in terms of anatomically labelled regions

Interpreting predictive models in terms of anatomically labelled regions Interpreting predictive models in terms of anatomically labelled regions Data Feature extraction/selection Model specification Accuracy and significance Model interpretation 2 Data Feature extraction/selection

More information

Pattern Recognition for Neuroimaging Data

Pattern Recognition for Neuroimaging Data Pattern Recognition for Neuroimaging Data Edinburgh, SPM course April 2013 C. Phillips, Cyclotron Research Centre, ULg, Belgium http://www.cyclotron.ulg.ac.be Overview Introduction Univariate & multivariate

More information

Pa#ern Recogni-on for Neuroimaging Toolbox

Pa#ern Recogni-on for Neuroimaging Toolbox Pa#ern Recogni-on for Neuroimaging Toolbox Pa#ern Recogni-on Methods: Basics João M. Monteiro Based on slides from Jessica Schrouff and Janaina Mourão-Miranda PRoNTo course UCL, London, UK 2017 Outline

More information

Multi-voxel pattern analysis: Decoding Mental States from fmri Activity Patterns

Multi-voxel pattern analysis: Decoding Mental States from fmri Activity Patterns Multi-voxel pattern analysis: Decoding Mental States from fmri Activity Patterns Artwork by Leon Zernitsky Jesse Rissman NITP Summer Program 2012 Part 1 of 2 Goals of Multi-voxel Pattern Analysis Decoding

More information

Correction for multiple comparisons. Cyril Pernet, PhD SBIRC/SINAPSE University of Edinburgh

Correction for multiple comparisons. Cyril Pernet, PhD SBIRC/SINAPSE University of Edinburgh Correction for multiple comparisons Cyril Pernet, PhD SBIRC/SINAPSE University of Edinburgh Overview Multiple comparisons correction procedures Levels of inferences (set, cluster, voxel) Circularity issues

More information

Multivariate Pattern Classification. Thomas Wolbers Space and Aging Laboratory Centre for Cognitive and Neural Systems

Multivariate Pattern Classification. Thomas Wolbers Space and Aging Laboratory Centre for Cognitive and Neural Systems Multivariate Pattern Classification Thomas Wolbers Space and Aging Laboratory Centre for Cognitive and Neural Systems Outline WHY PATTERN CLASSIFICATION? PROCESSING STREAM PREPROCESSING / FEATURE REDUCTION

More information

Overview Citation. ML Introduction. Overview Schedule. ML Intro Dataset. Introduction to Semi-Supervised Learning Review 10/4/2010

Overview Citation. ML Introduction. Overview Schedule. ML Intro Dataset. Introduction to Semi-Supervised Learning Review 10/4/2010 INFORMATICS SEMINAR SEPT. 27 & OCT. 4, 2010 Introduction to Semi-Supervised Learning Review 2 Overview Citation X. Zhu and A.B. Goldberg, Introduction to Semi- Supervised Learning, Morgan & Claypool Publishers,

More information

Multivariate pattern classification

Multivariate pattern classification Multivariate pattern classification Thomas Wolbers Space & Ageing Laboratory (www.sal.mvm.ed.ac.uk) Centre for Cognitive and Neural Systems & Centre for Cognitive Ageing and Cognitive Epidemiology Outline

More information

Introduction to Neuroimaging Janaina Mourao-Miranda

Introduction to Neuroimaging Janaina Mourao-Miranda Introduction to Neuroimaging Janaina Mourao-Miranda Neuroimaging techniques have changed the way neuroscientists address questions about functional anatomy, especially in relation to behavior and clinical

More information

Feature Selection for fmri Classification

Feature Selection for fmri Classification Feature Selection for fmri Classification Chuang Wu Program of Computational Biology Carnegie Mellon University Pittsburgh, PA 15213 chuangw@andrew.cmu.edu Abstract The functional Magnetic Resonance Imaging

More information

Second revision: Supplementary Material Linking brain-wide multivoxel activation patterns to behaviour: examples from language and math

Second revision: Supplementary Material Linking brain-wide multivoxel activation patterns to behaviour: examples from language and math Second revision: Supplementary Material Linking brain-wide multivoxel activation patterns to behaviour: examples from language and math Rajeev D. S. Raizada, Feng Ming Tsao, Huei-Mei Liu, Ian D. Holloway,

More information

Methods for data preprocessing

Methods for data preprocessing Methods for data preprocessing John Ashburner Wellcome Trust Centre for Neuroimaging, 12 Queen Square, London, UK. Overview Voxel-Based Morphometry Morphometry in general Volumetrics VBM preprocessing

More information

Keyword Extraction by KNN considering Similarity among Features

Keyword Extraction by KNN considering Similarity among Features 64 Int'l Conf. on Advances in Big Data Analytics ABDA'15 Keyword Extraction by KNN considering Similarity among Features Taeho Jo Department of Computer and Information Engineering, Inha University, Incheon,

More information

Neural Networks and Deep Learning

Neural Networks and Deep Learning Neural Networks and Deep Learning Example Learning Problem Example Learning Problem Celebrity Faces in the Wild Machine Learning Pipeline Raw data Feature extract. Feature computation Inference: prediction,

More information

What is machine learning?

What is machine learning? Machine learning, pattern recognition and statistical data modelling Lecture 12. The last lecture Coryn Bailer-Jones 1 What is machine learning? Data description and interpretation finding simpler relationship

More information

Multi-Voxel Pattern Analysis (MVPA) for fmri

Multi-Voxel Pattern Analysis (MVPA) for fmri MVPA for - and Multi-Voxel Pattern Analysis (MVPA) for 7 th M-BIC Workshop 2012 Maastricht University, Department of Cognitive Neuroscience Maastricht Brain Imaging Center (M-Bic), Maastricht, The Netherlands

More information

Data mining for neuroimaging data. John Ashburner

Data mining for neuroimaging data. John Ashburner Data mining for neuroimaging data John Ashburner MODELLING The Scientific Process MacKay, David JC. Bayesian interpolation. Neural computation 4, no. 3 (1992): 415-447. Model Selection Search for the best

More information

Understanding multivariate pattern analysis for neuroimaging applications

Understanding multivariate pattern analysis for neuroimaging applications Understanding multivariate pattern analysis for neuroimaging applications Dimitri Van De Ville Medical Image Processing Lab, Institute of Bioengineering, Ecole Polytechnique Fédérale de Lausanne Department

More information

Karl Friston, Carlton Chu, Janaina Mourão-Miranda, Oliver Hulme, Geraint Rees, Will Penny, John Ashburner

Karl Friston, Carlton Chu, Janaina Mourão-Miranda, Oliver Hulme, Geraint Rees, Will Penny, John Ashburner Accepted Manuscript Bayesian decoding of brain images Karl Friston, Carlton Chu, Janaina Mourão-Miranda, Oliver Hulme, Geraint Rees, Will Penny, John Ashburner PII: S1053-8119(07)00720-3 DOI: doi: 10.1016/j.neuroimage.2007.08.013

More information

COMP 551 Applied Machine Learning Lecture 13: Unsupervised learning

COMP 551 Applied Machine Learning Lecture 13: Unsupervised learning COMP 551 Applied Machine Learning Lecture 13: Unsupervised learning Associate Instructor: Herke van Hoof (herke.vanhoof@mail.mcgill.ca) Slides mostly by: (jpineau@cs.mcgill.ca) Class web page: www.cs.mcgill.ca/~jpineau/comp551

More information

Representational similarity analysis. Dr Ian Charest,

Representational similarity analysis. Dr Ian Charest, Representational similarity analysis Dr Ian Charest, Edinburgh, April 219 A space for neuroimaging studies Pattern across subjects Cross-subject correlation studies (e.g. social neuroscience) Raizada et

More information

ECG782: Multidimensional Digital Signal Processing

ECG782: Multidimensional Digital Signal Processing ECG782: Multidimensional Digital Signal Processing Object Recognition http://www.ee.unlv.edu/~b1morris/ecg782/ 2 Outline Knowledge Representation Statistical Pattern Recognition Neural Networks Boosting

More information

Predictive Analytics: Demystifying Current and Emerging Methodologies. Tom Kolde, FCAS, MAAA Linda Brobeck, FCAS, MAAA

Predictive Analytics: Demystifying Current and Emerging Methodologies. Tom Kolde, FCAS, MAAA Linda Brobeck, FCAS, MAAA Predictive Analytics: Demystifying Current and Emerging Methodologies Tom Kolde, FCAS, MAAA Linda Brobeck, FCAS, MAAA May 18, 2017 About the Presenters Tom Kolde, FCAS, MAAA Consulting Actuary Chicago,

More information

Multivariate fmri Analysis using Canonical Correlation Analysis instead of Classifiers, Comment on Todd et al.

Multivariate fmri Analysis using Canonical Correlation Analysis instead of Classifiers, Comment on Todd et al. Multivariate fmri Analysis using Canonical Correlation Analysis instead of Classifiers, Comment on Todd et al. Anders Eklund a, Hans Knutsson bc a Virginia Tech Carilion Research Institute, Virginia Tech,

More information

Can we interpret weight maps in terms of cognitive/clinical neuroscience? Jessica Schrouff

Can we interpret weight maps in terms of cognitive/clinical neuroscience? Jessica Schrouff Can we interpret weight maps in terms of cognitive/clinical neuroscience? Jessica Schrouff Computer Science Department, University College London, UK Laboratory of Behavioral and Cognitive Neuroscience,

More information

Applied Statistics for Neuroscientists Part IIa: Machine Learning

Applied Statistics for Neuroscientists Part IIa: Machine Learning Applied Statistics for Neuroscientists Part IIa: Machine Learning Dr. Seyed-Ahmad Ahmadi 04.04.2017 16.11.2017 Outline Machine Learning Difference between statistics and machine learning Modeling the problem

More information

Cognitive States Detection in fmri Data Analysis using incremental PCA

Cognitive States Detection in fmri Data Analysis using incremental PCA Department of Computer Engineering Cognitive States Detection in fmri Data Analysis using incremental PCA Hoang Trong Minh Tuan, Yonggwan Won*, Hyung-Jeong Yang International Conference on Computational

More information

Naïve Bayes, Gaussian Distributions, Practical Applications

Naïve Bayes, Gaussian Distributions, Practical Applications Naïve Bayes, Gaussian Distributions, Practical Applications Required reading: Mitchell draft chapter, sections 1 and 2. (available on class website) Machine Learning 10-601 Tom M. Mitchell Machine Learning

More information

Preface to the Second Edition. Preface to the First Edition. 1 Introduction 1

Preface to the Second Edition. Preface to the First Edition. 1 Introduction 1 Preface to the Second Edition Preface to the First Edition vii xi 1 Introduction 1 2 Overview of Supervised Learning 9 2.1 Introduction... 9 2.2 Variable Types and Terminology... 9 2.3 Two Simple Approaches

More information

Voxel selection algorithms for fmri

Voxel selection algorithms for fmri Voxel selection algorithms for fmri Henryk Blasinski December 14, 2012 1 Introduction Functional Magnetic Resonance Imaging (fmri) is a technique to measure and image the Blood- Oxygen Level Dependent

More information

Learning Tensor-Based Features for Whole-Brain fmri Classification

Learning Tensor-Based Features for Whole-Brain fmri Classification Learning Tensor-Based Features for Whole-Brain fmri Classification Xiaonan Song, Lingnan Meng, Qiquan Shi, and Haiping Lu Department of Computer Science, Hong Kong Baptist University haiping@hkbu.edu.hk

More information

A Taxonomy of Semi-Supervised Learning Algorithms

A Taxonomy of Semi-Supervised Learning Algorithms A Taxonomy of Semi-Supervised Learning Algorithms Olivier Chapelle Max Planck Institute for Biological Cybernetics December 2005 Outline 1 Introduction 2 Generative models 3 Low density separation 4 Graph

More information

CS 229 Final Project Report Learning to Decode Cognitive States of Rat using Functional Magnetic Resonance Imaging Time Series

CS 229 Final Project Report Learning to Decode Cognitive States of Rat using Functional Magnetic Resonance Imaging Time Series CS 229 Final Project Report Learning to Decode Cognitive States of Rat using Functional Magnetic Resonance Imaging Time Series Jingyuan Chen //Department of Electrical Engineering, cjy2010@stanford.edu//

More information

C. Poultney S. Cho pra (NYU Courant Institute) Y. LeCun

C. Poultney S. Cho pra (NYU Courant Institute) Y. LeCun Efficient Learning of Sparse Overcomplete Representations with an Energy-Based Model Marc'Aurelio Ranzato C. Poultney S. Cho pra (NYU Courant Institute) Y. LeCun CIAR Summer School Toronto 2006 Why Extracting

More information

Contents. Preface to the Second Edition

Contents. Preface to the Second Edition Preface to the Second Edition v 1 Introduction 1 1.1 What Is Data Mining?....................... 4 1.2 Motivating Challenges....................... 5 1.3 The Origins of Data Mining....................

More information

ADVANCED ANALYTICS USING SAS ENTERPRISE MINER RENS FEENSTRA

ADVANCED ANALYTICS USING SAS ENTERPRISE MINER RENS FEENSTRA INSIGHTS@SAS: ADVANCED ANALYTICS USING SAS ENTERPRISE MINER RENS FEENSTRA AGENDA 09.00 09.15 Intro 09.15 10.30 Analytics using SAS Enterprise Guide Ellen Lokollo 10.45 12.00 Advanced Analytics using SAS

More information

Thorsten Joachims Then: Universität Dortmund, Germany Now: Cornell University, USA

Thorsten Joachims Then: Universität Dortmund, Germany Now: Cornell University, USA Retrospective ICML99 Transductive Inference for Text Classification using Support Vector Machines Thorsten Joachims Then: Universität Dortmund, Germany Now: Cornell University, USA Outline The paper in

More information

Machine Learning / Jan 27, 2010

Machine Learning / Jan 27, 2010 Revisiting Logistic Regression & Naïve Bayes Aarti Singh Machine Learning 10-701/15-781 Jan 27, 2010 Generative and Discriminative Classifiers Training classifiers involves learning a mapping f: X -> Y,

More information

Feature Selection. CE-725: Statistical Pattern Recognition Sharif University of Technology Spring Soleymani

Feature Selection. CE-725: Statistical Pattern Recognition Sharif University of Technology Spring Soleymani Feature Selection CE-725: Statistical Pattern Recognition Sharif University of Technology Spring 2013 Soleymani Outline Dimensionality reduction Feature selection vs. feature extraction Filter univariate

More information

Using Machine Learning to Optimize Storage Systems

Using Machine Learning to Optimize Storage Systems Using Machine Learning to Optimize Storage Systems Dr. Kiran Gunnam 1 Outline 1. Overview 2. Building Flash Models using Logistic Regression. 3. Storage Object classification 4. Storage Allocation recommendation

More information

Neural Networks. Single-layer neural network. CSE 446: Machine Learning Emily Fox University of Washington March 10, /10/2017

Neural Networks. Single-layer neural network. CSE 446: Machine Learning Emily Fox University of Washington March 10, /10/2017 3/0/207 Neural Networks Emily Fox University of Washington March 0, 207 Slides adapted from Ali Farhadi (via Carlos Guestrin and Luke Zettlemoyer) Single-layer neural network 3/0/207 Perceptron as a neural

More information

Machine Learning (CSMML16) (Autumn term, ) Xia Hong

Machine Learning (CSMML16) (Autumn term, ) Xia Hong Machine Learning (CSMML16) (Autumn term, 28-29) Xia Hong 1 Useful books: 1. C. M. Bishop: Pattern Recognition and Machine Learning (2007) Springer. 2. S. Haykin: Neural Networks (1999) Prentice Hall. 3.

More information

Clustering and The Expectation-Maximization Algorithm

Clustering and The Expectation-Maximization Algorithm Clustering and The Expectation-Maximization Algorithm Unsupervised Learning Marek Petrik 3/7 Some of the figures in this presentation are taken from An Introduction to Statistical Learning, with applications

More information

Understanding multivariate pattern analysis for neuroimaging applications

Understanding multivariate pattern analysis for neuroimaging applications Understanding multivariate pattern analysis for neuroimaging applications Maria Giulia Preti Dimitri Van De Ville Medical Image Processing Lab, Institute of Bioengineering, Ecole Polytechnique Fédérale

More information

Supplementary Information. Anne Maass, Hartmut Schütze, Oliver Speck, Andrew Yonelinas, Claus Tempelmann,

Supplementary Information. Anne Maass, Hartmut Schütze, Oliver Speck, Andrew Yonelinas, Claus Tempelmann, Supplementary Information Laminar activity in the hippocampus and entorhinal cortex related to novelty and episodic encoding Anne Maass, Hartmut Schütze, Oliver Speck, Andrew Yonelinas, Claus Tempelmann,

More information

08 An Introduction to Dense Continuous Robotic Mapping

08 An Introduction to Dense Continuous Robotic Mapping NAVARCH/EECS 568, ROB 530 - Winter 2018 08 An Introduction to Dense Continuous Robotic Mapping Maani Ghaffari March 14, 2018 Previously: Occupancy Grid Maps Pose SLAM graph and its associated dense occupancy

More information

Day 3 Lecture 1. Unsupervised Learning

Day 3 Lecture 1. Unsupervised Learning Day 3 Lecture 1 Unsupervised Learning Semi-supervised and transfer learning Myth: you can t do deep learning unless you have a million labelled examples for your problem. Reality You can learn useful representations

More information

PATTERN CLASSIFICATION AND SCENE ANALYSIS

PATTERN CLASSIFICATION AND SCENE ANALYSIS PATTERN CLASSIFICATION AND SCENE ANALYSIS RICHARD O. DUDA PETER E. HART Stanford Research Institute, Menlo Park, California A WILEY-INTERSCIENCE PUBLICATION JOHN WILEY & SONS New York Chichester Brisbane

More information

Machine Learning Practical NITP Summer Course Pamela K. Douglas UCLA Semel Institute

Machine Learning Practical NITP Summer Course Pamela K. Douglas UCLA Semel Institute Machine Learning Practical NITP Summer Course 2013 Pamela K. Douglas UCLA Semel Institute Email: pamelita@g.ucla.edu Topics Covered Part I: WEKA Basics J Part II: MONK Data Set & Feature Selection (from

More information

Statistical Analysis of Neuroimaging Data. Phebe Kemmer BIOS 516 Sept 24, 2015

Statistical Analysis of Neuroimaging Data. Phebe Kemmer BIOS 516 Sept 24, 2015 Statistical Analysis of Neuroimaging Data Phebe Kemmer BIOS 516 Sept 24, 2015 Review from last time Structural Imaging modalities MRI, CAT, DTI (diffusion tensor imaging) Functional Imaging modalities

More information

Grundlagen der Künstlichen Intelligenz

Grundlagen der Künstlichen Intelligenz Grundlagen der Künstlichen Intelligenz Unsupervised learning Daniel Hennes 29.01.2018 (WS 2017/18) University Stuttgart - IPVS - Machine Learning & Robotics 1 Today Supervised learning Regression (linear

More information

Classification: Linear Discriminant Functions

Classification: Linear Discriminant Functions Classification: Linear Discriminant Functions CE-725: Statistical Pattern Recognition Sharif University of Technology Spring 2013 Soleymani Outline Discriminant functions Linear Discriminant functions

More information

Classification of Subject Motion for Improved Reconstruction of Dynamic Magnetic Resonance Imaging

Classification of Subject Motion for Improved Reconstruction of Dynamic Magnetic Resonance Imaging 1 CS 9 Final Project Classification of Subject Motion for Improved Reconstruction of Dynamic Magnetic Resonance Imaging Feiyu Chen Department of Electrical Engineering ABSTRACT Subject motion is a significant

More information

the PyHRF package P. Ciuciu1,2 and T. Vincent1,2 Methods meeting at Neurospin 1: CEA/NeuroSpin/LNAO

the PyHRF package P. Ciuciu1,2 and T. Vincent1,2 Methods meeting at Neurospin 1: CEA/NeuroSpin/LNAO Joint detection-estimation of brain activity from fmri time series: the PyHRF package Methods meeting at Neurospin P. Ciuciu1,2 and T. Vincent1,2 philippe.ciuciu@cea.fr 1: CEA/NeuroSpin/LNAO www.lnao.fr

More information

Applying Supervised Learning

Applying Supervised Learning Applying Supervised Learning When to Consider Supervised Learning A supervised learning algorithm takes a known set of input data (the training set) and known responses to the data (output), and trains

More information

An Introduction To Automatic Tissue Classification Of Brain MRI. Colm Elliott Mar 2014

An Introduction To Automatic Tissue Classification Of Brain MRI. Colm Elliott Mar 2014 An Introduction To Automatic Tissue Classification Of Brain MRI Colm Elliott Mar 2014 Tissue Classification Tissue classification is part of many processing pipelines. We often want to classify each voxel

More information

1 Introduction Motivation and Aims Functional Imaging Computational Neuroanatomy... 12

1 Introduction Motivation and Aims Functional Imaging Computational Neuroanatomy... 12 Contents 1 Introduction 10 1.1 Motivation and Aims....... 10 1.1.1 Functional Imaging.... 10 1.1.2 Computational Neuroanatomy... 12 1.2 Overview of Chapters... 14 2 Rigid Body Registration 18 2.1 Introduction.....

More information

Decoding analyses. Neuroimaging: Pattern Analysis 2017

Decoding analyses. Neuroimaging: Pattern Analysis 2017 Decoding analyses Neuroimaging: Pattern Analysis 2017 Scope Conceptual explanation of decoding/machine learning (ML) and related concepts; Not about mathematical basis of ML algorithms! Learning goals

More information

Neuroimaging and mathematical modelling Lesson 2: Voxel Based Morphometry

Neuroimaging and mathematical modelling Lesson 2: Voxel Based Morphometry Neuroimaging and mathematical modelling Lesson 2: Voxel Based Morphometry Nivedita Agarwal, MD Nivedita.agarwal@apss.tn.it Nivedita.agarwal@unitn.it Volume and surface morphometry Brain volume White matter

More information

A Nonparametric Bayesian Approach to Detecting Spatial Activation Patterns in fmri Data

A Nonparametric Bayesian Approach to Detecting Spatial Activation Patterns in fmri Data A Nonparametric Bayesian Approach to Detecting Spatial Activation Patterns in fmri Data Seyoung Kim, Padhraic Smyth, and Hal Stern Bren School of Information and Computer Sciences University of California,

More information

COMS 4771 Clustering. Nakul Verma

COMS 4771 Clustering. Nakul Verma COMS 4771 Clustering Nakul Verma Supervised Learning Data: Supervised learning Assumption: there is a (relatively simple) function such that for most i Learning task: given n examples from the data, find

More information

Temporal Feature Selection for fmri Analysis

Temporal Feature Selection for fmri Analysis Temporal Feature Selection for fmri Analysis Mark Palatucci School of Computer Science Carnegie Mellon University Pittsburgh, Pennsylvania markmp@cmu.edu ABSTRACT Recent work in neuroimaging has shown

More information

Encoding Words into String Vectors for Word Categorization

Encoding Words into String Vectors for Word Categorization Int'l Conf. Artificial Intelligence ICAI'16 271 Encoding Words into String Vectors for Word Categorization Taeho Jo Department of Computer and Information Communication Engineering, Hongik University,

More information

Supervised Learning for Image Segmentation

Supervised Learning for Image Segmentation Supervised Learning for Image Segmentation Raphael Meier 06.10.2016 Raphael Meier MIA 2016 06.10.2016 1 / 52 References A. Ng, Machine Learning lecture, Stanford University. A. Criminisi, J. Shotton, E.

More information

Autoencoders, denoising autoencoders, and learning deep networks

Autoencoders, denoising autoencoders, and learning deep networks 4 th CiFAR Summer School on Learning and Vision in Biology and Engineering Toronto, August 5-9 2008 Autoencoders, denoising autoencoders, and learning deep networks Part II joint work with Hugo Larochelle,

More information

An Empirical Evaluation of Deep Architectures on Problems with Many Factors of Variation

An Empirical Evaluation of Deep Architectures on Problems with Many Factors of Variation An Empirical Evaluation of Deep Architectures on Problems with Many Factors of Variation Hugo Larochelle, Dumitru Erhan, Aaron Courville, James Bergstra, and Yoshua Bengio Université de Montréal 13/06/2007

More information

Large Scale Data Analysis Using Deep Learning

Large Scale Data Analysis Using Deep Learning Large Scale Data Analysis Using Deep Learning Machine Learning Basics - 1 U Kang Seoul National University U Kang 1 In This Lecture Overview of Machine Learning Capacity, overfitting, and underfitting

More information

Simple Fully Automated Group Classification on Brain fmri

Simple Fully Automated Group Classification on Brain fmri BNL-95072-2011-CP Simple Fully Automated Group Classification on Brain fmri J Honorio 1,2, D Samaras 1, D Tomasi 2,3, RZ Goldstein 2 1 School of Medicine, SUNY at Stony Brook, Stony Brook, NY 11790 USA

More information

Statistical Analysis of Metabolomics Data. Xiuxia Du Department of Bioinformatics & Genomics University of North Carolina at Charlotte

Statistical Analysis of Metabolomics Data. Xiuxia Du Department of Bioinformatics & Genomics University of North Carolina at Charlotte Statistical Analysis of Metabolomics Data Xiuxia Du Department of Bioinformatics & Genomics University of North Carolina at Charlotte Outline Introduction Data pre-treatment 1. Normalization 2. Centering,

More information

String Vector based KNN for Text Categorization

String Vector based KNN for Text Categorization 458 String Vector based KNN for Text Categorization Taeho Jo Department of Computer and Information Communication Engineering Hongik University Sejong, South Korea tjo018@hongik.ac.kr Abstract This research

More information

Supervised vs unsupervised clustering

Supervised vs unsupervised clustering Classification Supervised vs unsupervised clustering Cluster analysis: Classes are not known a- priori. Classification: Classes are defined a-priori Sometimes called supervised clustering Extract useful

More information

EMPIRICALLY INVESTIGATING THE STATISTICAL VALIDITY OF SPM, FSL AND AFNI FOR SINGLE SUBJECT FMRI ANALYSIS

EMPIRICALLY INVESTIGATING THE STATISTICAL VALIDITY OF SPM, FSL AND AFNI FOR SINGLE SUBJECT FMRI ANALYSIS EMPIRICALLY INVESTIGATING THE STATISTICAL VALIDITY OF SPM, FSL AND AFNI FOR SINGLE SUBJECT FMRI ANALYSIS Anders Eklund a,b,c, Thomas Nichols d, Mats Andersson a,c, Hans Knutsson a,c a Department of Biomedical

More information

Machine Learning. The Breadth of ML Neural Networks & Deep Learning. Marc Toussaint. Duy Nguyen-Tuong. University of Stuttgart

Machine Learning. The Breadth of ML Neural Networks & Deep Learning. Marc Toussaint. Duy Nguyen-Tuong. University of Stuttgart Machine Learning The Breadth of ML Neural Networks & Deep Learning Marc Toussaint University of Stuttgart Duy Nguyen-Tuong Bosch Center for Artificial Intelligence Summer 2017 Neural Networks Consider

More information

Clustering and Visualisation of Data

Clustering and Visualisation of Data Clustering and Visualisation of Data Hiroshi Shimodaira January-March 28 Cluster analysis aims to partition a data set into meaningful or useful groups, based on distances between data points. In some

More information

AN INTERACTION K-MEANS CLUSTERING WITH RANKING FOR MINING INTERACTION PATTERNS AMONG THE BRAIN REGIONS

AN INTERACTION K-MEANS CLUSTERING WITH RANKING FOR MINING INTERACTION PATTERNS AMONG THE BRAIN REGIONS AN INTERACTION K-MEANS CLUSTERING WITH RANKING FOR MINING INTERACTION PATTERNS AMONG THE BRAIN REGIONS S.Bency Angel 1, J.Dhivya Merlin 2 1 PG Scholar, 2 Assistant Professor, Department of CSE,Adhiyamaan

More information

Semi-supervised Learning

Semi-supervised Learning Semi-supervised Learning Piyush Rai CS5350/6350: Machine Learning November 8, 2011 Semi-supervised Learning Supervised Learning models require labeled data Learning a reliable model usually requires plenty

More information

Efficient Algorithms may not be those we think

Efficient Algorithms may not be those we think Efficient Algorithms may not be those we think Yann LeCun, Computational and Biological Learning Lab The Courant Institute of Mathematical Sciences New York University http://yann.lecun.com http://www.cs.nyu.edu/~yann

More information

Voxel-Based Morphometry & DARTEL. Ged Ridgway, London With thanks to John Ashburner and the FIL Methods Group

Voxel-Based Morphometry & DARTEL. Ged Ridgway, London With thanks to John Ashburner and the FIL Methods Group Zurich SPM Course 2012 Voxel-Based Morphometry & DARTEL Ged Ridgway, London With thanks to John Ashburner and the FIL Methods Group Aims of computational neuroanatomy * Many interesting and clinically

More information

Automated fmri Feature Abstraction using Neural Network Clustering Techniques

Automated fmri Feature Abstraction using Neural Network Clustering Techniques NIPS workshop on New Directions on Decoding Mental States from fmri Data, 12/8/2006 Automated fmri Feature Abstraction using Neural Network Clustering Techniques Radu Stefan Niculescu Siemens Medical Solutions

More information

Lecture 11: Clustering Introduction and Projects Machine Learning

Lecture 11: Clustering Introduction and Projects Machine Learning Lecture 11: Clustering Introduction and Projects Machine Learning Andrew Rosenberg March 12, 2010 1/1 Last Time Junction Tree Algorithm Efficient Marginals in Graphical Models 2/1 Today Clustering Project

More information

scikit-learn (Machine Learning in Python)

scikit-learn (Machine Learning in Python) scikit-learn (Machine Learning in Python) (PB13007115) 2016-07-12 (PB13007115) scikit-learn (Machine Learning in Python) 2016-07-12 1 / 29 Outline 1 Introduction 2 scikit-learn examples 3 Captcha recognize

More information

Alternatives to Direct Supervision

Alternatives to Direct Supervision CreativeAI: Deep Learning for Graphics Alternatives to Direct Supervision Niloy Mitra Iasonas Kokkinos Paul Guerrero Nils Thuerey Tobias Ritschel UCL UCL UCL TUM UCL Timetable Theory and Basics State of

More information

What to come. There will be a few more topics we will cover on supervised learning

What to come. There will be a few more topics we will cover on supervised learning Summary so far Supervised learning learn to predict Continuous target regression; Categorical target classification Linear Regression Classification Discriminative models Perceptron (linear) Logistic regression

More information

Pattern Recognition. Kjell Elenius. Speech, Music and Hearing KTH. March 29, 2007 Speech recognition

Pattern Recognition. Kjell Elenius. Speech, Music and Hearing KTH. March 29, 2007 Speech recognition Pattern Recognition Kjell Elenius Speech, Music and Hearing KTH March 29, 2007 Speech recognition 2007 1 Ch 4. Pattern Recognition 1(3) Bayes Decision Theory Minimum-Error-Rate Decision Rules Discriminant

More information

Robustness of Sparse Regression Models in fmri Data Analysis

Robustness of Sparse Regression Models in fmri Data Analysis Robustness of Sparse Regression Models in fmri Data Analysis Melissa K. Carroll Department of Computer Science Princeton University Princeton, NJ 854 Guillermo A. Cecchi Yorktown Heights, NY 1598 Irina

More information

More Learning. Ensembles Bayes Rule Neural Nets K-means Clustering EM Clustering WEKA

More Learning. Ensembles Bayes Rule Neural Nets K-means Clustering EM Clustering WEKA More Learning Ensembles Bayes Rule Neural Nets K-means Clustering EM Clustering WEKA 1 Ensembles An ensemble is a set of classifiers whose combined results give the final decision. test feature vector

More information

Computational Neuroanatomy

Computational Neuroanatomy Computational Neuroanatomy John Ashburner john@fil.ion.ucl.ac.uk Smoothing Motion Correction Between Modality Co-registration Spatial Normalisation Segmentation Morphometry Overview fmri time-series kernel

More information

Instance-based Learning CE-717: Machine Learning Sharif University of Technology. M. Soleymani Fall 2015

Instance-based Learning CE-717: Machine Learning Sharif University of Technology. M. Soleymani Fall 2015 Instance-based Learning CE-717: Machine Learning Sharif University of Technology M. Soleymani Fall 2015 Outline Non-parametric approach Unsupervised: Non-parametric density estimation Parzen Windows K-Nearest

More information

Overview of machine learning

Overview of machine learning Overview of machine learning Kevin P. Murphy Last updated November 26, 2007 1 Introduction In this Chapter, we provide a brief overview of the most commonly studied problems and solution methods within

More information

Tutorial on Machine Learning Tools

Tutorial on Machine Learning Tools Tutorial on Machine Learning Tools Yanbing Xue Milos Hauskrecht Why do we need these tools? Widely deployed classical models No need to code from scratch Easy-to-use GUI Outline Matlab Apps Weka 3 UI TensorFlow

More information

Alex Waibel

Alex Waibel Alex Waibel 815.11.2011 1 16.11.2011 Organisation Literatur: Introduction to The Theory of Neural Computation Hertz, Krogh, Palmer, Santa Fe Institute Neural Network Architectures An Introduction, Judith

More information

Unsupervised Learning

Unsupervised Learning Deep Learning for Graphics Unsupervised Learning Niloy Mitra Iasonas Kokkinos Paul Guerrero Vladimir Kim Kostas Rematas Tobias Ritschel UCL UCL/Facebook UCL Adobe Research U Washington UCL Timetable Niloy

More information

fmri Preprocessing & Noise Modeling

fmri Preprocessing & Noise Modeling Translational Neuromodeling Unit fmri Preprocessing & Noise Modeling Lars Kasper September 25 th / October 17 th, 2015 MR-Technology Group & Translational Neuromodeling Unit An SPM Tutorial Institute for

More information

Lecture 25: Review I

Lecture 25: Review I Lecture 25: Review I Reading: Up to chapter 5 in ISLR. STATS 202: Data mining and analysis Jonathan Taylor 1 / 18 Unsupervised learning In unsupervised learning, all the variables are on equal standing,

More information

Parametric Response Surface Models for Analysis of Multi-Site fmri Data

Parametric Response Surface Models for Analysis of Multi-Site fmri Data Parametric Response Surface Models for Analysis of Multi-Site fmri Data Seyoung Kim 1, Padhraic Smyth 1, Hal Stern 1, Jessica Turner 2, and FIRST BIRN 1 Bren School of Information and Computer Sciences,

More information

Lecture 10: Support Vector Machines and their Applications

Lecture 10: Support Vector Machines and their Applications Lecture 10: Support Vector Machines and their Applications Cognitive Systems - Machine Learning Part II: Special Aspects of Concept Learning SVM, kernel trick, linear separability, text mining, active

More information

Stacked Denoising Autoencoders for Face Pose Normalization

Stacked Denoising Autoencoders for Face Pose Normalization Stacked Denoising Autoencoders for Face Pose Normalization Yoonseop Kang 1, Kang-Tae Lee 2,JihyunEun 2, Sung Eun Park 2 and Seungjin Choi 1 1 Department of Computer Science and Engineering Pohang University

More information