A Reduced-Dimension fmri! Shared Response Model

Size: px
Start display at page:

Download "A Reduced-Dimension fmri! Shared Response Model"

Transcription

1 A Reduced-Dimension fmri! Shared Response Model Po-Hsuan! (Cameron)! Chen 1! Janice! Chen 2! Yaara! Yeshurun 2! Uri! Hasson 2! James! Haxby 3! Peter! Ramadge 1! 1 Department of Electrical Engineering, Princeton University! 2 Princeton Neuroscience Institute and Department of Psychology, Princeton University! 3 Department of Psychological and Brain Sciences! and Center for Cognitive Neuroscience, Dartmouth College!

2 Functional magnetic resonance! imaging (fmri) data! TR = Time of repetition! Volume! Voxel!

3 Motivation! Modern fmri studies of human brain use data from multiple subjects! scientific reason! statistical reason! How can we aggregate fmri data from multiple subjects?! Challenge! Inter-subject variability in anatomical structure and functional topographies!

4 Given data from training subjects,!! Prediction:! can we predict the brain response of a test subject?!! Classification:! given brain response from a test subject, can we classify what s the stimulus?!

5 Learn subject specific functional topographies! Subject 1! Subject 2! voxel space! shared feature space!

6 Data collected while subjects receiving stimuli! Temporally synchronized naturalistic stimuli! 1. Sample a wide range of response from the subject! 2. Use time as anchor for learning shared response! sherlock! raider! forrest! audiobook! movie watching! movie and image! watching! auditory film! listening! audio book! listening!

7 Factor Model! voxels! time! voxels! features!!! features! time! fmri data!

8 fmri response as linear combination of functional topographies! voxels! time! voxels! features! time!!!! features! fmri data! functional! topographies! features!

9 Learning what is shared across subjects! subjects x voxels! time! voxels!! features!! features! time! One$s&mulus$ Many$subjects$ fmri data! subject specific! functional topographies! shared! features!

10 fmri data as linear combination of subject specific functional topographies! subjects x voxels! time! features! time! voxels!!! features! fmri data! subject specific! functional topographies! shared! features!

11 A generative model! feature space! S shared features!

12 A generative model! feature space! W 1 $ S W m subject specific! functional! topographies! shared features!

13 A generative model! voxel space! feature space! X 1 W 1 $ $ S X m W m synthesized! shared response! subject specific! functional! topographies! shared features!

14 A generative model! voxel space! feature space! min! X 1 W 1 $ $ $ S min! X m W m fmri data! synthesized! shared response! subject specific! functional! topographies! shared features!

15 Shared Response Model (SRM) is a latent variable model! s t N (0, s ) s s t d x it s t N (W i s t + µ i, 2 i I) Wi T W i = I W i,µ i, i x it W i not square! m s t W i shared elicited response at time t! observations of subject i at time t! functional topographies for subject i! noise level for subject i s data! x it 2 i Feature identification with dimensionality reduction! Constrained EM algorithm!

16 Shared features, subject specific functional topographies, and subject specific response! voxel space! feature space! =$ +$ X 1 W 1 $ $ $ $ 0 E s x [S] =$ +$ X m & distribution! W m fmri! data! subject! specific! response! shared! response! subject specific! functional! topographies! shared features!

17 Evaluation with various datasets! Different MRI machines! Different institutes! Different subjects! Different preprocessing protocols! Different brain regions! Different data size! sherlock! raider! forrest! audiobook!

18 1 st $half$ movie! movie$ data! data$ learn bases! image data/! movie data! project to! bases! projected! data! output! Generalization to new subject! with time segment matching! subject 1! subject 1! subject 1! Learning Subject Specific Bases!! shared response! (template)! Testing on Held-out Subject!!! train! classifier! subject m-1! subject m-1! subject m-1! subject m! W 1 W m 1 W m subject m! W 1 W m 1 W m subject m! test! Dataset$ sherlock! forrest! raider!

19 1 st $half$ movie! movie$ data! data$ learn bases! image 2 nd $half$$ data/! movie$data$ data! project to! bases! projected! data! output! Generalization to new subject! with time segment matching! subject 1! subject 1! subject 1! Learning Subject Specific Bases!! shared response! (template)! Testing on Held-out Subject!!! train! classifier! subject m-1! subject m-1! subject m-1! subject m! W 1 W m 1 W m subject m! W 1 W m 1 W m subject m! test! Dataset$ sherlock! forrest! raider!

20 Generalization to new subject! with time segment matching!

21 Generalization to new subject and distinct stimulus with image classification! movie! data! subject 1! Learning Subject Specific Bases!! subject m-1! subject m! Dataset$ raider! learn bases! image Image$ data/! movie data$ data! project to! bases! projected! data! W 1 W m 1 W m subject 1! subject 1! shared response! (template)! Testing on Held-out Subject!!! subject m-1! subject m-1! subject m! W 1 W m 1 W m subject m! output! train! classifier! test!

22 Generalization to new subject and distinct stimulus with image classification! Outperforms within-subject classification!

23 Classifying mental states! 40 subjects listening to narrated story! Separate 40 subjects into 2 groups! Two groups receive different prior contexts! Leading to different interpretations of the story! Predict prior context of a left-out subject! Dataset$ audiobook!

24 Classifying mental states! shared! by all! Group 1! Group 2! within! group! individual! shared! by all! within! group! individual! Group! prediction! accuracy! with SRM! 0.72±0.06!

25 Classifying mental states! shared! by all! Group 1! Group 2! within! group! individual! shared! by all! within! group! individual! Group! prediction! accuracy! with SRM! 0.72±0.06! 0.54±0.06!

26 Classifying mental states! shared! by all! Group 1! Group 2! within! group! individual! shared! by all! within! group! individual! Group! prediction! accuracy! with SRM! 0.72±0.06! 0.54±0.06! 0.70±0.04!

27 Classifying mental states! shared! by all! Group 1! Group 2! within! group! individual! shared! by all! within! group! individual! Group! prediction! accuracy! with SRM! 0.72±0.06! 0.54±0.06! 0.70±0.04! 0.82±0.04!

28 ! Conclusion! SRM achieves state-of-the-art performance using multi-subject data, demonstrates higher sensitivity! SRM outperforms within subject classification! Low dimensional representation of brain response! SRM decouples shared and individual responses, allowing detection of group specific responses! Recent Extensions:! Kernel version of SRM to unlock information in higher order statistics from fmri data! Information theoretic based SRM!

29 A Reduced-Dimension fmri! Shared Response Model Poster 23$ Po-Hsuan! (Cameron)! Chen! Janice! Chen! Yaara! Yeshurun! Uri! Hasson! James! Haxby! Peter! Ramadge!

A Semantic Shared Response Model

A Semantic Shared Response Model A Semantic Shared Response Model Kiran Vodrahalli*, Po-Hsuan Chen*, Janice Chen*, Esther Yong, Christopher Honey, Peter J. Ramadge*, Kenneth A. Norman*, Sanjeev Arora* ICML MVRL 2016 June 23, 2016 * =

More information

arxiv: v1 [stat.ml] 17 Aug 2016

arxiv: v1 [stat.ml] 17 Aug 2016 A Convolutional Autoencoder for Multi-Subject fmri Data Aggregation Po-Hsuan Chen 1, Xia Zhu 2, Hejia Zhang 1, Javier S. Turek 2, Janice Chen 3, Theodore L. Willke 2, Uri Hasson 3, Peter J. Ramadge 1 1

More information

Analysis of Functional MRI Timeseries Data Using Signal Processing Techniques

Analysis of Functional MRI Timeseries Data Using Signal Processing Techniques Analysis of Functional MRI Timeseries Data Using Signal Processing Techniques Sea Chen Department of Biomedical Engineering Advisors: Dr. Charles A. Bouman and Dr. Mark J. Lowe S. Chen Final Exam October

More information

Multi-voxel pattern analysis: Decoding Mental States from fmri Activity Patterns

Multi-voxel pattern analysis: Decoding Mental States from fmri Activity Patterns Multi-voxel pattern analysis: Decoding Mental States from fmri Activity Patterns Artwork by Leon Zernitsky Jesse Rissman NITP Summer Program 2012 Part 1 of 2 Goals of Multi-voxel Pattern Analysis Decoding

More information

CS 229 Final Project Report Learning to Decode Cognitive States of Rat using Functional Magnetic Resonance Imaging Time Series

CS 229 Final Project Report Learning to Decode Cognitive States of Rat using Functional Magnetic Resonance Imaging Time Series CS 229 Final Project Report Learning to Decode Cognitive States of Rat using Functional Magnetic Resonance Imaging Time Series Jingyuan Chen //Department of Electrical Engineering, cjy2010@stanford.edu//

More information

Mapping of Hierarchical Activation in the Visual Cortex Suman Chakravartula, Denise Jones, Guillaume Leseur CS229 Final Project Report. Autumn 2008.

Mapping of Hierarchical Activation in the Visual Cortex Suman Chakravartula, Denise Jones, Guillaume Leseur CS229 Final Project Report. Autumn 2008. Mapping of Hierarchical Activation in the Visual Cortex Suman Chakravartula, Denise Jones, Guillaume Leseur CS229 Final Project Report. Autumn 2008. Introduction There is much that is unknown regarding

More information

Introduction to Neuroimaging Janaina Mourao-Miranda

Introduction to Neuroimaging Janaina Mourao-Miranda Introduction to Neuroimaging Janaina Mourao-Miranda Neuroimaging techniques have changed the way neuroscientists address questions about functional anatomy, especially in relation to behavior and clinical

More information

Multivariate Pattern Classification. Thomas Wolbers Space and Aging Laboratory Centre for Cognitive and Neural Systems

Multivariate Pattern Classification. Thomas Wolbers Space and Aging Laboratory Centre for Cognitive and Neural Systems Multivariate Pattern Classification Thomas Wolbers Space and Aging Laboratory Centre for Cognitive and Neural Systems Outline WHY PATTERN CLASSIFICATION? PROCESSING STREAM PREPROCESSING / FEATURE REDUCTION

More information

Cognitive States Detection in fmri Data Analysis using incremental PCA

Cognitive States Detection in fmri Data Analysis using incremental PCA Department of Computer Engineering Cognitive States Detection in fmri Data Analysis using incremental PCA Hoang Trong Minh Tuan, Yonggwan Won*, Hyung-Jeong Yang International Conference on Computational

More information

Graphical Models, Bayesian Method, Sampling, and Variational Inference

Graphical Models, Bayesian Method, Sampling, and Variational Inference Graphical Models, Bayesian Method, Sampling, and Variational Inference With Application in Function MRI Analysis and Other Imaging Problems Wei Liu Scientific Computing and Imaging Institute University

More information

Multivariate pattern classification

Multivariate pattern classification Multivariate pattern classification Thomas Wolbers Space & Ageing Laboratory (www.sal.mvm.ed.ac.uk) Centre for Cognitive and Neural Systems & Centre for Cognitive Ageing and Cognitive Epidemiology Outline

More information

Feature Selection for fmri Classification

Feature Selection for fmri Classification Feature Selection for fmri Classification Chuang Wu Program of Computational Biology Carnegie Mellon University Pittsburgh, PA 15213 chuangw@andrew.cmu.edu Abstract The functional Magnetic Resonance Imaging

More information

Voxel selection algorithms for fmri

Voxel selection algorithms for fmri Voxel selection algorithms for fmri Henryk Blasinski December 14, 2012 1 Introduction Functional Magnetic Resonance Imaging (fmri) is a technique to measure and image the Blood- Oxygen Level Dependent

More information

Representational similarity analysis. Dr Ian Charest,

Representational similarity analysis. Dr Ian Charest, Representational similarity analysis Dr Ian Charest, Edinburgh, April 219 A space for neuroimaging studies Pattern across subjects Cross-subject correlation studies (e.g. social neuroscience) Raizada et

More information

Statistical Analysis of Neuroimaging Data. Phebe Kemmer BIOS 516 Sept 24, 2015

Statistical Analysis of Neuroimaging Data. Phebe Kemmer BIOS 516 Sept 24, 2015 Statistical Analysis of Neuroimaging Data Phebe Kemmer BIOS 516 Sept 24, 2015 Review from last time Structural Imaging modalities MRI, CAT, DTI (diffusion tensor imaging) Functional Imaging modalities

More information

SPM8 for Basic and Clinical Investigators. Preprocessing. fmri Preprocessing

SPM8 for Basic and Clinical Investigators. Preprocessing. fmri Preprocessing SPM8 for Basic and Clinical Investigators Preprocessing fmri Preprocessing Slice timing correction Geometric distortion correction Head motion correction Temporal filtering Intensity normalization Spatial

More information

arxiv: v1 [q-bio.nc] 11 Oct 2017

arxiv: v1 [q-bio.nc] 11 Oct 2017 Deep Hyperalignment arxiv:1710.0393v1 [q-bio.nc] 11 Oct 017 Muhammad Yousefnezhad, Daoqiang Zhang College of Computer Science and Technology Nanjing University of Aeronautics and Astronautics {myousefnezhad,dqzhang}@nuaa.edu.cn

More information

Basic Introduction to Data Analysis. Block Design Demonstration. Robert Savoy

Basic Introduction to Data Analysis. Block Design Demonstration. Robert Savoy Basic Introduction to Data Analysis Block Design Demonstration Robert Savoy Sample Block Design Experiment Demonstration Use of Visual and Motor Task Separability of Responses Combined Visual and Motor

More information

Basic fmri Design and Analysis. Preprocessing

Basic fmri Design and Analysis. Preprocessing Basic fmri Design and Analysis Preprocessing fmri Preprocessing Slice timing correction Geometric distortion correction Head motion correction Temporal filtering Intensity normalization Spatial filtering

More information

Journal of Articles in Support of The Null Hypothesis

Journal of Articles in Support of The Null Hypothesis Data Preprocessing Martin M. Monti, PhD UCLA Psychology NITP 2016 Typical (task-based) fmri analysis sequence Image Pre-processing Single Subject Analysis Group Analysis Journal of Articles in Support

More information

Dimensionality Reduction of fmri Data using PCA

Dimensionality Reduction of fmri Data using PCA Dimensionality Reduction of fmri Data using PCA Elio Andia ECE-699 Learning from Data George Mason University Fairfax VA, USA INTRODUCTION The aim of this project was to implement PCA as a dimensionality

More information

Pixels to Voxels: Modeling Visual Representation in the Human Brain

Pixels to Voxels: Modeling Visual Representation in the Human Brain Pixels to Voxels: Modeling Visual Representation in the Human Brain Authors: Pulkit Agrawal, Dustin Stansbury, Jitendra Malik, Jack L. Gallant Presenters: JunYoung Gwak, Kuan Fang Outlines Background Motivation

More information

Temporal Feature Selection for fmri Analysis

Temporal Feature Selection for fmri Analysis Temporal Feature Selection for fmri Analysis Mark Palatucci School of Computer Science Carnegie Mellon University Pittsburgh, Pennsylvania markmp@cmu.edu ABSTRACT Recent work in neuroimaging has shown

More information

Functional MRI in Clinical Research and Practice Preprocessing

Functional MRI in Clinical Research and Practice Preprocessing Functional MRI in Clinical Research and Practice Preprocessing fmri Preprocessing Slice timing correction Geometric distortion correction Head motion correction Temporal filtering Intensity normalization

More information

Methods for data preprocessing

Methods for data preprocessing Methods for data preprocessing John Ashburner Wellcome Trust Centre for Neuroimaging, 12 Queen Square, London, UK. Overview Voxel-Based Morphometry Morphometry in general Volumetrics VBM preprocessing

More information

fmri pre-processing Juergen Dukart

fmri pre-processing Juergen Dukart fmri pre-processing Juergen Dukart Outline Why do we need pre-processing? fmri pre-processing Slice time correction Realignment Unwarping Coregistration Spatial normalisation Smoothing Overview fmri time-series

More information

Section 9. Human Anatomy and Physiology

Section 9. Human Anatomy and Physiology Section 9. Human Anatomy and Physiology 9.1 MR Neuroimaging 9.2 Electroencephalography Overview As stated throughout, electrophysiology is the key tool in current systems neuroscience. However, single-

More information

Classification of Whole Brain fmri Activation Patterns. Serdar Kemal Balcı

Classification of Whole Brain fmri Activation Patterns. Serdar Kemal Balcı Classification of Whole Brain fmri Activation Patterns by Serdar Kemal Balcı Submitted to the Department of Electrical Engineering and Computer Science in partial fulfillment of the requirements for the

More information

Learning Tensor-Based Features for Whole-Brain fmri Classification

Learning Tensor-Based Features for Whole-Brain fmri Classification Learning Tensor-Based Features for Whole-Brain fmri Classification Xiaonan Song, Lingnan Meng, Qiquan Shi, and Haiping Lu Department of Computer Science, Hong Kong Baptist University haiping@hkbu.edu.hk

More information

Temporal and Cross-Subject Probabilistic Models for fmri Prediction Tasks

Temporal and Cross-Subject Probabilistic Models for fmri Prediction Tasks Temporal and Cross-Subject Probabilistic Models for fmri Prediction Tasks Alexis Battle Gal Chechik Daphne Koller Department of Computer Science Stanford University Stanford, CA 94305-9010 {ajbattle,gal,koller}@cs.stanford.edu

More information

Toward a rigorous statistical framework for brain mapping

Toward a rigorous statistical framework for brain mapping Toward a rigorous statistical framework for brain mapping Bertrand Thirion, bertrand.thirion@inria.fr 1 Cognitive neuroscience How are cognitive activities affected or controlled by neural circuits in

More information

INDEPENDENT COMPONENT ANALYSIS APPLIED TO fmri DATA: A GENERATIVE MODEL FOR VALIDATING RESULTS

INDEPENDENT COMPONENT ANALYSIS APPLIED TO fmri DATA: A GENERATIVE MODEL FOR VALIDATING RESULTS INDEPENDENT COMPONENT ANALYSIS APPLIED TO fmri DATA: A GENERATIVE MODEL FOR VALIDATING RESULTS V. Calhoun 1,2, T. Adali, 2 and G. Pearlson 1 1 Johns Hopkins University Division of Psychiatric Neuro-Imaging,

More information

Reconstructing visual experiences from brain activity evoked by natural movies

Reconstructing visual experiences from brain activity evoked by natural movies Reconstructing visual experiences from brain activity evoked by natural movies Shinji Nishimoto, An T. Vu, Thomas Naselaris, Yuval Benjamini, Bin Yu, and Jack L. Gallant, Current Biology, 2011 -Yi Gao,

More information

IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, VOL. 3, NO. 4, DECEMBER

IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, VOL. 3, NO. 4, DECEMBER IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, VOL. 3, NO. 4, DECEMBER 2017 683 A New Representation of fmri Signal by a Set of Local Meshes for Brain Decoding Itir Onal, Student

More information

Selected topics on fmri image processing

Selected topics on fmri image processing fmri Symposium, 24 January, 2006, Ghent Selected topics on fmri image processing Jan Sijbers The fmri folks of the Vision Lab UZA Bio-Imaging Lab Vision Lab Univ. Maastricht T.U. Delft 1 Overview generalized

More information

Analysis of fmri data within Brainvisa Example with the Saccades database

Analysis of fmri data within Brainvisa Example with the Saccades database Analysis of fmri data within Brainvisa Example with the Saccades database 18/11/2009 Note : All the sentences in italic correspond to informations relative to the specific dataset under study TP participants

More information

Learning from High Dimensional fmri Data using Random Projections

Learning from High Dimensional fmri Data using Random Projections Learning from High Dimensional fmri Data using Random Projections Author: Madhu Advani December 16, 011 Introduction The term the Curse of Dimensionality refers to the difficulty of organizing and applying

More information

Bayesian Inference in fmri Will Penny

Bayesian Inference in fmri Will Penny Bayesian Inference in fmri Will Penny Bayesian Approaches in Neuroscience Karolinska Institutet, Stockholm February 2016 Overview Posterior Probability Maps Hemodynamic Response Functions Population

More information

Robustness of Sparse Regression Models in fmri Data Analysis

Robustness of Sparse Regression Models in fmri Data Analysis Robustness of Sparse Regression Models in fmri Data Analysis Melissa K. Carroll Department of Computer Science Princeton University Princeton, NJ 854 Guillermo A. Cecchi Yorktown Heights, NY 1598 Irina

More information

SPM8 for Basic and Clinical Investigators. Preprocessing

SPM8 for Basic and Clinical Investigators. Preprocessing SPM8 for Basic and Clinical Investigators Preprocessing fmri Preprocessing Slice timing correction Geometric distortion correction Head motion correction Temporal filtering Intensity normalization Spatial

More information

Functional MRI data preprocessing. Cyril Pernet, PhD

Functional MRI data preprocessing. Cyril Pernet, PhD Functional MRI data preprocessing Cyril Pernet, PhD Data have been acquired, what s s next? time No matter the design, multiple volumes (made from multiple slices) have been acquired in time. Before getting

More information

Surface Projection Method for Visualizing Volumetric Data

Surface Projection Method for Visualizing Volumetric Data Surface Projection Method for Visualizing Volumetric Data by Peter Lincoln A senior thesis submitted in partial fulfillment of the requirements for the degree of Bachelor of Science With Departmental Honors

More information

Introduction to fmri. Pre-processing

Introduction to fmri. Pre-processing Introduction to fmri Pre-processing Tibor Auer Department of Psychology Research Fellow in MRI Data Types Anatomical data: T 1 -weighted, 3D, 1/subject or session - (ME)MPRAGE/FLASH sequence, undistorted

More information

HST.583 Functional Magnetic Resonance Imaging: Data Acquisition and Analysis Fall 2006

HST.583 Functional Magnetic Resonance Imaging: Data Acquisition and Analysis Fall 2006 MIT OpenCourseWare http://ocw.mit.edu HST.583 Functional Magnetic Resonance Imaging: Data Acquisition and Analysis Fall 2006 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.

More information

(Information) Visualization

(Information) Visualization (Information) Visualization CSC 511 Instructor: Melanie Tory First, a bit about me Human-computer interaction Psychology Computer Graphics Domain knowledge Data Visualization is Use of computer supported,

More information

An Introduction To Automatic Tissue Classification Of Brain MRI. Colm Elliott Mar 2014

An Introduction To Automatic Tissue Classification Of Brain MRI. Colm Elliott Mar 2014 An Introduction To Automatic Tissue Classification Of Brain MRI Colm Elliott Mar 2014 Tissue Classification Tissue classification is part of many processing pipelines. We often want to classify each voxel

More information

Version. Getting Started: An fmri-cpca Tutorial

Version. Getting Started: An fmri-cpca Tutorial Version 11 Getting Started: An fmri-cpca Tutorial 2 Table of Contents Table of Contents... 2 Introduction... 3 Definition of fmri-cpca Data... 3 Purpose of this tutorial... 3 Prerequisites... 4 Used Terms

More information

Naïve Bayes, Gaussian Distributions, Practical Applications

Naïve Bayes, Gaussian Distributions, Practical Applications Naïve Bayes, Gaussian Distributions, Practical Applications Required reading: Mitchell draft chapter, sections 1 and 2. (available on class website) Machine Learning 10-601 Tom M. Mitchell Machine Learning

More information

The WU-Minn HCP Open Access Initial Data Release: User Guide. Appendix 2 File Names and Directory Structure for Minimally Pre-Processed Data

The WU-Minn HCP Open Access Initial Data Release: User Guide. Appendix 2 File Names and Directory Structure for Minimally Pre-Processed Data The WU-Minn HCP Open Access Initial Data Release: User Guide Appendix 2 File Names and Directory Structure for Minimally Pre-Processed Data Version 2 release: 21 December 2012 Table of Contents File Names

More information

PIXELS TO VOXELS: MODELING VISUAL REPRESENTATION IN THE HUMAN BRAIN

PIXELS TO VOXELS: MODELING VISUAL REPRESENTATION IN THE HUMAN BRAIN PIXELS TO VOXELS: MODELING VISUAL REPRESENTATION IN THE HUMAN BRAIN By Pulkit Agrawal, Dustin Stansbury, Jitendra Malik, Jack L. Gallant University of California Berkeley Presented by Tim Patzelt AGENDA

More information

Tour-Based Mode Choice Modeling: Using An Ensemble of (Un-) Conditional Data-Mining Classifiers

Tour-Based Mode Choice Modeling: Using An Ensemble of (Un-) Conditional Data-Mining Classifiers Tour-Based Mode Choice Modeling: Using An Ensemble of (Un-) Conditional Data-Mining Classifiers James P. Biagioni Piotr M. Szczurek Peter C. Nelson, Ph.D. Abolfazl Mohammadian, Ph.D. Agenda Background

More information

MultiVariate Bayesian (MVB) decoding of brain images

MultiVariate Bayesian (MVB) decoding of brain images MultiVariate Bayesian (MVB) decoding of brain images Alexa Morcom Edinburgh SPM course 2015 With thanks to J. Daunizeau, K. Brodersen for slides stimulus behaviour encoding of sensorial or cognitive state?

More information

SCENARIO BASED ADAPTIVE PREPROCESSING FOR STREAM DATA USING SVM CLASSIFIER

SCENARIO BASED ADAPTIVE PREPROCESSING FOR STREAM DATA USING SVM CLASSIFIER SCENARIO BASED ADAPTIVE PREPROCESSING FOR STREAM DATA USING SVM CLASSIFIER P.Radhabai Mrs.M.Priya Packialatha Dr.G.Geetha PG Student Assistant Professor Professor Dept of Computer Science and Engg Dept

More information

Principal Component Analysis for Analysis and Classification of fmri Activation Maps

Principal Component Analysis for Analysis and Classification of fmri Activation Maps IJCSNS International Journal of Computer Science and Network Security, VOL.7 No.11, November 2007 235 Principal Component Analysis for Analysis and Classification of fmri Activation Maps 1 H N Suma, 2

More information

Nonparametric sparse hierarchical models describe V1 fmri responses to natural images

Nonparametric sparse hierarchical models describe V1 fmri responses to natural images Nonparametric sparse hierarchical models describe V1 fmri responses to natural images Pradeep Ravikumar, Vincent Q. Vu and Bin Yu Department of Statistics University of California, Berkeley Berkeley, CA

More information

Norbert Schuff VA Medical Center and UCSF

Norbert Schuff VA Medical Center and UCSF Norbert Schuff Medical Center and UCSF Norbert.schuff@ucsf.edu Medical Imaging Informatics N.Schuff Course # 170.03 Slide 1/67 Objective Learn the principle segmentation techniques Understand the role

More information

Preprocessing of fmri data

Preprocessing of fmri data Preprocessing of fmri data Pierre Bellec CRIUGM, DIRO, UdM Flowchart of the NIAK fmri preprocessing pipeline fmri run 1 fmri run N individual datasets CIVET NUC, segmentation, spatial normalization slice

More information

Correction of Partial Volume Effects in Arterial Spin Labeling MRI

Correction of Partial Volume Effects in Arterial Spin Labeling MRI Correction of Partial Volume Effects in Arterial Spin Labeling MRI By: Tracy Ssali Supervisors: Dr. Keith St. Lawrence and Udunna Anazodo Medical Biophysics 3970Z Six Week Project April 13 th 2012 Introduction

More information

Chapter 3 Set Redundancy in Magnetic Resonance Brain Images

Chapter 3 Set Redundancy in Magnetic Resonance Brain Images 16 Chapter 3 Set Redundancy in Magnetic Resonance Brain Images 3.1 MRI (magnetic resonance imaging) MRI is a technique of measuring physical structure within the human anatomy. Our proposed research focuses

More information

Jarek Szlichta

Jarek Szlichta Jarek Szlichta http://data.science.uoit.ca/ Approximate terminology, though there is some overlap: Data(base) operations Executing specific operations or queries over data Data mining Looking for patterns

More information

Modeling Visual Cortex V4 in Naturalistic Conditions with Invari. Representations

Modeling Visual Cortex V4 in Naturalistic Conditions with Invari. Representations Modeling Visual Cortex V4 in Naturalistic Conditions with Invariant and Sparse Image Representations Bin Yu Departments of Statistics and EECS University of California at Berkeley Rutgers University, May

More information

Preprocessing II: Between Subjects John Ashburner

Preprocessing II: Between Subjects John Ashburner Preprocessing II: Between Subjects John Ashburner Pre-processing Overview Statistics or whatever fmri time-series Anatomical MRI Template Smoothed Estimate Spatial Norm Motion Correct Smooth Coregister

More information

I.e. Sex differences in child appetitive traits and Eating in the Absence of Hunger:

I.e. Sex differences in child appetitive traits and Eating in the Absence of Hunger: Supplementary Materials I. Evidence of sex differences on eating behavior in children I.e. Sex differences in child appetitive traits and Eating in the Absence of Hunger: Table 2. Parent Report for Child

More information

CS 229 Midterm Review

CS 229 Midterm Review CS 229 Midterm Review Course Staff Fall 2018 11/2/2018 Outline Today: SVMs Kernels Tree Ensembles EM Algorithm / Mixture Models [ Focus on building intuition, less so on solving specific problems. Ask

More information

EPI Data Are Acquired Serially. EPI Data Are Acquired Serially 10/23/2011. Functional Connectivity Preprocessing. fmri Preprocessing

EPI Data Are Acquired Serially. EPI Data Are Acquired Serially 10/23/2011. Functional Connectivity Preprocessing. fmri Preprocessing Functional Connectivity Preprocessing Geometric distortion Head motion Geometric distortion Head motion EPI Data Are Acquired Serially EPI Data Are Acquired Serially descending 1 EPI Data Are Acquired

More information

fmri Image Preprocessing

fmri Image Preprocessing fmri Image Preprocessing Rick Hoge, Ph.D. Laboratoire de neuroimagerie vasculaire (LINeV) Centre de recherche de l institut universitaire de gériatrie de Montréal, Université de Montréal Outline Motion

More information

Multi-Voxel Pattern Analysis (MVPA) for fmri

Multi-Voxel Pattern Analysis (MVPA) for fmri MVPA for - and Multi-Voxel Pattern Analysis (MVPA) for 7 th M-BIC Workshop 2012 Maastricht University, Department of Cognitive Neuroscience Maastricht Brain Imaging Center (M-Bic), Maastricht, The Netherlands

More information

MULTIVARIATE ANALYSES WITH fmri DATA

MULTIVARIATE ANALYSES WITH fmri DATA MULTIVARIATE ANALYSES WITH fmri DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) Institute for Biomedical Engineering University of Zurich & ETH Zurich Motivation Modelling Concepts Learning

More information

Turbo-BrainVoyager. Setup guide

Turbo-BrainVoyager. Setup guide Turbo-BrainVoyager Setup guide Turbo-BrainVoyager (TBV) is a highly optimized software package for real-time analysis and advanced visualization of functional and structural magnetic resonance imaging

More information

Interpreting predictive models in terms of anatomically labelled regions

Interpreting predictive models in terms of anatomically labelled regions Interpreting predictive models in terms of anatomically labelled regions Data Feature extraction/selection Model specification Accuracy and significance Model interpretation 2 Data Feature extraction/selection

More information

Time-Frequency Method Based Activation Detection in Functional MRI Time-Series

Time-Frequency Method Based Activation Detection in Functional MRI Time-Series Time-Frequency Method Based Activation Detection in Functional MRI Time-Series Arun Kumar 1,2 and Jagath C. Rajapakse 1,3 1 School of Computing, NTU, Singapore 2 School of EEE,Singapore Polytechnic, Singapore

More information

Response to Comment on Perceptual Learning Incepted by Decoded fmri Neurofeedback Without Stimulus Presentation ;

Response to Comment on Perceptual Learning Incepted by Decoded fmri Neurofeedback Without Stimulus Presentation ; Response to Comment on Perceptual Learning Incepted by Decoded fmri Neurofeedback Without Stimulus Presentation ; How can a decoded neurofeedback method (DecNef) lead to successful reinforcement and visual

More information

Reconstruction of Fiber Trajectories via Population-Based Estimation of Local Orientations

Reconstruction of Fiber Trajectories via Population-Based Estimation of Local Orientations IDEA Reconstruction of Fiber Trajectories via Population-Based Estimation of Local Orientations Pew-Thian Yap, John H. Gilmore, Weili Lin, Dinggang Shen Email: ptyap@med.unc.edu 2011-09-21 Poster: P2-46-

More information

Factor Topographic Latent Source Analysis: Factor Analysis for Brain Images

Factor Topographic Latent Source Analysis: Factor Analysis for Brain Images Factor Topographic Latent Source Analysis: Factor Analysis for Brain Images Jeremy R. Manning 1,2, Samuel J. Gershman 3, Kenneth A. Norman 1,3, and David M. Blei 2 1 Princeton Neuroscience Institute, Princeton

More information

A User s Guide to Graphical-Model-based Multivariate Analysis

A User s Guide to Graphical-Model-based Multivariate Analysis A User s Guide to Graphical-Model-based Multivariate Analysis 1. Introduction Rong Chen December 2006 Graphical-Model-based Multivariate Analysis (GAMMA) is a Bayesian data mining software for structural

More information

Lecture 10: Support Vector Machines and their Applications

Lecture 10: Support Vector Machines and their Applications Lecture 10: Support Vector Machines and their Applications Cognitive Systems - Machine Learning Part II: Special Aspects of Concept Learning SVM, kernel trick, linear separability, text mining, active

More information

New Approaches for EEG Source Localization and Dipole Moment Estimation. Shun Chi Wu, Yuchen Yao, A. Lee Swindlehurst University of California Irvine

New Approaches for EEG Source Localization and Dipole Moment Estimation. Shun Chi Wu, Yuchen Yao, A. Lee Swindlehurst University of California Irvine New Approaches for EEG Source Localization and Dipole Moment Estimation Shun Chi Wu, Yuchen Yao, A. Lee Swindlehurst University of California Irvine Outline Motivation why EEG? Mathematical Model equivalent

More information

THE capabilities of human intelligence can be broadly

THE capabilities of human intelligence can be broadly 1 Constructing a New-style Conceptual Model of Brain Data for Systematic Brain Informatics Ning Zhong and Jianhui Chen Abstract The development of brain science has led to a vast increase of brain data.

More information

Artifact detection and repair in fmri

Artifact detection and repair in fmri Artifact detection and repair in fmri Paul K. Mazaika, Ph.D. Center for Interdisciplinary Brain Sciences Research (CIBSR) Division of Interdisciplinary Behavioral Sciences Stanford University School of

More information

FMRI Pre-Processing and Model- Based Statistics

FMRI Pre-Processing and Model- Based Statistics FMRI Pre-Processing and Model- Based Statistics Brief intro to FMRI experiments and analysis FMRI pre-stats image processing Simple Single-Subject Statistics Multi-Level FMRI Analysis Advanced FMRI Analysis

More information

CS/NEUR125 Brains, Minds, and Machines. Due: Wednesday, April 5

CS/NEUR125 Brains, Minds, and Machines. Due: Wednesday, April 5 CS/NEUR125 Brains, Minds, and Machines Lab 8: Using fmri to Discover Language Areas in the Brain Due: Wednesday, April 5 In this lab, you will analyze fmri data from an experiment that was designed to

More information

Machine Learning Techniques

Machine Learning Techniques Machine Learning Techniques ( 機器學習技法 ) Lecture 16: Finale Hsuan-Tien Lin ( 林軒田 ) htlin@csie.ntu.edu.tw Department of Computer Science & Information Engineering National Taiwan University ( 國立台灣大學資訊工程系

More information

fmri pattern classification using neuroanatomically constrained boosting

fmri pattern classification using neuroanatomically constrained boosting fmri pattern classification using neuroanatomically constrained boosting Manel Martínez-Ramón, a,c, * Vladimir Koltchinskii, b Gregory L. Heileman, a and Stefan Posse c a Department of Electrical and Computer

More information

Module 10 MULTIMEDIA SYNCHRONIZATION

Module 10 MULTIMEDIA SYNCHRONIZATION Module 10 MULTIMEDIA SYNCHRONIZATION Lesson 33 Basic definitions and requirements Instructional objectives At the end of this lesson, the students should be able to: 1. Define synchronization between media

More information

Introductory Concepts for Voxel-Based Statistical Analysis

Introductory Concepts for Voxel-Based Statistical Analysis Introductory Concepts for Voxel-Based Statistical Analysis John Kornak University of California, San Francisco Department of Radiology and Biomedical Imaging Department of Epidemiology and Biostatistics

More information

Machine Learning of fmri Virtual Sensors of Cognitive States

Machine Learning of fmri Virtual Sensors of Cognitive States Machine Learning of fmri Virtual Sensors of Cognitive States Tom Mitchell Rebecca Hutchinson Marcel Just Sharlene Newman Radu Stefan Niculescu Francisco Pereira Xuerui Wang Computer Science Department

More information

Motion Correction in fmri by Mapping Slice-to-Volume with Concurrent Field-Inhomogeneity Correction

Motion Correction in fmri by Mapping Slice-to-Volume with Concurrent Field-Inhomogeneity Correction Motion Correction in fmri by Mapping Slice-to-Volume with Concurrent Field-Inhomogeneity Correction Desmond T.B. Yeo 1,2, Jeffery A. Fessler 2, and Boklye Kim 1 1 Department of Radiology, University of

More information

Lesson Plans. Put It Together! Combining Pictures with Words to Create Your Movie

Lesson Plans. Put It Together! Combining Pictures with Words to Create Your Movie Lesson Plans L e s s o n 4 : Put It Together! Combining Pictures with Words to Create Your Movie National Language Arts Standard 3: Students apply a wide range of strategies to comprehend, interpret, evaluate,

More information

Statistical Parametric Maps for Functional MRI Experiments in R: The Package fmri

Statistical Parametric Maps for Functional MRI Experiments in R: The Package fmri Weierstrass Institute for Applied Analysis and Stochastics Statistical Parametric Maps for Functional MRI Experiments in R: The Package fmri Karsten Tabelow UseR!2011 Mohrenstrasse 39 10117 Berlin Germany

More information

A Data-Driven fmri Neuronal Activation Analysis Method Using Temporal Clustering Technique and an Adaptive Voxel Selection Criterion

A Data-Driven fmri Neuronal Activation Analysis Method Using Temporal Clustering Technique and an Adaptive Voxel Selection Criterion A Data-Driven fmri Neuronal Activation Analysis Method Using Temporal Clustering Technique and an Adaptive Voxel Selection Criterion Sarah Lee, Fernando Zelaya, Stephanie A. Amiel and Michael J. Brammer

More information

Clustering. K-means clustering

Clustering. K-means clustering Clustering K-means clustering Clustering Motivation: Identify clusters of data points in a multidimensional space, i.e. partition the data set {x 1,...,x N } into K clusters. Intuition: A cluster is a

More information

Issues Regarding fmri Imaging Workflow and DICOM

Issues Regarding fmri Imaging Workflow and DICOM Issues Regarding fmri Imaging Workflow and DICOM Lawrence Tarbox, Ph.D. Fred Prior, Ph.D Mallinckrodt Institute of Radiology Washington University in St. Louis What is fmri fmri is used to localize functions

More information

mritc: A Package for MRI Tissue Classification

mritc: A Package for MRI Tissue Classification mritc: A Package for MRI Tissue Classification Dai Feng 1 Luke Tierney 2 1 Merck Research Labratories 2 University of Iowa July 2010 Feng & Tierney (Merck & U of Iowa) MRI Tissue Classification July 2010

More information

Automated fmri Feature Abstraction using Neural Network Clustering Techniques

Automated fmri Feature Abstraction using Neural Network Clustering Techniques NIPS workshop on New Directions on Decoding Mental States from fmri Data, 12/8/2006 Automated fmri Feature Abstraction using Neural Network Clustering Techniques Radu Stefan Niculescu Siemens Medical Solutions

More information

Data Mining with SPSS Modeler

Data Mining with SPSS Modeler Tilo Wendler Soren Grottrup Data Mining with SPSS Modeler Theory, Exercises and Solutions Springer 1 Introduction 1 1.1 The Concept of the SPSS Modeler 2 1.2 Structure and Features of This Book 5 1.2.1

More information

Equipment Setup Instructions for fmri Experiments

Equipment Setup Instructions for fmri Experiments Equipment Setup Instructions for fmri Experiments This document outlines the setup of equipment necessary for presenting visual and auditory stimuli to and collecting button-press responses from participants

More information

Extracting Multi-Knowledge from fmri Data through Swarm-based Rough Set Reduction

Extracting Multi-Knowledge from fmri Data through Swarm-based Rough Set Reduction Extracting Multi-Knowledge from fmri Data through Swarm-based Rough Set Reduction Hongbo Liu 1, Ajith Abraham 2, Hong Ye 1 1 School of Computer Science, Dalian Maritime University, Dalian 116026, China

More information

Update ASA 4.8. Expand your research potential with ASA 4.8. Highly advanced 3D display of single channel coherence

Update ASA 4.8. Expand your research potential with ASA 4.8. Highly advanced 3D display of single channel coherence Update ASA 4.8 Expand your research potential with ASA 4.8. The ASA 4.8 software has everything needed for a complete analysis of EEG / ERP and MEG data. From features like (pre)processing of data, co-registration

More information

The organization of the human cerebral cortex estimated by intrinsic functional connectivity

The organization of the human cerebral cortex estimated by intrinsic functional connectivity 1 The organization of the human cerebral cortex estimated by intrinsic functional connectivity Journal: Journal of Neurophysiology Author: B. T. Thomas Yeo, et al Link: https://www.ncbi.nlm.nih.gov/pubmed/21653723

More information

A Human Activity Recognition System Using Skeleton Data from RGBD Sensors Enea Cippitelli, Samuele Gasparrini, Ennio Gambi and Susanna Spinsante

A Human Activity Recognition System Using Skeleton Data from RGBD Sensors Enea Cippitelli, Samuele Gasparrini, Ennio Gambi and Susanna Spinsante A Human Activity Recognition System Using Skeleton Data from RGBD Sensors Enea Cippitelli, Samuele Gasparrini, Ennio Gambi and Susanna Spinsante -Presented By: Dhanesh Pradhan Motivation Activity Recognition

More information