Reconstructing visual experiences from brain activity evoked by natural movies
|
|
- Jasper Kelly
- 5 years ago
- Views:
Transcription
1 Reconstructing visual experiences from brain activity evoked by natural movies Shinji Nishimoto, An T. Vu, Thomas Naselaris, Yuval Benjamini, Bin Yu, and Jack L. Gallant, Current Biology, Yi Gao, PhD candidate in Neuroscience 11/19/2018
2 Brain activity Functional magnetic resonance imaging(fmri) measures brain activity by detecting changes associated with blood flow Unit: voxel The activity of neurons in your brain constantly changes as you are involved in different activities by Dr. Mark Lescroart
3 Part 1: Encoding Part 2: Decoding f(x)? ffffffff f(x)
4 Part 1: Encoding Recorded BOLD signals from three human subjects while they viewed a series of color natural movies (20 * 20 at 15 Hz) Two separate data sets were obtained from each subjects Training data: BOLD signals evoked by 7,200 s of color natural movies Data fit to a separate encoding model for each voxel located in posterior and ventral occipitotemporal visual cortex Test data: BOLD signals evoked by 540 s of color natural movies Data used to assess accuracy of encoding model and as targets for movie reconstruction
5 Motion-energy encoding model A two-stage process: Motion-energy filters Temporal hemodynamic response filters
6 Step 1: Motion-energy filters Spatially down-sample all movie frames to 96x96 pixels Convert RGB to CIE color space: luminance info maintained, color info discarded Luminance patterns pass through a bank of three-dimensional spatiotemporal Gabor wavelet filters
7 Gabor Wavelet filters Each filter is constructed by multiplying a three-dimensional spatiotemporal (2 dimensions for space, 1 dimension for time) sinusoid by a three-dimensional spatiotemporal Gaussian envelope Contains 6,555 separate three-dimensional Gabor filters Filters occur at six spatial frequencies (0, 2, 4, 8, 16, and 32 cycles/image), three temporal frequency filters (0, 2, and 4 Hz), and eight directions (0, 45,,135 degrees) NIshimoto & Gallant, 2011
8 Step 1: Motion-energy filters Each filter occurs at two quadratic phases (0 and 90 degrees) to facilitate motionenergy computation Output of each quadrature pair of filters is squared and summed to yield local motion-energy measurements(adelson & Bergen, 1985)
9 Step 1: Motion-energy filters Compression: log transformation
10 Step 1: Motion-energy filters Temporally down-sampled from 15 Hz to the sampling rate used to measure BOLD signals (1 Hz) Z-score transformation (mean = 0, standard deviation = 1)
11 Step 2: Hemodynamic response filters
12 Step 2: Hemodynamic response filters To capture temporal delays of BOLD signals in the model, vector s is constructed by concatenating motion-energy filtered stimulus vectors at various temporal delays Temporal window of hemodynamic response filters was 3-6 s before BOLD signal(4 time samples) L1-regularized least squares regression procedure was used to obtain the linear weights
13 Part 1: Encoding
14 Validity of motion-energy encoding model Comparison of retinotopic angle maps estimated using (top) the motion-energy encoding model and (bottom) conventional multi-focal mapping on a flattened cortical map
15 Movie identification accuracy Can the model correctly associate an observed BOLD signal pattern with the specific stimulus that evoked it? Motion-energy encoding model identified the specific movie stimulus that evoked an observed BOLD signal 95% of the time Identification accuracy was >75% for all three subjects
16 Motion-energy encoding model Valid Temporal information Spatial information Might provide good reconstructions of natural movies from brain activity measurements
17 Part 2: Decoding
18 A Bayesian approach to reconstruct movies from evoked BOLD signals Use BOLD signals measured from a set of voxels to recreate a picture of an unknown stimulus Observed signals Unknown movie?
19 A Bayesian approach to reconstruct movies from evoked BOLD signals Prior: Sampled natural movie (~18 million 1-s movie clips from YouTube) Posterior: 1. Each clip in the sampled prior is processed using the motion-energy encoding models fit to each voxel 2. Predicted signals are compared to measured signals evoked by an unknown stimulus Posterior rank: Likelihood of the observed response given the clip
20 Maximum a posteriori (MAP) and Averaged high posterior (AHP) reconstructions
21
22
23
24 Quantifying reconstruction quality Reconstruction accuracy was significantly higher than chance (p <.0001)
25 Summary Developed an encoding model that predicts BOLD signals in early visual areas with high accuracy. By using this model in a Bayesian framework, the authors were the first to reconstuct natural movies from human brain activity.
Pixels to Voxels: Modeling Visual Representation in the Human Brain
Pixels to Voxels: Modeling Visual Representation in the Human Brain Authors: Pulkit Agrawal, Dustin Stansbury, Jitendra Malik, Jack L. Gallant Presenters: JunYoung Gwak, Kuan Fang Outlines Background Motivation
More informationNonparametric sparse hierarchical models describe V1 fmri responses to natural images
Nonparametric sparse hierarchical models describe V1 fmri responses to natural images Pradeep Ravikumar, Vincent Q. Vu and Bin Yu Department of Statistics University of California, Berkeley Berkeley, CA
More informationarxiv: v1 [q-bio.nc] 24 Nov 2014
Deep Neural Networks Reveal a Gradient in the Complexity of Neural Representations across the Brain s Ventral Visual Pathway arxiv:4.6422v [q-bio.nc] 24 Nov 24 Umut Güçlü and Marcel A. J. van Gerven Radboud
More informationA spatial constrained multi target regression model for human brain activity prediction
Wen and Li Appl Inform (216) 3:1 DOI 1.1186/s4535-16-26-x RESEARCH Open Access A spatial constrained multi target regression model for human brain activity prediction Zhenfu Wen 1,2 and Yuanqing Li 1,2*
More informationBayesian Reconstruction of Natural Images from Human Brain Activity
Article Bayesian Reconstruction of Natural Images from Human Brain Activity Thomas Naselaris, 1 Ryan J. Prenger, 2 Kendrick N. Kay, 3 Michael Oliver, 4 and Jack L. Gallant 1,3,4, * 1 Helen Wills Neuroscience
More informationarxiv: v1 [q-bio.qm] 5 Mar 2015
Pyrcca: regularized kernel canonical correlation analysis in Python and its applications to neuroimaging. Natalia Y. Bilenko 1 and Jack L. Gallant 1,2 arxiv:1503.01538v1 [q-bio.qm] 5 Mar 2015 1 Helen Wills
More informationAnalysis of Functional MRI Timeseries Data Using Signal Processing Techniques
Analysis of Functional MRI Timeseries Data Using Signal Processing Techniques Sea Chen Department of Biomedical Engineering Advisors: Dr. Charles A. Bouman and Dr. Mark J. Lowe S. Chen Final Exam October
More informationAttention modulates spatial priority maps in human occipital, parietal, and frontal cortex
Attention modulates spatial priority maps in human occipital, parietal, and frontal cortex Thomas C. Sprague 1 and John T. Serences 1,2 1 Neuroscience Graduate Program, University of California San Diego
More informationTopographic Mapping with fmri
Topographic Mapping with fmri Retinotopy in visual cortex Tonotopy in auditory cortex signal processing + neuroimaging = beauty! Topographic Mapping with fmri Retinotopy in visual cortex Tonotopy in auditory
More informationSupplementary Figure 1. Decoding results broken down for different ROIs
Supplementary Figure 1 Decoding results broken down for different ROIs Decoding results for areas V1, V2, V3, and V1 V3 combined. (a) Decoded and presented orientations are strongly correlated in areas
More informationCS/NEUR125 Brains, Minds, and Machines. Due: Wednesday, April 5
CS/NEUR125 Brains, Minds, and Machines Lab 8: Using fmri to Discover Language Areas in the Brain Due: Wednesday, April 5 In this lab, you will analyze fmri data from an experiment that was designed to
More informationBayesian Inference in fmri Will Penny
Bayesian Inference in fmri Will Penny Bayesian Approaches in Neuroscience Karolinska Institutet, Stockholm February 2016 Overview Posterior Probability Maps Hemodynamic Response Functions Population
More informationTemporal and Cross-Subject Probabilistic Models for fmri Prediction Tasks
Temporal and Cross-Subject Probabilistic Models for fmri Prediction Tasks Alexis Battle Gal Chechik Daphne Koller Department of Computer Science Stanford University Stanford, CA 94305-9010 {ajbattle,gal,koller}@cs.stanford.edu
More informationINDEPENDENT COMPONENT ANALYSIS APPLIED TO fmri DATA: A GENERATIVE MODEL FOR VALIDATING RESULTS
INDEPENDENT COMPONENT ANALYSIS APPLIED TO fmri DATA: A GENERATIVE MODEL FOR VALIDATING RESULTS V. Calhoun 1,2, T. Adali, 2 and G. Pearlson 1 1 Johns Hopkins University Division of Psychiatric Neuro-Imaging,
More informationCS 229 Project report: Extracting vital signs from video
CS 229 Project report: Extracting vital signs from video D.Deriso, N. Banerjee, A. Fallou Abstract In both developing and developed countries, reducing the cost of medical care is a primary goal of science
More informationSeeking Interpretable Models for High Dimensional Data
Seeking Interpretable Models for High Dimensional Data Bin Yu Statistics Department, EECS Department University of California, Berkeley http://www.stat.berkeley.edu/~binyu Characteristics of Modern Data
More informationCognitive States Detection in fmri Data Analysis using incremental PCA
Department of Computer Engineering Cognitive States Detection in fmri Data Analysis using incremental PCA Hoang Trong Minh Tuan, Yonggwan Won*, Hyung-Jeong Yang International Conference on Computational
More informationA Semantic Shared Response Model
A Semantic Shared Response Model Kiran Vodrahalli*, Po-Hsuan Chen*, Janice Chen*, Esther Yong, Christopher Honey, Peter J. Ramadge*, Kenneth A. Norman*, Sanjeev Arora* ICML MVRL 2016 June 23, 2016 * =
More informationMulti-voxel pattern analysis: Decoding Mental States from fmri Activity Patterns
Multi-voxel pattern analysis: Decoding Mental States from fmri Activity Patterns Artwork by Leon Zernitsky Jesse Rissman NITP Summer Program 2012 Part 1 of 2 Goals of Multi-voxel Pattern Analysis Decoding
More informationPIXELS TO VOXELS: MODELING VISUAL REPRESENTATION IN THE HUMAN BRAIN
PIXELS TO VOXELS: MODELING VISUAL REPRESENTATION IN THE HUMAN BRAIN By Pulkit Agrawal, Dustin Stansbury, Jitendra Malik, Jack L. Gallant University of California Berkeley Presented by Tim Patzelt AGENDA
More informationStability. Bin Yu Statistics and EECS, University of California-Berkeley. SAMSI Opening Workshop on Massive Data, Sept, 2012
Stability Bin Yu Statistics and EECS, University of California-Berkeley SAMSI Opening Workshop on Massive Data, Sept, 2012 1 In honor of John W. Tukey June 16, 1915 July 26, 2000 2 1962: Future of Data
More informationModeling Visual Cortex V4 in Naturalistic Conditions with Invari. Representations
Modeling Visual Cortex V4 in Naturalistic Conditions with Invariant and Sparse Image Representations Bin Yu Departments of Statistics and EECS University of California at Berkeley Rutgers University, May
More informationA SYNOPTIC ACCOUNT FOR TEXTURE SEGMENTATION: FROM EDGE- TO REGION-BASED MECHANISMS
A SYNOPTIC ACCOUNT FOR TEXTURE SEGMENTATION: FROM EDGE- TO REGION-BASED MECHANISMS Enrico Giora and Clara Casco Department of General Psychology, University of Padua, Italy Abstract Edge-based energy models
More informationGraphical Models, Bayesian Method, Sampling, and Variational Inference
Graphical Models, Bayesian Method, Sampling, and Variational Inference With Application in Function MRI Analysis and Other Imaging Problems Wei Liu Scientific Computing and Imaging Institute University
More informationCoordinate Transformations in Parietal Cortex. Computational Models of Neural Systems Lecture 7.1. David S. Touretzky November, 2013
Coordinate Transformations in Parietal Cortex Lecture 7.1 David S. Touretzky November, 2013 Outline Anderson: parietal cells represent locations of visual stimuli. Zipser and Anderson: a backprop network
More informationDetecting Salient Contours Using Orientation Energy Distribution. Part I: Thresholding Based on. Response Distribution
Detecting Salient Contours Using Orientation Energy Distribution The Problem: How Does the Visual System Detect Salient Contours? CPSC 636 Slide12, Spring 212 Yoonsuck Choe Co-work with S. Sarma and H.-C.
More informationCS 229 Final Project Report Learning to Decode Cognitive States of Rat using Functional Magnetic Resonance Imaging Time Series
CS 229 Final Project Report Learning to Decode Cognitive States of Rat using Functional Magnetic Resonance Imaging Time Series Jingyuan Chen //Department of Electrical Engineering, cjy2010@stanford.edu//
More informationIndependent Component Analysis of fmri Data
Independent Component Analysis of fmri Data Denise Miller April 2005 Introduction Techniques employed to analyze functional magnetic resonance imaging (fmri) data typically use some form of univariate
More informationHST.583 Functional Magnetic Resonance Imaging: Data Acquisition and Analysis Fall 2006
MIT OpenCourseWare http://ocw.mit.edu HST.583 Functional Magnetic Resonance Imaging: Data Acquisition and Analysis Fall 2006 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.
More informationMultivariate Pattern Classification. Thomas Wolbers Space and Aging Laboratory Centre for Cognitive and Neural Systems
Multivariate Pattern Classification Thomas Wolbers Space and Aging Laboratory Centre for Cognitive and Neural Systems Outline WHY PATTERN CLASSIFICATION? PROCESSING STREAM PREPROCESSING / FEATURE REDUCTION
More informationScalable Video Coding
Introduction to Multimedia Computing Scalable Video Coding 1 Topics Video On Demand Requirements Video Transcoding Scalable Video Coding Spatial Scalability Temporal Scalability Signal to Noise Scalability
More informationIntroduction to Neuroimaging Janaina Mourao-Miranda
Introduction to Neuroimaging Janaina Mourao-Miranda Neuroimaging techniques have changed the way neuroscientists address questions about functional anatomy, especially in relation to behavior and clinical
More informationBayesian Spatiotemporal Modeling with Hierarchical Spatial Priors for fmri
Bayesian Spatiotemporal Modeling with Hierarchical Spatial Priors for fmri Galin L. Jones 1 School of Statistics University of Minnesota March 2015 1 Joint with Martin Bezener and John Hughes Experiment
More informationHow Many Humans Does it Take to Judge Video Quality?
How Many Humans Does it Take to Judge Video Quality? Bill Reckwerdt, CTO Video Clarity, Inc. Version 1.0 A Video Clarity Case Study page 1 of 5 Abstract for Subjective Video Quality Assessment In order
More informationRepresentational similarity analysis. Dr Ian Charest,
Representational similarity analysis Dr Ian Charest, Edinburgh, April 219 A space for neuroimaging studies Pattern across subjects Cross-subject correlation studies (e.g. social neuroscience) Raizada et
More informationFMRI data: Independent Component Analysis (GIFT) & Connectivity Analysis (FNC)
FMRI data: Independent Component Analysis (GIFT) & Connectivity Analysis (FNC) Software: Matlab Toolbox: GIFT & FNC Yingying Wang, Ph.D. in Biomedical Engineering 10 16 th, 2014 PI: Dr. Nadine Gaab Outline
More informationNaïve Bayes, Gaussian Distributions, Practical Applications
Naïve Bayes, Gaussian Distributions, Practical Applications Required reading: Mitchell draft chapter, sections 1 and 2. (available on class website) Machine Learning 10-601 Tom M. Mitchell Machine Learning
More informationSupplementary Methods
1 Travelling waves of activity in primary visual cortex during binocular rivalry Sang-Hun Lee, Randolph Blake, and David J. Heeger Supplementary Methods Data were acquired from three male observers, 25-34
More informationApplied Statistics and Machine Learning
Applied Statistics and Machine Learning Logistic Regression, and Generalized Linear models Model Selection, Lasso, and Structured Sparsity Bin Yu, IMA, June 19, 2013 Classification is supervised learning
More informationLearning and Inferring Depth from Monocular Images. Jiyan Pan April 1, 2009
Learning and Inferring Depth from Monocular Images Jiyan Pan April 1, 2009 Traditional ways of inferring depth Binocular disparity Structure from motion Defocus Given a single monocular image, how to infer
More informationarxiv: v1 [q-bio.nc] 9 Jun 2016
Modeling the dynamics of human brain activity with recurrent neural networks Umut Güçlü and Marcel A. J. van Gerven arxiv:1606.03071v1 [q-bio.nc] 9 Jun 2016 Radboud University, Donders Institute for Brain,
More informationOptimizing deep video representation to match brain activity
Optimizing deep video representation to match brain activity Hugo ichard, Ana Pinho, Bertrand Thirion, Guillaume Charpiat To cite this version: Hugo ichard, Ana Pinho, Bertrand Thirion, Guillaume Charpiat.
More informationMultivariate pattern classification
Multivariate pattern classification Thomas Wolbers Space & Ageing Laboratory (www.sal.mvm.ed.ac.uk) Centre for Cognitive and Neural Systems & Centre for Cognitive Ageing and Cognitive Epidemiology Outline
More informationSupplementary Data. in residuals voxel time-series exhibiting high variance, for example, large sinuses.
Supplementary Data Supplementary Materials and Methods Step-by-step description of principal component-orthogonalization technique Below is a step-by-step description of the principal component (PC)-orthogonalization
More informationSupplementary Figure 1
Supplementary Figure 1 BOLD and CBV functional maps showing EPI versus line-scanning FLASH fmri. A. Colored BOLD and CBV functional maps are shown in the highlighted window (green frame) of the raw EPI
More informationCross-orientation suppression in human visual cortex
J Neurophysiol 106: 2108 2119, 2011. First published July 20, 2011; doi:10.1152/jn.00540.2011. Cross-orientation suppression in human visual cortex Gijs Joost Brouwer and David J. Heeger Department of
More informationSimultaneous Estimation of Response Fields and Impulse Response Functions PhD Thesis Proposal
Simultaneous Estimation of Response Fields and Impulse Response Functions PhD Thesis Proposal Erich Huang Carnegie Mellon University - Department of Statistics February 11, 2009 Abstract Relevant issues
More informationFace Recognition by Combining Kernel Associative Memory and Gabor Transforms
Face Recognition by Combining Kernel Associative Memory and Gabor Transforms Author Zhang, Bai-ling, Leung, Clement, Gao, Yongsheng Published 2006 Conference Title ICPR2006: 18th International Conference
More informationCP Generalize Concepts in Abstract Multi-dimensional Image Model Component Semantics. David Clunie.
CP-1390 - Generalize Concepts in Abstract Multi-dimensional Image Model Semantics Page 1 STATUS Date of Last Update Person Assigned Submitter Name Submission Date Assigned 2014/06/09 David Clunie mailto:dclunie@dclunie.com
More informationNo-reference perceptual quality metric for H.264/AVC encoded video. Maria Paula Queluz
No-reference perceptual quality metric for H.264/AVC encoded video Tomás Brandão Maria Paula Queluz IT ISCTE IT IST VPQM 2010, Scottsdale, USA, January 2010 Outline 1. Motivation and proposed work 2. Technical
More informationBayes Classifiers and Generative Methods
Bayes Classifiers and Generative Methods CSE 4309 Machine Learning Vassilis Athitsos Computer Science and Engineering Department University of Texas at Arlington 1 The Stages of Supervised Learning To
More informationarxiv: v1 [stat.ap] 14 Apr 2011
To appear in the Annals of Applied Statistics ENCODING AND DECODING V1 FMRI RESPONSES TO NATURAL IMAGES WITH SPARSE NONPARAMETRIC MODELS arxiv:1104.2805v1 [stat.ap] 14 Apr 2011 By Vincent Q. Vu, Pradeep
More informationPDF hosted at the Radboud Repository of the Radboud University Nijmegen
PDF hosted at the Radboud Repository of the Radboud University Nijmegen The following full text is a publisher's version. For additional information about this publication click this link. http://hdl.handle.net/2066/131512
More informationVoxel selection algorithms for fmri
Voxel selection algorithms for fmri Henryk Blasinski December 14, 2012 1 Introduction Functional Magnetic Resonance Imaging (fmri) is a technique to measure and image the Blood- Oxygen Level Dependent
More informationAnalysis and Synthesis of Texture
Analysis and Synthesis of Texture CMPE 264: Image Analysis and Computer Vision Spring 02, Hai Tao 31/5/02 Extracting image structure by filter banks Q Represent image textures using the responses of a
More informationTexture. Outline. Image representations: spatial and frequency Fourier transform Frequency filtering Oriented pyramids Texture representation
Texture Outline Image representations: spatial and frequency Fourier transform Frequency filtering Oriented pyramids Texture representation 1 Image Representation The standard basis for images is the set
More informationEstimating image bases for visual image reconstruction from human brain activity
Estimating image bases for visual image reconstruction from human brain activity Yusuke Fujiwara 1 Yoichi Miyawaki 2,1 Yukiyasu Kamitani 1 1 ATR Computational Neuroscience Laboratories 2 National Institute
More informationArtifacts and Textured Region Detection
Artifacts and Textured Region Detection 1 Vishal Bangard ECE 738 - Spring 2003 I. INTRODUCTION A lot of transformations, when applied to images, lead to the development of various artifacts in them. In
More informationMultiVariate Bayesian (MVB) decoding of brain images
MultiVariate Bayesian (MVB) decoding of brain images Alexa Morcom Edinburgh SPM course 2015 With thanks to J. Daunizeau, K. Brodersen for slides stimulus behaviour encoding of sensorial or cognitive state?
More informationThe organization of the human cerebral cortex estimated by intrinsic functional connectivity
1 The organization of the human cerebral cortex estimated by intrinsic functional connectivity Journal: Journal of Neurophysiology Author: B. T. Thomas Yeo, et al Link: https://www.ncbi.nlm.nih.gov/pubmed/21653723
More informationFace Recognition & Detection Using Image Processing
Face Recognition & Detection Using Image Processing Chandani Sharma Research Scholar Department of Electronics & Communication Engg. Graphic Era University, Dehradun, U K, INDIA Abstract: Face Recognition
More informationHST.583 Functional Magnetic Resonance Imaging: Data Acquisition and Analysis Fall 2008
MIT OpenCourseWare http://ocw.mit.edu HST.583 Functional Magnetic Resonance Imaging: Data Acquisition and Analysis Fall 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.
More informationPattern Recognition for Neuroimaging Data
Pattern Recognition for Neuroimaging Data Edinburgh, SPM course April 2013 C. Phillips, Cyclotron Research Centre, ULg, Belgium http://www.cyclotron.ulg.ac.be Overview Introduction Univariate & multivariate
More informationCSE / 60537: Biometrics
CSE 40537 / 60537: Biometrics * ** * * ** * * Face Recognition 8 174 ! The Computer Vision Research Lab is seeking participants for 3-D Biometrics research! The CVRL is investigating the performance of
More informationMultivariate analyses & decoding
Multivariate analyses & decoding Kay Henning Brodersen Computational Neuroeconomics Group Department of Economics, University of Zurich Machine Learning and Pattern Recognition Group Department of Computer
More informationK-Means Clustering. Sargur Srihari
K-Means Clustering Sargur srihari@cedar.buffalo.edu 1 Topics in Mixture Models and EM Mixture models K-means Clustering Mixtures of Gaussians Maximum Likelihood EM for Gaussian mistures EM Algorithm Gaussian
More informationA Reduced-Dimension fmri! Shared Response Model
A Reduced-Dimension fmri! Shared Response Model Po-Hsuan! (Cameron)! Chen 1! Janice! Chen 2! Yaara! Yeshurun 2! Uri! Hasson 2! James! Haxby 3! Peter! Ramadge 1! 1 Department of Electrical Engineering,
More informationBayesian Segmentation and Motion Estimation in Video Sequences using a Markov-Potts Model
Bayesian Segmentation and Motion Estimation in Video Sequences using a Markov-Potts Model Patrice BRAULT and Ali MOHAMMAD-DJAFARI LSS, Laboratoire des Signaux et Systemes, CNRS UMR 8506, Supelec, Plateau
More informationPyramid Coding and Subband Coding
Pyramid Coding and Subband Coding Predictive pyramids Transform pyramids Subband coding Perfect reconstruction filter banks Quadrature mirror filter banks Octave band splitting Transform coding as a special
More informationA fast and efficient method for compressing fmri data sets
A fast and efficient method for compressing fmri data sets Fabian J. Theis 1,2 and Toshihisa Tanaka 1 1 Department of Electrical and Electronic Engineering, Tokyo University of Agriculture and Technology,
More informationFMA901F: Machine Learning Lecture 3: Linear Models for Regression. Cristian Sminchisescu
FMA901F: Machine Learning Lecture 3: Linear Models for Regression Cristian Sminchisescu Machine Learning: Frequentist vs. Bayesian In the frequentist setting, we seek a fixed parameter (vector), with value(s)
More informationReddit Recommendation System Daniel Poon, Yu Wu, David (Qifan) Zhang CS229, Stanford University December 11 th, 2011
Reddit Recommendation System Daniel Poon, Yu Wu, David (Qifan) Zhang CS229, Stanford University December 11 th, 2011 1. Introduction Reddit is one of the most popular online social news websites with millions
More informationTutorial BOLD Module
m a k i n g f u n c t i o n a l M R I e a s y n o r d i c B r a i n E x Tutorial BOLD Module Please note that this tutorial is for the latest released nordicbrainex. If you are using an older version please
More informationAiyar, Mani Laxman. Keywords: MPEG4, H.264, HEVC, HDTV, DVB, FIR.
2015; 2(2): 201-209 IJMRD 2015; 2(2): 201-209 www.allsubjectjournal.com Received: 07-01-2015 Accepted: 10-02-2015 E-ISSN: 2349-4182 P-ISSN: 2349-5979 Impact factor: 3.762 Aiyar, Mani Laxman Dept. Of ECE,
More informationCMPT 365 Multimedia Systems. Media Compression - Video
CMPT 365 Multimedia Systems Media Compression - Video Spring 2017 Edited from slides by Dr. Jiangchuan Liu CMPT365 Multimedia Systems 1 Introduction What s video? a time-ordered sequence of frames, i.e.,
More informationTemporal Modeling and Missing Data Estimation for MODIS Vegetation data
Temporal Modeling and Missing Data Estimation for MODIS Vegetation data Rie Honda 1 Introduction The Moderate Resolution Imaging Spectroradiometer (MODIS) is the primary instrument on board NASA s Earth
More informationDirectional Tuning in Single Unit Activity from the Monkey Motor Cortex
Teaching Week Computational Neuroscience, Mind and Brain, 2011 Directional Tuning in Single Unit Activity from the Monkey Motor Cortex Martin Nawrot 1 and Alexa Riehle 2 Theoretical Neuroscience and Neuroinformatics,
More informationSuper-Resolution from Image Sequences A Review
Super-Resolution from Image Sequences A Review Sean Borman, Robert L. Stevenson Department of Electrical Engineering University of Notre Dame 1 Introduction Seminal work by Tsai and Huang 1984 More information
More informationComputer Vision 2. SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung. Computer Vision 2 Dr. Benjamin Guthier
Computer Vision 2 SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung Computer Vision 2 Dr. Benjamin Guthier 1. IMAGE PROCESSING Computer Vision 2 Dr. Benjamin Guthier Content of this Chapter Non-linear
More informationStatistical Analysis of MRI Data
Statistical Analysis of MRI Data Shelby Cummings August 1, 2012 Abstract Every day, numerous people around the country go under medical testing with the use of MRI technology. Developed in the late twentieth
More informationElliptical Head Tracker using Intensity Gradients and Texture Histograms
Elliptical Head Tracker using Intensity Gradients and Texture Histograms Sriram Rangarajan, Dept. of Electrical and Computer Engineering, Clemson University, Clemson, SC 29634 srangar@clemson.edu December
More informationTHE SHUFFLE ESTIMATOR FOR EXPLAINABLE VARIANCE IN FMRI EXPERIMENTS. Department of Statistics, UC Berkeley
Submitted to the Annals of Applied Statistics THE SHUFFLE ESTIMATOR FOR EXPLAINABLE VARIANCE IN FMRI EXPERIMENTS By Yuval Benjamini and Bin Yu Department of Statistics, UC Berkeley In computational neuroscience,
More informationPyramid Coding and Subband Coding
Pyramid Coding and Subband Coding! Predictive pyramids! Transform pyramids! Subband coding! Perfect reconstruction filter banks! Quadrature mirror filter banks! Octave band splitting! Transform coding
More informationLocating ego-centers in depth for hippocampal place cells
204 5th Joint Symposium on Neural Computation Proceedings UCSD (1998) Locating ego-centers in depth for hippocampal place cells Kechen Zhang,' Terrence J. Sejeowski112 & Bruce L. ~cnau~hton~ 'Howard Hughes
More informationStatistical Analysis of Neuroimaging Data. Phebe Kemmer BIOS 516 Sept 24, 2015
Statistical Analysis of Neuroimaging Data Phebe Kemmer BIOS 516 Sept 24, 2015 Review from last time Structural Imaging modalities MRI, CAT, DTI (diffusion tensor imaging) Functional Imaging modalities
More informationExtensions of One-Dimensional Gray-level Nonlinear Image Processing Filters to Three-Dimensional Color Space
Extensions of One-Dimensional Gray-level Nonlinear Image Processing Filters to Three-Dimensional Color Space Orlando HERNANDEZ and Richard KNOWLES Department Electrical and Computer Engineering, The College
More informationMULTIVARIATE ANALYSES WITH fmri DATA
MULTIVARIATE ANALYSES WITH fmri DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) Institute for Biomedical Engineering University of Zurich & ETH Zurich Motivation Modelling Concepts Learning
More informationCS229 Project: Classification of Motor Tasks Based on Functional Neuroimaging
CS229 Project: Classification of Motor Tasks Based on Functional Neuroimaging Gerald Brantner Mechanical Engineering, Stanford University, Stanford, CA 9435, USA. geraldb@stanford.edu Georg Schorpp Management
More informationTime-Frequency Method Based Activation Detection in Functional MRI Time-Series
Time-Frequency Method Based Activation Detection in Functional MRI Time-Series Arun Kumar 1,2 and Jagath C. Rajapakse 1,3 1 School of Computing, NTU, Singapore 2 School of EEE,Singapore Polytechnic, Singapore
More informationCSC 578 Neural Networks and Deep Learning
CSC 578 Neural Networks and Deep Learning Fall 2018/19 7. Recurrent Neural Networks (Some figures adapted from NNDL book) 1 Recurrent Neural Networks 1. Recurrent Neural Networks (RNNs) 2. RNN Training
More informationOptimizing the Deblocking Algorithm for. H.264 Decoder Implementation
Optimizing the Deblocking Algorithm for H.264 Decoder Implementation Ken Kin-Hung Lam Abstract In the emerging H.264 video coding standard, a deblocking/loop filter is required for improving the visual
More informationTemporal Feature Selection for fmri Analysis
Temporal Feature Selection for fmri Analysis Mark Palatucci School of Computer Science Carnegie Mellon University Pittsburgh, Pennsylvania markmp@cmu.edu ABSTRACT Recent work in neuroimaging has shown
More informationFeature Selection for fmri Classification
Feature Selection for fmri Classification Chuang Wu Program of Computational Biology Carnegie Mellon University Pittsburgh, PA 15213 chuangw@andrew.cmu.edu Abstract The functional Magnetic Resonance Imaging
More informationFilter Select ion Model for Generating Visual Mot ion Signals
In: C. L. Giles, S. J. Hanson, and J. D. Cowan (Eds.) Advances in Neural Infirmation Processing Systems 5, Morgan Kaufman Publishers, San Mateo, CA, (1993). Filter Select ion Model for Generating Visual
More informationDeep Learning. Deep Learning. Practical Application Automatically Adding Sounds To Silent Movies
http://blog.csdn.net/zouxy09/article/details/8775360 Automatic Colorization of Black and White Images Automatically Adding Sounds To Silent Movies Traditionally this was done by hand with human effort
More informationSpatiotemporal Gabor filters: a new method for dynamic texture recognition
Spatiotemporal Gabor filters: a new method for dynamic texture recognition Wesley Nunes Gonçalves, Bruno Brandoli Machado, Odemir Martinez Bruno Physics Institute of São Carlos (IFSC) Institute of Mathematical
More informationSaliency Extraction for Gaze-Contingent Displays
In: Workshop on Organic Computing, P. Dadam, M. Reichert (eds.), Proceedings of the 34th GI-Jahrestagung, Vol. 2, 646 650, Ulm, September 2004. Saliency Extraction for Gaze-Contingent Displays Martin Böhme,
More informationEfficient Visual Coding: From Retina To V2
Efficient Visual Coding: From Retina To V Honghao Shan Garrison Cottrell Computer Science and Engineering UCSD La Jolla, CA 9093-0404 shanhonghao@gmail.com, gary@ucsd.edu Abstract The human visual system
More informationPredicting Eyes Fixations in Movie Videos: Visual Saliency Experiments on a New Eye-Tracking Database
Predicting Eyes Fixations in Movie Videos: Visual Saliency Experiments on a New Eye-Tracking Database Petros Koutras, Athanasios Katsamanis, and Petros Maragos School of Electrical and Computer Engineering
More informationShort Survey on Static Hand Gesture Recognition
Short Survey on Static Hand Gesture Recognition Huu-Hung Huynh University of Science and Technology The University of Danang, Vietnam Duc-Hoang Vo University of Science and Technology The University of
More information