Analysis of (cdna) Microarray Data: Part I. Sources of Bias and Normalisation

Size: px
Start display at page:

Download "Analysis of (cdna) Microarray Data: Part I. Sources of Bias and Normalisation"

Transcription

1 Analysis of (cdna) Microarray Data: Part I. Sources of Bias and Normalisation MICROARRAY ANALYSIS My (Educated?) View 1. Data included in GEXEX a. Whole data stored and securely available b. GP3xCLI on each hybridisation 2. Relaxed data acquisition criteria a. Signal to Noise > 1.00 (relaxer (sp?) exist) b. Mean to Median > 0.85 (Tran et al. 2002) 3. Data Normalisation 4. Mixed-Model Equations a. Check Residuals (plot Residuals vs Predicted) b. Check REML estimates of Variance Components c. Proportion of Total Variance due to Gene x Variety 5. Process Gene x Treatment BLUPs Differentially Expressed Genes a. t-statistics Z-score P-value b. Mixtures of Distributions Posterior Probabilities 6. Process Differentially Expressed genes a. Hierarchical clustering b. Gene ontology analysis 1

2 MICROARRAY ANALYSIS BASIC PIECES FOR SIGNAL DETECTION Foreground RED and GREEN R f G f Background RED and GREEN R b G b Background-corrected RED R = R f R b GREEN G = G f G b True Signals! Log-transformed Difference: Minus Mean: Average Log 2 (R) Log 2 (G) M = Log 2 (R) Log 2 (G) = Log 2 (R/G) A = 0.5 * ( Log 2 (R) + Log 2 (G) ) = 0.5 * Log 2 (R*G) MA-Plots to come Data Acquisition Criteria The Red/Green Intensities can be spatially biased 2

3 Data Acquisition Criteria The Red/Green Intensities can be intensity-biased MA-Plot Values should scatter around zero Data Acquisition Criteria Background Correction: Why bother? 3

4 Data Acquisition Criteria Background Correction: Why bother? Data Acquisition Criteria RED versus GREEN Log-transformation: Why bother? 4

5 Data Acquisition Criteria MA-Plots: All versus only valid signals Data Acquisition Criteria Signal to Noise Ratio Fg Bg S2N = σ Bg Mean to Median Correlation Min M 2 M = Max { Mean, Median} { Mean, Median} 5

6 Data Normalisation Normalisation is an attempt to correct for systematic bias. Normalisation allows you to compare data from one array to another. Systematic Bias can be introduced into microarray experiments at all stages. Need to: Avoid it (as much as possible) Recognize it Correct for it Discard unrecoverable data In practice we do not always understand the data - inevitably some biology will be removed too (or at least not revealed). Pool of Cell Lines Data Normalisation Tumor Source: Catherine Ball (Stanford) Different amounts of Differential starting material. labeling efficiency of dyes Different amounts of Differential RNA in efficiency each channel of scanning Differential in each efficiency channel. of hybridization over slide surface. 6

7 Sources Different labeling efficiencies or dye effects Scanner malfunction Differences in concentration of DNA on arrays (plate effects) Printing or tip problems Uneven hybridization Batch bias Experimenter issues Systematic Bias and Dealing with it Detect and recognize the effect Note something odd Determine magnitude and effect on data Try a few methods Identify source of bias Think big! Eliminate or reduce contributing factors Correct data Discard uncorrectable data Systematic Bias Labeling Efficiencies Cause Bias One channel of a twochannel array has higher intensity than the other (usually GREEN). Most common source of recognizable bias. Solution: Most easy to addressed (eg. dyeswaps, balanced loops). 7

8 Systematic Bias Scanning (operator?) Bias Mis-aligned lasers can cause big problems In this case, the two channels are slightly out of register Solution: fix the scanner and repeat Systematic Bias Printing (operator?) Bias Irregular shaped spots are often observed (printing error) Slides from the same printing batch cluster together Solution: Probably limited to better printing technique and image analysis, rather than normalization 8

9 Systematic Bias Probe Bias Different concentrations of probes might produce patterns in arrays Biological role of probes can produce patterns in arrays These patterns can create a spatial bias that are not artificial, but biological Systematic Bias Probe Bias Probes arranged on the array based on biological function cause spatial bias Solution: avoid arranging reporters based on function, know your experimental design Coding regions Intergenic regions 9

10 Systematic Bias Hybridisation (operator?) Bias Poor technique during hybridisation can cause a spatial bias Operator is one of the largest sources of systematic bias Experiments done by the same operator often cluster together more tightly than warranted by the biology Solution: Consistent methods, successful techniques Data Normalisation and other beautifying techniques Technique Choices Aim (Real) Aim (Ideal) Transformation To Near Normality Log 2 Lin-Log Numerically tractable Gaussian Normalisation Location Location Parameter: 1. Mean 2. Median 3. Regression(s) (LOWESS) Account for systematic effects Gaussian Standardisation Scale Scale Parameter Stabilise variance Gaussian 10

11 Data Normalisation Transformation to near normality Solution: Explore the entire Box-Cox family of power transformations: x ( λ) λ x 1 = λ ln( x) λ 0 λ= l( λ) = ln 2 n + ( λ 1) n j= 1 n j= 1 ( x ( λ) j ln( x ) x j ( λ) ) 2 Maximum at λ 0, hence use the log-transformation Data Normalisation Transformation to near normality Raw Data exponential-like Log2 Transformed normal-like 11

12 Data Normalisation Transformation to near normality Lin-Log Transformation x ( δ ) log2 ( x) x δ 1 = x log ( δ) 1+ x< δ 2 δ x = background corrected = Fg - Bg Data Normalisation Transformation to near normality The Edwards transformation as well as the Lin-Log transformation are an attempt to use the entire data, not only those for which foreground is greater than background. The reasoning is that errors are linear and multiplicative for small and large signals, respectively. The search for and choice of δ could be rather unconvincing (eg. Different for different array slides). Solution: Use Log 2 if Foreground > Background Otherwise, use a small arbitrary value (say 0), Or simply disregard. Alternatively: Use only Foreground and Log 2 it 12

13 Log 2 (R/G) c = M - c Location Parameter GLOBAL: Mean: c = Mean of M s Median: c = Median of M s Assumption: Changes roughly symmetric around Mean or Median LOWESS: c = Weighted Regress of M on A Assumption: Changes roughly symmetric at all intensities LOCAL: LOWESS: c = c(i) = Weighted Regression of M on A within print-tip-group i LOWESS = Locally WEighted Regression and Smoothing Scatterplots LOWESS = Locally WEighted Regression and Smoothing Scatterplots Source: G Rosa

14 LOWESS = Locally WEighted Regression and Smoothing Scatterplots SAS Code Source: G Rosa Genetic analysis of complex traits using SAS ISBN Normalised Intensities LOWESS = Locally WEighted Regression and Smoothing Scatterplots Source: G Rosa

15 LOWESS = Locally WEighted Regression and Smoothing Scatterplots Source: G Rosa None Source: Yang et al

16 After Global Median Source: Yang et al 2002 Global Lowess Source: Yang et al

17 Print-in-Group Lowess Source: Yang et al 2002 After Print-in-Group Lowess Source: Yang et al

18 Additional Assumption (other than symmetry of changes): The proportion of genes that are Differentially Expressed (DE) is minimal Question: Answer: Comment: Which genes to use? Only the ones (housekeeping) that we know are not DE Boutique arrays become a nuisance Scale Normalisation (Standardisation) Some scale adjustments may be required so that the relative expression levels from one particular experiment (slide) do not dominate the average relative expression levels across replicate experiments. Log 2 (R/G) c(i) a(i) Notes: 1. The scaling a(i) is such that Var(M) = a(i) 2 σ 2 2. The estimation requires an approximation ( robust ) to the geometric mean: MAD where MAD is the Median Absolute Deviation. 3. It doesn t get any more heuristic (funnier?) than this I I i =1 Yang et al 2002 i MAD i 18

19 Data Normalisation and other beautifying techniques Notes: 1. Except Log2, everything else applies only to Ratios: M = log2(r/g) 2. Except Log2, everything else applies only within slide 3. Everything is beautified to identify DE genes straight from MA-plot, either from a single slide or from a function of M s across slides. 4. The uncertainty in measurements increases as intensity decreases 5. Measurements close to the detection limit are the most uncertain (cf. Sensitivity) 6. Fold-change measurements ignore these effects 7. We can calculate an intensity-dependent z-score that measures the ratio relative to the standard deviation in the data Data Normalisation and other beautifying techniques Corrected Log10 ( Ratio ) 2 2 Locally estimated standard deviation of positive ratios Z= 5 Corrected Log10 ( Ratio ) 1 2-fold Z= 1 0 Z= -1 2-fold -1 Locally estimated standard deviation of negative ratios Z= 2 1 Z= 1 2-fold 0 2-fold Z= -1-1 Z= -5 Z= -2 Z= Mean ( Log10 ( Intensity ) ) Mean ( Log10 ( Intensity ) ) Local Log10 ( Ratio ) Z-Score 10 5 Z > 2 is at the ~ 95% confidence level Source: J Pevsner 2004 Z= Mean ( Log10 ( Intensity ) ) 19

20 Normalisation: References Bilban M, Buehler LK, Head S, Desoye G, Quaranta V. Normalizing DNA microarray data. Curr Issues Mol Biol Apr;4(2): Durbin BP, Hardin JS, Hawkins DM, Rocke DM. A variance-stabilizing transformation for gene-expression microarray data. Bioinformatics Jul;18 Suppl 1:S Kepler TB, Crosby L, Morgan KT. Normalization and analysis of DNA microarray data by self-consistency and local regression. Genome Biol Jun 28;3(7):RESEARCH0037. Schuchhardt, J., D. Beule, et al. Normalization Strategies for cdna Microarrays. NAR (10): E47-e47. Tran PH, Peiffer DA, Shin Y, Meek LM, Brody JP, Cho KW. Microarray optimizations: increasing spot accuracy and automated identification of true microarray signals. Nucleic Acids Res Jun 15;30(12):e54. Tseng GC, Oh MK, Rohlin L, Liao JC, Wong WH. Issues in cdna microarray analysis: quality filtering, channel normalization, models of variations and assessment of gene effects. Nucleic Acids Res Jun 15;29(12): Tsodikov A, Szabo A, Jones D. Adjustments and measures of differential expression for microarray data. Bioinformatics Feb;18(2): Yang MC, Ruan QG, Yang JJ, Eckenrode S, Wu S, McIndoe RA, She JX. A statistical method for flagging weak spots improves normalization and ratio estimates in microarrays. Physiol Genomics Oct 10;7(1): Yang YH, Dudoit S, Luu P, Lin DM, Peng V, Ngai J, Speed TP. Normalization for cdna microarray data: a robust composite method addressing single and multiple slide systematic variation. Nucleic Acids Res Feb 15;30(4):e15. 20

/ Computational Genomics. Normalization

/ Computational Genomics. Normalization 10-810 /02-710 Computational Genomics Normalization Genes and Gene Expression Technology Display of Expression Information Yeast cell cycle expression Experiments (over time) baseline expression program

More information

PROCEDURE HELP PREPARED BY RYAN MURPHY

PROCEDURE HELP PREPARED BY RYAN MURPHY Module on Microarray Statistics for Biochemistry: Metabolomics & Regulation Part 2: Normalization of Microarray Data By Johanna Hardin and Laura Hoopes Instructions and worksheet to be handed in NAME Lecture/Discussion

More information

Preprocessing -- examples in microarrays

Preprocessing -- examples in microarrays Preprocessing -- examples in microarrays I: cdna arrays Image processing Addressing (gridding) Segmentation (classify a pixel as foreground or background) Intensity extraction (summary statistic) Normalization

More information

Normalization: Bioconductor s marray package

Normalization: Bioconductor s marray package Normalization: Bioconductor s marray package Yee Hwa Yang 1 and Sandrine Dudoit 2 October 30, 2017 1. Department of edicine, University of California, San Francisco, jean@biostat.berkeley.edu 2. Division

More information

Course on Microarray Gene Expression Analysis

Course on Microarray Gene Expression Analysis Course on Microarray Gene Expression Analysis ::: Normalization methods and data preprocessing Madrid, April 27th, 2011. Gonzalo Gómez ggomez@cnio.es Bioinformatics Unit CNIO ::: Introduction. The probe-level

More information

Applying Data-Driven Normalization Strategies for qpcr Data Using Bioconductor

Applying Data-Driven Normalization Strategies for qpcr Data Using Bioconductor Applying Data-Driven Normalization Strategies for qpcr Data Using Bioconductor Jessica Mar April 30, 2018 1 Introduction High-throughput real-time quantitative reverse transcriptase polymerase chain reaction

More information

Microarray Data Analysis (V) Preprocessing (i): two-color spotted arrays

Microarray Data Analysis (V) Preprocessing (i): two-color spotted arrays Microarray Data Analysis (V) Preprocessing (i): two-color spotted arrays Preprocessing Probe-level data: the intensities read for each of the components. Genomic-level data: the measures being used in

More information

Bioconductor s stepnorm package

Bioconductor s stepnorm package Bioconductor s stepnorm package Yuanyuan Xiao 1 and Yee Hwa Yang 2 October 18, 2004 Departments of 1 Biopharmaceutical Sciences and 2 edicine University of California, San Francisco yxiao@itsa.ucsf.edu

More information

How to use the DEGseq Package

How to use the DEGseq Package How to use the DEGseq Package Likun Wang 1,2 and Xi Wang 1. October 30, 2018 1 MOE Key Laboratory of Bioinformatics and Bioinformatics Division, TNLIST /Department of Automation, Tsinghua University. 2

More information

Introduction to GE Microarray data analysis Practical Course MolBio 2012

Introduction to GE Microarray data analysis Practical Course MolBio 2012 Introduction to GE Microarray data analysis Practical Course MolBio 2012 Claudia Pommerenke Nov-2012 Transkriptomanalyselabor TAL Microarray and Deep Sequencing Core Facility Göttingen University Medical

More information

Methodology for spot quality evaluation

Methodology for spot quality evaluation Methodology for spot quality evaluation Semi-automatic pipeline in MAIA The general workflow of the semi-automatic pipeline analysis in MAIA is shown in Figure 1A, Manuscript. In Block 1 raw data, i.e..tif

More information

Giri Narasimhan. CAP 5510: Introduction to Bioinformatics. ECS 254; Phone: x3748

Giri Narasimhan. CAP 5510: Introduction to Bioinformatics. ECS 254; Phone: x3748 CAP 5510: Introduction to Bioinformatics Giri Narasimhan ECS 254; Phone: x3748 giri@cis.fiu.edu www.cis.fiu.edu/~giri/teach/bioinfs07.html 3/3/08 CAP5510 1 Gene g Probe 1 Probe 2 Probe N 3/3/08 CAP5510

More information

Analyzing ICAT Data. Analyzing ICAT Data

Analyzing ICAT Data. Analyzing ICAT Data Analyzing ICAT Data Gary Van Domselaar University of Alberta Analyzing ICAT Data ICAT: Isotope Coded Affinity Tag Introduced in 1999 by Ruedi Aebersold as a method for quantitative analysis of complex

More information

Using FARMS for summarization Using I/NI-calls for gene filtering. Djork-Arné Clevert. Institute of Bioinformatics, Johannes Kepler University Linz

Using FARMS for summarization Using I/NI-calls for gene filtering. Djork-Arné Clevert. Institute of Bioinformatics, Johannes Kepler University Linz Software Manual Institute of Bioinformatics, Johannes Kepler University Linz Using FARMS for summarization Using I/NI-calls for gene filtering Djork-Arné Clevert Institute of Bioinformatics, Johannes Kepler

More information

Organizing, cleaning, and normalizing (smoothing) cdna microarray data

Organizing, cleaning, and normalizing (smoothing) cdna microarray data Organizing, cleaning, and normalizing (smoothing) cdna microarray data All product names are given as examples only and they are not endorsed by the USDA or the University of Illinois. INTRODUCTION The

More information

A Two-Way Semi-Linear Model for Normalization and Significant Analysis of cdna Microarray Data

A Two-Way Semi-Linear Model for Normalization and Significant Analysis of cdna Microarray Data A Two-Way Semi-Linear Model for Normalization and Significant Analysis of cdna Microarray Data Jian Huang, Deli Wang, and Cun-Hui Zhang 1:Dpeartment of Statistics and Actuarial Science, and Program in

More information

Gene Clustering & Classification

Gene Clustering & Classification BINF, Introduction to Computational Biology Gene Clustering & Classification Young-Rae Cho Associate Professor Department of Computer Science Baylor University Overview Introduction to Gene Clustering

More information

Gene signature selection to predict survival benefits from adjuvant chemotherapy in NSCLC patients

Gene signature selection to predict survival benefits from adjuvant chemotherapy in NSCLC patients 1 Gene signature selection to predict survival benefits from adjuvant chemotherapy in NSCLC patients 1,2 Keyue Ding, Ph.D. Nov. 8, 2014 1 NCIC Clinical Trials Group, Kingston, Ontario, Canada 2 Dept. Public

More information

How do microarrays work

How do microarrays work Lecture 3 (continued) Alvis Brazma European Bioinformatics Institute How do microarrays work condition mrna cdna hybridise to microarray condition Sample RNA extract labelled acid acid acid nucleic acid

More information

Package OLIN. September 30, 2018

Package OLIN. September 30, 2018 Version 1.58.0 Date 2016-02-19 Package OLIN September 30, 2018 Title Optimized local intensity-dependent normalisation of two-color microarrays Author Matthias Futschik Maintainer Matthias

More information

STA Rev. F Learning Objectives. Learning Objectives (Cont.) Module 3 Descriptive Measures

STA Rev. F Learning Objectives. Learning Objectives (Cont.) Module 3 Descriptive Measures STA 2023 Module 3 Descriptive Measures Learning Objectives Upon completing this module, you should be able to: 1. Explain the purpose of a measure of center. 2. Obtain and interpret the mean, median, and

More information

Micro-array Image Analysis using Clustering Methods

Micro-array Image Analysis using Clustering Methods Micro-array Image Analysis using Clustering Methods Mrs Rekha A Kulkarni PICT PUNE kulkarni_rekha@hotmail.com Abstract Micro-array imaging is an emerging technology and several experimental procedures

More information

Vector Xpression 3. Speed Tutorial: III. Creating a Script for Automating Normalization of Data

Vector Xpression 3. Speed Tutorial: III. Creating a Script for Automating Normalization of Data Vector Xpression 3 Speed Tutorial: III. Creating a Script for Automating Normalization of Data Table of Contents Table of Contents...1 Important: Please Read...1 Opening Data in Raw Data Viewer...2 Creating

More information

MATH3880 Introduction to Statistics and DNA MATH5880 Statistics and DNA Practical Session Monday, 16 November pm BRAGG Cluster

MATH3880 Introduction to Statistics and DNA MATH5880 Statistics and DNA Practical Session Monday, 16 November pm BRAGG Cluster MATH3880 Introduction to Statistics and DNA MATH5880 Statistics and DNA Practical Session Monday, 6 November 2009 3.00 pm BRAGG Cluster This document contains the tasks need to be done and completed by

More information

Nature Publishing Group

Nature Publishing Group Figure S I II III 6 7 8 IV ratio ssdna (S/G) WT hr hr hr 6 7 8 9 V 6 6 7 7 8 8 9 9 VII 6 7 8 9 X VI XI VIII IX ratio ssdna (S/G) rad hr hr hr 6 7 Chromosome Coordinate (kb) 6 6 Nature Publishing Group

More information

Learner Expectations UNIT 1: GRAPICAL AND NUMERIC REPRESENTATIONS OF DATA. Sept. Fathom Lab: Distributions and Best Methods of Display

Learner Expectations UNIT 1: GRAPICAL AND NUMERIC REPRESENTATIONS OF DATA. Sept. Fathom Lab: Distributions and Best Methods of Display CURRICULUM MAP TEMPLATE Priority Standards = Approximately 70% Supporting Standards = Approximately 20% Additional Standards = Approximately 10% HONORS PROBABILITY AND STATISTICS Essential Questions &

More information

All About PlexSet Technology Data Analysis in nsolver Software

All About PlexSet Technology Data Analysis in nsolver Software All About PlexSet Technology Data Analysis in nsolver Software PlexSet is a multiplexed gene expression technology which allows pooling of up to 8 samples per ncounter cartridge lane, enabling users to

More information

Supplementary information: Detection of differentially expressed segments in tiling array data

Supplementary information: Detection of differentially expressed segments in tiling array data Supplementary information: Detection of differentially expressed segments in tiling array data Christian Otto 1,2, Kristin Reiche 3,1,4, Jörg Hackermüller 3,1,4 July 1, 212 1 Bioinformatics Group, Department

More information

Gene Expression an Overview of Problems & Solutions: 1&2. Utah State University Bioinformatics: Problems and Solutions Summer 2006

Gene Expression an Overview of Problems & Solutions: 1&2. Utah State University Bioinformatics: Problems and Solutions Summer 2006 Gene Expression an Overview of Problems & Solutions: 1&2 Utah State University Bioinformatics: Problems and Solutions Summer 2006 Review DNA mrna Proteins action! mrna transcript abundance ~ expression

More information

ChristoHouston Energy Inc. (CHE INC.) Pipeline Anomaly Analysis By Liquid Green Technologies Corporation

ChristoHouston Energy Inc. (CHE INC.) Pipeline Anomaly Analysis By Liquid Green Technologies Corporation ChristoHouston Energy Inc. () Pipeline Anomaly Analysis By Liquid Green Technologies Corporation CHE INC. Overview: Review of Scope of Work Wall thickness analysis - Pipeline and sectional statistics Feature

More information

MICROARRAY IMAGE SEGMENTATION USING CLUSTERING METHODS

MICROARRAY IMAGE SEGMENTATION USING CLUSTERING METHODS Mathematical and Computational Applications, Vol. 5, No. 2, pp. 240-247, 200. Association for Scientific Research MICROARRAY IMAGE SEGMENTATION USING CLUSTERING METHODS Volkan Uslan and Đhsan Ömür Bucak

More information

Statistical Analysis of Metabolomics Data. Xiuxia Du Department of Bioinformatics & Genomics University of North Carolina at Charlotte

Statistical Analysis of Metabolomics Data. Xiuxia Du Department of Bioinformatics & Genomics University of North Carolina at Charlotte Statistical Analysis of Metabolomics Data Xiuxia Du Department of Bioinformatics & Genomics University of North Carolina at Charlotte Outline Introduction Data pre-treatment 1. Normalization 2. Centering,

More information

Cluster Analysis for Microarray Data

Cluster Analysis for Microarray Data Cluster Analysis for Microarray Data Seventh International Long Oligonucleotide Microarray Workshop Tucson, Arizona January 7-12, 2007 Dan Nettleton IOWA STATE UNIVERSITY 1 Clustering Group objects that

More information

Double Self-Organizing Maps to Cluster Gene Expression Data

Double Self-Organizing Maps to Cluster Gene Expression Data Double Self-Organizing Maps to Cluster Gene Expression Data Dali Wang, Habtom Ressom, Mohamad Musavi, Cristian Domnisoru University of Maine, Department of Electrical & Computer Engineering, Intelligent

More information

STA Module 2B Organizing Data and Comparing Distributions (Part II)

STA Module 2B Organizing Data and Comparing Distributions (Part II) STA 2023 Module 2B Organizing Data and Comparing Distributions (Part II) Learning Objectives Upon completing this module, you should be able to 1 Explain the purpose of a measure of center 2 Obtain and

More information

STA Learning Objectives. Learning Objectives (cont.) Module 2B Organizing Data and Comparing Distributions (Part II)

STA Learning Objectives. Learning Objectives (cont.) Module 2B Organizing Data and Comparing Distributions (Part II) STA 2023 Module 2B Organizing Data and Comparing Distributions (Part II) Learning Objectives Upon completing this module, you should be able to 1 Explain the purpose of a measure of center 2 Obtain and

More information

Vocabulary. 5-number summary Rule. Area principle. Bar chart. Boxplot. Categorical data condition. Categorical variable.

Vocabulary. 5-number summary Rule. Area principle. Bar chart. Boxplot. Categorical data condition. Categorical variable. 5-number summary 68-95-99.7 Rule Area principle Bar chart Bimodal Boxplot Case Categorical data Categorical variable Center Changing center and spread Conditional distribution Context Contingency table

More information

MiChip. Jonathon Blake. October 30, Introduction 1. 5 Plotting Functions 3. 6 Normalization 3. 7 Writing Output Files 3

MiChip. Jonathon Blake. October 30, Introduction 1. 5 Plotting Functions 3. 6 Normalization 3. 7 Writing Output Files 3 MiChip Jonathon Blake October 30, 2018 Contents 1 Introduction 1 2 Reading the Hybridization Files 1 3 Removing Unwanted Rows and Correcting for Flags 2 4 Summarizing Intensities 3 5 Plotting Functions

More information

ROTS: Reproducibility Optimized Test Statistic

ROTS: Reproducibility Optimized Test Statistic ROTS: Reproducibility Optimized Test Statistic Fatemeh Seyednasrollah, Tomi Suomi, Laura L. Elo fatsey (at) utu.fi March 3, 2016 Contents 1 Introduction 2 2 Algorithm overview 3 3 Input data 3 4 Preprocessing

More information

Bayesian Robust Inference of Differential Gene Expression The bridge package

Bayesian Robust Inference of Differential Gene Expression The bridge package Bayesian Robust Inference of Differential Gene Expression The bridge package Raphael Gottardo October 30, 2017 Contents Department Statistics, University of Washington http://www.rglab.org raph@stat.washington.edu

More information

As of August 15, 2008, GenBank contained bases from reported sequences. The search procedure should be

As of August 15, 2008, GenBank contained bases from reported sequences. The search procedure should be 48 Bioinformatics I, WS 09-10, S. Henz (script by D. Huson) November 26, 2009 4 BLAST and BLAT Outline of the chapter: 1. Heuristics for the pairwise local alignment of two sequences 2. BLAST: search and

More information

Decision Systems Group, Brigham and Women s Hospital, Harvard Medical School, Boston, MA 02115, USA

Decision Systems Group, Brigham and Women s Hospital, Harvard Medical School, Boston, MA 02115, USA TITLE: Analysis of repeatability in spotted cdna microarrays. Authors Tor-Kristian Jenssen 1,2, Mette Langaas 2,3,4 Winston P. Kuo 5,6,7 Birgitte Smith-Sørensen 2 Ola Myklebost 2 Eivind Hovig 2 Institutions

More information

Anaquin - Vignette Ted Wong January 05, 2019

Anaquin - Vignette Ted Wong January 05, 2019 Anaquin - Vignette Ted Wong (t.wong@garvan.org.au) January 5, 219 Citation [1] Representing genetic variation with synthetic DNA standards. Nature Methods, 217 [2] Spliced synthetic genes as internal controls

More information

Second revision: Supplementary Material Linking brain-wide multivoxel activation patterns to behaviour: examples from language and math

Second revision: Supplementary Material Linking brain-wide multivoxel activation patterns to behaviour: examples from language and math Second revision: Supplementary Material Linking brain-wide multivoxel activation patterns to behaviour: examples from language and math Rajeev D. S. Raizada, Feng Ming Tsao, Huei-Mei Liu, Ian D. Holloway,

More information

Clustering. Lecture 6, 1/24/03 ECS289A

Clustering. Lecture 6, 1/24/03 ECS289A Clustering Lecture 6, 1/24/03 What is Clustering? Given n objects, assign them to groups (clusters) based on their similarity Unsupervised Machine Learning Class Discovery Difficult, and maybe ill-posed

More information

Automatic Techniques for Gridding cdna Microarray Images

Automatic Techniques for Gridding cdna Microarray Images Automatic Techniques for Gridding cda Microarray Images aima Kaabouch, Member, IEEE, and Hamid Shahbazkia Department of Electrical Engineering, University of orth Dakota Grand Forks, D 58202-765 2 University

More information

Week 7 Picturing Network. Vahe and Bethany

Week 7 Picturing Network. Vahe and Bethany Week 7 Picturing Network Vahe and Bethany Freeman (2005) - Graphic Techniques for Exploring Social Network Data The two main goals of analyzing social network data are identification of cohesive groups

More information

Scanner Parameter Estimation Using Bilevel Scans of Star Charts

Scanner Parameter Estimation Using Bilevel Scans of Star Charts ICDAR, Seattle WA September Scanner Parameter Estimation Using Bilevel Scans of Star Charts Elisa H. Barney Smith Electrical and Computer Engineering Department Boise State University, Boise, Idaho 8375

More information

Automated Bioinformatics Analysis System on Chip ABASOC. version 1.1

Automated Bioinformatics Analysis System on Chip ABASOC. version 1.1 Automated Bioinformatics Analysis System on Chip ABASOC version 1.1 Phillip Winston Miller, Priyam Patel, Daniel L. Johnson, PhD. University of Tennessee Health Science Center Office of Research Molecular

More information

TIGR MIDAS Version 2.19 TIGR MIDAS. Microarray Data Analysis System. Version 2.19 November Page 1 of 85

TIGR MIDAS Version 2.19 TIGR MIDAS. Microarray Data Analysis System. Version 2.19 November Page 1 of 85 TIGR MIDAS Microarray Data Analysis System Version 2.19 November 2004 Page 1 of 85 Table of Contents 1 General Information...4 1.1 Obtaining MIDAS... 4 1.2 Referencing MIDAS... 4 1.3 A note on non-windows

More information

EECS 730 Introduction to Bioinformatics Microarray. Luke Huan Electrical Engineering and Computer Science

EECS 730 Introduction to Bioinformatics Microarray. Luke Huan Electrical Engineering and Computer Science EECS 730 Introduction to Bioinformatics Microarray Luke Huan Electrical Engineering and Computer Science http://people.eecs.ku.edu/~jhuan/ GeneChip 2011/11/29 EECS 730 2 Hybridization to the Chip 2011/11/29

More information

Guide to Microarray Analysis

Guide to Microarray Analysis Application Note Microarray Analysis Guide to Microarray Analysis Damian Verdnik, Ph.D. Last updated: January 1, 1 Principles 1 Data Types 1 3 Normalization 3 5 Clustering 7 6 Statistical Analysis 13 7

More information

3 Nonlinear Regression

3 Nonlinear Regression CSC 4 / CSC D / CSC C 3 Sometimes linear models are not sufficient to capture the real-world phenomena, and thus nonlinear models are necessary. In regression, all such models will have the same basic

More information

High throughput Data Analysis 2. Cluster Analysis

High throughput Data Analysis 2. Cluster Analysis High throughput Data Analysis 2 Cluster Analysis Overview Why clustering? Hierarchical clustering K means clustering Issues with above two Other methods Quality of clustering results Introduction WHY DO

More information

CLUSTERING IN BIOINFORMATICS

CLUSTERING IN BIOINFORMATICS CLUSTERING IN BIOINFORMATICS CSE/BIMM/BENG 8 MAY 4, 0 OVERVIEW Define the clustering problem Motivation: gene expression and microarrays Types of clustering Clustering algorithms Other applications of

More information

Package st. July 8, 2015

Package st. July 8, 2015 Version 1.2.5 Date 2015-07-08 Package st July 8, 2015 Title Shrinkage t Statistic and Correlation-Adjusted t-score Author Rainer Opgen-Rhein, Verena Zuber, and Korbinian Strimmer. Maintainer Korbinian

More information

2014 Stat-Ease, Inc. All Rights Reserved.

2014 Stat-Ease, Inc. All Rights Reserved. What s New in Design-Expert version 9 Factorial split plots (Two-Level, Multilevel, Optimal) Definitive Screening and Single Factor designs Journal Feature Design layout Graph Columns Design Evaluation

More information

Using Excel for Graphical Analysis of Data

Using Excel for Graphical Analysis of Data Using Excel for Graphical Analysis of Data Introduction In several upcoming labs, a primary goal will be to determine the mathematical relationship between two variable physical parameters. Graphs are

More information

Package stepnorm. R topics documented: April 10, Version Date

Package stepnorm. R topics documented: April 10, Version Date Version 1.38.0 Date 2008-10-08 Package stepnorm April 10, 2015 Title Stepwise normalization functions for cdna microarrays Author Yuanyuan Xiao , Yee Hwa (Jean) Yang

More information

Response to API 1163 and Its Impact on Pipeline Integrity Management

Response to API 1163 and Its Impact on Pipeline Integrity Management ECNDT 2 - Tu.2.7.1 Response to API 3 and Its Impact on Pipeline Integrity Management Munendra S TOMAR, Martin FINGERHUT; RTD Quality Services, USA Abstract. Knowing the accuracy and reliability of ILI

More information

Using Excel for Graphical Analysis of Data

Using Excel for Graphical Analysis of Data EXERCISE Using Excel for Graphical Analysis of Data Introduction In several upcoming experiments, a primary goal will be to determine the mathematical relationship between two variable physical parameters.

More information

Acquisition Description Exploration Examination Understanding what data is collected. Characterizing properties of data.

Acquisition Description Exploration Examination Understanding what data is collected. Characterizing properties of data. Summary Statistics Acquisition Description Exploration Examination what data is collected Characterizing properties of data. Exploring the data distribution(s). Identifying data quality problems. Selecting

More information

Exploratory data analysis for microarrays

Exploratory data analysis for microarrays Exploratory data analysis for microarrays Jörg Rahnenführer Computational Biology and Applied Algorithmics Max Planck Institute for Informatics D-66123 Saarbrücken Germany NGFN - Courses in Practical DNA

More information

Bayesian Analysis of Differential Gene Expression

Bayesian Analysis of Differential Gene Expression Bayesian Analysis of Differential Gene Expression Biostat Journal Club Chuan Zhou chuan.zhou@vanderbilt.edu Department of Biostatistics Vanderbilt University Bayesian Modeling p. 1/1 Lewin et al., 2006

More information

Correction for pixel censoring in cdna microarrays

Correction for pixel censoring in cdna microarrays Correction for pixel censoring in cdna microarrays Chris Glasbey 1 and Mizanur Khondoker 1 1 Biomathematics and Statistics Scotland, King s Buildings, Edinburgh EH9 3JZ, UK Abstract: cdna microarrays are

More information

Locating ego-centers in depth for hippocampal place cells

Locating ego-centers in depth for hippocampal place cells 204 5th Joint Symposium on Neural Computation Proceedings UCSD (1998) Locating ego-centers in depth for hippocampal place cells Kechen Zhang,' Terrence J. Sejeowski112 & Bruce L. ~cnau~hton~ 'Howard Hughes

More information

A short reference to FSPMA definition files

A short reference to FSPMA definition files A short reference to FSPMA definition files P. Sykacek Department of Genetics & Department of Pathology University of Cambridge peter@sykacek.net June 22, 2005 Abstract This report provides a brief reference

More information

User Guide for Tn-seq analysis software (TSAS) by

User Guide for Tn-seq analysis software (TSAS) by User Guide for Tn-seq analysis software (TSAS) by Saheed Imam email: saheedrimam@gmail.com Transposon mutagenesis followed by high-throughput sequencing (Tn-seq) is a robust approach for genome-wide identification

More information

Computational Genomics and Molecular Biology, Fall

Computational Genomics and Molecular Biology, Fall Computational Genomics and Molecular Biology, Fall 2015 1 Sequence Alignment Dannie Durand Pairwise Sequence Alignment The goal of pairwise sequence alignment is to establish a correspondence between the

More information

Developing Effect Sizes for Non-Normal Data in Two-Sample Comparison Studies

Developing Effect Sizes for Non-Normal Data in Two-Sample Comparison Studies Developing Effect Sizes for Non-Normal Data in Two-Sample Comparison Studies with an Application in E-commerce Durham University Apr 13, 2010 Outline 1 Introduction Effect Size, Complementory for Hypothesis

More information

9/29/13. Outline Data mining tasks. Clustering algorithms. Applications of clustering in biology

9/29/13. Outline Data mining tasks. Clustering algorithms. Applications of clustering in biology 9/9/ I9 Introduction to Bioinformatics, Clustering algorithms Yuzhen Ye (yye@indiana.edu) School of Informatics & Computing, IUB Outline Data mining tasks Predictive tasks vs descriptive tasks Example

More information

TECH NOTE Improving the Sensitivity of Ultra Low Input mrna Seq

TECH NOTE Improving the Sensitivity of Ultra Low Input mrna Seq TECH NOTE Improving the Sensitivity of Ultra Low Input mrna Seq SMART Seq v4 Ultra Low Input RNA Kit for Sequencing Powered by SMART and LNA technologies: Locked nucleic acid technology significantly improves

More information

Drug versus Disease (DrugVsDisease) package

Drug versus Disease (DrugVsDisease) package 1 Introduction Drug versus Disease (DrugVsDisease) package The Drug versus Disease (DrugVsDisease) package provides a pipeline for the comparison of drug and disease gene expression profiles where negatively

More information

MS data processing. Filtering and correcting data. W4M Core Team. 22/09/2015 v 1.0.0

MS data processing. Filtering and correcting data. W4M Core Team. 22/09/2015 v 1.0.0 MS data processing Filtering and correcting data W4M Core Team 22/09/2015 v 1.0.0 Presentation map 1) Processing the data W4M table format for Galaxy 2) Filters for mass spectrometry extracted data a)

More information

The analysis of acgh data: Overview

The analysis of acgh data: Overview The analysis of acgh data: Overview JC Marioni, ML Smith, NP Thorne January 13, 2006 Overview i snapcgh (Segmentation, Normalisation and Processing of arraycgh data) is a package for the analysis of array

More information

Your Name: Section: INTRODUCTION TO STATISTICAL REASONING Computer Lab #4 Scatterplots and Regression

Your Name: Section: INTRODUCTION TO STATISTICAL REASONING Computer Lab #4 Scatterplots and Regression Your Name: Section: 36-201 INTRODUCTION TO STATISTICAL REASONING Computer Lab #4 Scatterplots and Regression Objectives: 1. To learn how to interpret scatterplots. Specifically you will investigate, using

More information

Fuzzy C-means with Bi-dimensional Empirical Mode Decomposition for Segmentation of Microarray Image

Fuzzy C-means with Bi-dimensional Empirical Mode Decomposition for Segmentation of Microarray Image www.ijcsi.org 316 Fuzzy C-means with Bi-dimensional Empirical Mode Decomposition for Segmentation of Microarray Image J.Harikiran 1, D.RamaKrishna 2, M.L.Phanendra 3, Dr.P.V.Lakshmi 4, Dr.R.Kiran Kumar

More information

Data processing. Filters and normalisation. Mélanie Pétéra W4M Core Team 31/05/2017 v 1.0.0

Data processing. Filters and normalisation. Mélanie Pétéra W4M Core Team 31/05/2017 v 1.0.0 Data processing Filters and normalisation Mélanie Pétéra W4M Core Team 31/05/2017 v 1.0.0 Presentation map 1) Processing the data W4M table format for Galaxy 2) A generic tool to filter in Galaxy a) Generic

More information

Tutorial: Using Tina Vision s Quantitative Pattern Recognition Tool.

Tutorial: Using Tina Vision s Quantitative Pattern Recognition Tool. Tina Memo No. 2014-004 Internal Report Tutorial: Using Tina Vision s Quantitative Pattern Recognition Tool. P.D.Tar. Last updated 07 / 06 / 2014 ISBE, Medical School, University of Manchester, Stopford

More information

Supplementary Figure 1. Decoding results broken down for different ROIs

Supplementary Figure 1. Decoding results broken down for different ROIs Supplementary Figure 1 Decoding results broken down for different ROIs Decoding results for areas V1, V2, V3, and V1 V3 combined. (a) Decoded and presented orientations are strongly correlated in areas

More information

Classification of Subject Motion for Improved Reconstruction of Dynamic Magnetic Resonance Imaging

Classification of Subject Motion for Improved Reconstruction of Dynamic Magnetic Resonance Imaging 1 CS 9 Final Project Classification of Subject Motion for Improved Reconstruction of Dynamic Magnetic Resonance Imaging Feiyu Chen Department of Electrical Engineering ABSTRACT Subject motion is a significant

More information

Clustering Techniques

Clustering Techniques Clustering Techniques Bioinformatics: Issues and Algorithms CSE 308-408 Fall 2007 Lecture 16 Lopresti Fall 2007 Lecture 16-1 - Administrative notes Your final project / paper proposal is due on Friday,

More information

A Reliable and Distributed LIMS for Efficient Management of the Microarray Experiment Environment

A Reliable and Distributed LIMS for Efficient Management of the Microarray Experiment Environment A Reliable and Distributed LIMS for Efficient Management of the Microarray Experiment Environment Hee-Jeong Jin BK Center for U-Port IT Research Education, Pusan National University, Busan, South Korea,

More information

Package INCATome. October 5, 2017

Package INCATome. October 5, 2017 Type Package Package INCATome October 5, 2017 Title Internal Control Analysis of Translatome Studies by Microarrays Version 1.0 Date 2017-10-03 Author Sbarrato T. [cre,aut], Spriggs R.V. [cre,aut], Wilson

More information

Resampling Methods. Levi Waldron, CUNY School of Public Health. July 13, 2016

Resampling Methods. Levi Waldron, CUNY School of Public Health. July 13, 2016 Resampling Methods Levi Waldron, CUNY School of Public Health July 13, 2016 Outline and introduction Objectives: prediction or inference? Cross-validation Bootstrap Permutation Test Monte Carlo Simulation

More information

1 Principles 1 2 Data Types 1 3 Normalization 3. 5 Clustering 7 6 Statistical Analysis 13 7 Conclusion 16 4 Dataset Filtering and Management 4

1 Principles 1 2 Data Types 1 3 Normalization 3. 5 Clustering 7 6 Statistical Analysis 13 7 Conclusion 16 4 Dataset Filtering and Management 4 » fi fifi Damian Verdnik, Ph.D. Last updated: January 1, 1 Principles 1 Data Types 1 3 Normalization 3 5 Clustering 7 6 Statistical Analysis 13 7 Conclusion 16 Dataset Filtering and Management 1 Principles

More information

CANCER PREDICTION USING PATTERN CLASSIFICATION OF MICROARRAY DATA. By: Sudhir Madhav Rao &Vinod Jayakumar Instructor: Dr.

CANCER PREDICTION USING PATTERN CLASSIFICATION OF MICROARRAY DATA. By: Sudhir Madhav Rao &Vinod Jayakumar Instructor: Dr. CANCER PREDICTION USING PATTERN CLASSIFICATION OF MICROARRAY DATA By: Sudhir Madhav Rao &Vinod Jayakumar Instructor: Dr. Michael Nechyba 1. Abstract The objective of this project is to apply well known

More information

Introduction to Bioinformatics AS Laboratory Assignment 2

Introduction to Bioinformatics AS Laboratory Assignment 2 Introduction to Bioinformatics AS 250.265 Laboratory Assignment 2 Last week, we discussed several high-throughput methods for the analysis of gene expression in cells. Of those methods, microarray technologies

More information

Robotics. Lecture 5: Monte Carlo Localisation. See course website for up to date information.

Robotics. Lecture 5: Monte Carlo Localisation. See course website  for up to date information. Robotics Lecture 5: Monte Carlo Localisation See course website http://www.doc.ic.ac.uk/~ajd/robotics/ for up to date information. Andrew Davison Department of Computing Imperial College London Review:

More information

Affymetrix GeneChip DNA Analysis Software

Affymetrix GeneChip DNA Analysis Software Affymetrix GeneChip DNA Analysis Software User s Guide Version 3.0 For Research Use Only. Not for use in diagnostic procedures. P/N 701454 Rev. 3 Trademarks Affymetrix, GeneChip, EASI,,,, HuSNP, GenFlex,

More information

DI TRANSFORM. The regressive analyses. identify relationships

DI TRANSFORM. The regressive analyses. identify relationships July 2, 2015 DI TRANSFORM MVstats TM Algorithm Overview Summary The DI Transform Multivariate Statistics (MVstats TM ) package includes five algorithm options that operate on most types of geologic, geophysical,

More information

Package LMGene. R topics documented: December 23, Version Date

Package LMGene. R topics documented: December 23, Version Date Version 2.38.0 Date 2013-07-24 Package LMGene December 23, 2018 Title LMGene Software for Data Transformation and Identification of Differentially Expressed Genes in Gene Expression Arrays Author David

More information

Minnesota Academic Standards for Mathematics 2007

Minnesota Academic Standards for Mathematics 2007 An Alignment of Minnesota for Mathematics 2007 to the Pearson Integrated High School Mathematics 2014 to Pearson Integrated High School Mathematics Common Core Table of Contents Chapter 1... 1 Chapter

More information

GPR Analyzer version 1.23 User s Manual

GPR Analyzer version 1.23 User s Manual GPR Analyzer version 1.23 User s Manual GPR Analyzer is a tool to quickly analyze multi- species microarrays, especially designed for use with the MIDTAL (Microarray Detection of Toxic ALgae) chip. It

More information

affyqcreport: A Package to Generate QC Reports for Affymetrix Array Data

affyqcreport: A Package to Generate QC Reports for Affymetrix Array Data affyqcreport: A Package to Generate QC Reports for Affymetrix Array Data Craig Parman and Conrad Halling April 30, 2018 Contents 1 Introduction 1 2 Getting Started 2 3 Figure Details 3 3.1 Report page

More information

3 Nonlinear Regression

3 Nonlinear Regression 3 Linear models are often insufficient to capture the real-world phenomena. That is, the relation between the inputs and the outputs we want to be able to predict are not linear. As a consequence, nonlinear

More information

Correlation Motif Vignette

Correlation Motif Vignette Correlation Motif Vignette Hongkai Ji, Yingying Wei October 30, 2018 1 Introduction The standard algorithms for detecting differential genes from microarray data are mostly designed for analyzing a single

More information

TELCOM2125: Network Science and Analysis

TELCOM2125: Network Science and Analysis School of Information Sciences University of Pittsburgh TELCOM2125: Network Science and Analysis Konstantinos Pelechrinis Spring 2015 2 Part 4: Dividing Networks into Clusters The problem l Graph partitioning

More information

Data Mining Chapter 3: Visualizing and Exploring Data Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University

Data Mining Chapter 3: Visualizing and Exploring Data Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University Data Mining Chapter 3: Visualizing and Exploring Data Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University Exploratory data analysis tasks Examine the data, in search of structures

More information

Machine Learning in Biology

Machine Learning in Biology Università degli studi di Padova Machine Learning in Biology Luca Silvestrin (Dottorando, XXIII ciclo) Supervised learning Contents Class-conditional probability density Linear and quadratic discriminant

More information