Two Examples of Datanomic. David Du Digital Technology Center Intelligent Storage Consortium University of Minnesota
|
|
- Amelia Murphy
- 6 years ago
- Views:
Transcription
1 Two Examples of Datanomic David Du Digital Technology Center Intelligent Storage Consortium University of Minnesota
2 Datanomic Computing (Autonomic Storage) System behavior driven by characteristics of the data and the changing environment Automatic optimization to ever changing data requirements Allocate resources according to increase in demand of the data Transform data formats to support different applications Seamless data access from anywhere at anytime Location and context aware access to data Content-based search Adaptive performance Consistent view of each user s data Independent of platforms, operating systems, and data formats Exploit active object, active and intelligent disk Solve data explosion and provenance issues
3 Three Possible Approaches Semantic Web Web is the key Grid Computing Services offered by middleware Intelligent Storage Devices Reduce layers by adding features to storage devices
4 Two Examples E2E QoS Provisioning for Network- Attached Storage Systems Solutions to Data Provenance Problem
5 Motivation of E2E QoS Provisioning OSD supports diverse applications Different applications require different Performance guarantees: bandwidth, response time, throughput Objects in OSD carries application semantics Objects in OSD has full knowledge of its current storage condition
6 QoS Challenges in Network Attached Storage QoS Requirements from applications Data are accessed from remote storage devices via IP network connections How to ensure QoS delivery within storage devices? How to ensure QoS over networks? How to ensure QoS E2E?
7 Feedback Based QoS Control Use a controller between clients and the storage server (client side vs. ISP) Clients provide performance goals A feedback mechanism in control compares the performance measured and expected The controller throttles the user requests if there is performance goal violation
8 A Feedback Control Perf Goal Requests Diff Controller Adjusted Req rate TCP/IP TCP/IP Network Network Storage Server Computed Performance Measurement
9 Possible Control Along The End User Access Data Path Client Client Client Client ISP ISP 2 2 TCP/IP Network Storage 3 Server
10 Storage QoS Control Motivation Multimedia application requires guaranteed timely delivery Different applications has different QoS requirements Storage access has a lot of variations QoS provisioning QoS aware disk scheduling to guarantee the real-time requirements
11 Storage Brick A Storage Brick Target BW 1 Gigabit Ethernet Gigabit Ethernet Brick Controller CPU Memory Initiator 1 TCP Network BW 2 HBA (SATA) HBA (SATA) Initiator 2 BW n d 1 d 2 d 3 d 4 d 5 d 6 d 7 d 8 Initiator n
12 Challenges in QoS Provisioning in Storage Brick Storage brick often uses striping and replication to improve performance RAID systems make the disk scheduling more difficult and previous algorithm inappropriate Client connections have different network bandwidths iscsi has the upper level flow control
13 Issue 1: Network-Aware Scheduling Goal: exploit the knowledge of underlying network conditions to efficiently schedule object requests Environment: storage brick attached to Internet Assumption: Multiple initiators with different BW access the storage brick through iscsi Each session s BW can be acquired The objects are striped over multiple disks in brick for performance and load-balance purpose
14 Issue 2 QoS-Aware Storage Scheduling Motivations: Different QoS requirements from different applications Different network bandwidth from different sessions Different RAID configurations in the storage brick Objectives Propose a framework to support different app QoS for different sessions
15 Scheduling with Object Replicas Previous scheduling assumes there is only one copy of the requested object Object can have multiple replicas Locate the most favorable replica of an object to be requested Schedule disk access on the favorable object
16 Issue 3: End-End QoS Support Storage QoS support only provides guarantee within the storage devices TCP/IP network is a best-effort network, no hard guarantee is provided TCP/IP network is shared by a variety of users, not just storage access users Feedback control is not practical given the variety of clients and diverse distribution Integration of network QoS and Storage QoS to provide true end-end QoS
17 A List of Related Projects iscsi Performance Study iscsi Simulation Implementation and Study Adaptive iscsi Storage Access QoS for iscsi with OSD Support Implementation and Evaluation of DMAPI- Based Data Backup Prototype Network-Aware Resource Scheduling QoS support for OSD Implementation
18 What is data provenance? Provenance is a relationship between data objects to explain how a particular object has been derived. A workflow of data processes usually explains this relationship Using provenance, a user can trace the workflow that led to the aggregation of processes producing a particular object.
19 EnsEMBL Pipeline (Workflow) Genomic Sequence Data Regular (daily) addition of new data Occasional updates to existing data Download & Import Scripts Primary Data: Contig, Clone, Assembly, dna, Corrections take the form of updates Also, assembly data (partial chromosome locations) Search Targets / Models / Parameter Sets Examples: NCBI NR, PFAM Models Update Scripts Target Sets Preliminary Pipeline Some updates (BLAST targets) are additive Some represent retraining and cannot be easily added to the (new models for HMMs, contig sets from TIGR) Update frequency currently driven by computational limits Features: Dna_align_feature, protein_align_feature External Gene Calls & xrefs Gene Calling Protein Annotations Transcript, Exon, Gene, Xref, Protein Pipeline EnsEMBL Genes: Transcript, Exon, Gene, Xref,
20 GenBank HTG FASTA 1 Nightly download of new phase3 and phase2 (2 ordered pieces at most) HTG sequences University of of Minnesota Mt Mt BAC Registry Young lab MtBR -Linkage group -BAC ordering (to come) Check GenBank Accession and Version numbers against CCGB-DeCIFR contents to avoid duplication. If Acc# already present in CCGB-DeCIFR with earlier version#, drop all analysis results from database tables For the same Acc#, keep only the latest version to perform analysis on. Use MtBR linkage group information to assign BAC display to chromosome Create pipeline analysis queuing job SubmitContig ContigStartState CCGB-DeCIFR analysis pipeline 1. Repeat masker 2. Genscan (Ath smat) 2b 3. Fgenesh (Dicots smat) 4. BLASTX vs PIR-NREF (soon to be replaced by UniProt) 5. BLASTN vs NCBI_dbEST NCBI_nt NCBI Mt cdna NCBI Ath genome NCBI Lj HTGs 3 TIGR latest unigenes o Arabidopsis thaliana o Lotus japonicus Incremental BLAST o Glycine max Target update o Medicago truncatula CCGB unigenes Query update o Medicago truncatula o Peanut o Pseudorobinia accacia (Black locust) CCGB DeCIFR private 2a Upon all analysis completion for a BAC, push that BAC analysis results to production database instance (public) CCGB DeCIFR public
21 Nightly download of genomic sequences thata are to be put into the pipeline 1 2b 2a 3
22 Suggestions for test development for provenance using the CCGB-DeCIFR genome annotation pipeline As the annotation pipeline currently stands, three development points in the pipeline are suggested. The first two are immediately available. The third one will be available in the near future. The third one requires us to write a fair amount of new code, and that particular project needs to be integrated into our development schedule. 1. Provenance of sequences downloaded from NCBI on a nightly basis Every night a cron job is run to check for the NCBI release of new Medicago genome sequences that fit specific criteria. A list of the seq ID ( Acc# and gi) is made and compare with the content of CCGB-DeCIFR database. Sequences that are downloaded are: - New accession ( an fit the specific criteria) - Old accession but new GI [sequence updates] 2. Provenance of gene prediction analysis (result features, parameters used, DAS source(?)) Gene prediction programs may have been trained on different training sets ( different research groups US, EU) Focus on the FGENESH ( trained for dicots)[2a] and Genscan (trained for Arabidopsis)[2b] 3. Provenance for incremental update of target databases for homology searches [ BLAST, HMM]
23 How to solve data provenance in bioinformatics? Workflow of Functional Genomics Data Dependent Relationships Between Data Objects Analysis Tools: take several input data with a set of parameter values to produce a version of output data object Results and generated knowledge are presented as annotations and feedback to the system
24 Generalized Black Box for An Analysis Tool any object (target/db/query..) input /w metadata analysis instance output /w metadata analysis model w/ db (gene calling algorithm/matching algorithm/filters/general db search/user scripts...) all necessary configuration sets e.g. version information includes intermediate data
25 Our Proposed Solution Taking Intelligent Storage Approach to Demonstrate Its Power Provenance Information is part of metadata or attributes associated with data Infinite Number of Versions of A Data Object exist What is the efficient way to store and to maintain these many versions? How does a change to one object affect the others?
Sequence Alignment. GBIO0002 Archana Bhardwaj University of Liege
Sequence Alignment GBIO0002 Archana Bhardwaj University of Liege 1 What is Sequence Alignment? A sequence alignment is a way of arranging the sequences of DNA, RNA, or protein to identify regions of similarity.
More informationIntroduc)on to annota)on with Artemis. Download presenta.on and data
Introduc)on to annota)on with Artemis Download presenta.on and data Annota)on Assign an informa)on to genomic sequences???? Genome annota)on 1. Iden.fying genomic elements by: Predic)on (structural annota.on
More informationAssessing Transcriptome Assembly
Assessing Transcriptome Assembly Matt Johnson July 9, 2015 1 Introduction Now that you have assembled a transcriptome, you are probably wondering about the sequence content. Are the sequences from the
More informationGenome Browsers - The UCSC Genome Browser
Genome Browsers - The UCSC Genome Browser Background The UCSC Genome Browser is a well-curated site that provides users with a view of gene or sequence information in genomic context for a specific species,
More informationHow to use KAIKObase Version 3.1.0
How to use KAIKObase Version 3.1.0 Version3.1.0 29/Nov/2010 http://sgp2010.dna.affrc.go.jp/kaikobase/ Copyright National Institute of Agrobiological Sciences. All rights reserved. Outline 1. System overview
More informationDiscovery Net : A UK e-science Pilot Project for Grid-based Knowledge Discovery Services. Patrick Wendel Imperial College, London
Discovery Net : A UK e-science Pilot Project for Grid-based Knowledge Discovery Services Patrick Wendel Imperial College, London Data Mining and Exploration Middleware for Distributed and Grid Computing,
More informationThe Ensembl API. What is the API? November 7, European Bioinformatics Institute (EBI) Hinxton, Cambridge, UK
The Ensembl API European Bioinformatics Institute (EBI) Hinxton, Cambridge, UK 8 Nov 2006 1/51 What is the API? The Ensembl API (application programming interface) is a framework for applications that
More information2) NCBI BLAST tutorial This is a users guide written by the education department at NCBI.
Web resources -- Tour. page 1 of 8 This is a guided tour. Any homework is separate. In fact, this exercise is used for multiple classes and is publicly available to everyone. The entire tour will take
More informationGenome Browsers Guide
Genome Browsers Guide Take a Class This guide supports the Galter Library class called Genome Browsers. See our Classes schedule for the next available offering. If this class is not on our upcoming schedule,
More informationLecture 5 Advanced BLAST
Introduction to Bioinformatics for Medical Research Gideon Greenspan gdg@cs.technion.ac.il Lecture 5 Advanced BLAST BLAST Recap Sequence Alignment Complexity and indexing BLASTN and BLASTP Basic parameters
More informationCLC Server. End User USER MANUAL
CLC Server End User USER MANUAL Manual for CLC Server 10.0.1 Windows, macos and Linux March 8, 2018 This software is for research purposes only. QIAGEN Aarhus Silkeborgvej 2 Prismet DK-8000 Aarhus C Denmark
More informationQoS support for Intelligent Storage Devices
QoS support for Intelligent Storage Devices Joel Wu Scott Brandt Department of Computer Science University of California Santa Cruz ISW 04 UC Santa Cruz Mixed-Workload Requirement General purpose systems
More informationAnnotating a Genome in PATRIC
Annotating a Genome in PATRIC The following step-by-step workflow is intended to help you learn how to navigate the new PATRIC workspace environment in order to annotate and browse your genome on the PATRIC
More informationBioExtract Server User Manual
BioExtract Server User Manual University of South Dakota About Us The BioExtract Server harnesses the power of online informatics tools for creating and customizing workflows. Users can query online sequence
More informationHow to Run NCBI BLAST on zcluster at GACRC
How to Run NCBI BLAST on zcluster at GACRC BLAST: Basic Local Alignment Search Tool Georgia Advanced Computing Resource Center University of Georgia Suchitra Pakala pakala@uga.edu 1 OVERVIEW What is BLAST?
More informationINTRODUCTION TO BIOINFORMATICS
Molecular Biology-2019 1 INTRODUCTION TO BIOINFORMATICS In this section, we want to provide a simple introduction to using the web site of the National Center for Biotechnology Information NCBI) to obtain
More informationDatabase Searching Using BLAST
Mahidol University Objectives SCMI512 Molecular Sequence Analysis Database Searching Using BLAST Lecture 2B After class, students should be able to: explain the FASTA algorithm for database searching explain
More informationGenome Browser. Background and Strategy
Genome Browser Background and Strategy Contents What is a genome browser? Purpose of a genome browser Examples Structure Extra Features Contents What is a genome browser? Purpose of a genome browser Examples
More informationWilson Leung 01/03/2018 An Introduction to NCBI BLAST. Prerequisites: Detecting and Interpreting Genetic Homology: Lecture Notes on Alignment
An Introduction to NCBI BLAST Prerequisites: Detecting and Interpreting Genetic Homology: Lecture Notes on Alignment Resources: The BLAST web server is available at https://blast.ncbi.nlm.nih.gov/blast.cgi
More informationINTRODUCTION TO BIOINFORMATICS
Molecular Biology-2017 1 INTRODUCTION TO BIOINFORMATICS In this section, we want to provide a simple introduction to using the web site of the National Center for Biotechnology Information NCBI) to obtain
More informationSTORAGE CONSOLIDATION WITH IP STORAGE. David Dale, NetApp
STORAGE CONSOLIDATION WITH IP STORAGE David Dale, NetApp SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA. Member companies and individuals may use this material in
More informationWilson Leung 05/27/2008 A Simple Introduction to NCBI BLAST
A Simple Introduction to NCBI BLAST Prerequisites: Detecting and Interpreting Genetic Homology: Lecture Notes on Alignment Resources: The BLAST web server is available at http://www.ncbi.nih.gov/blast/
More informationCreating and Using Genome Assemblies Tutorial
Creating and Using Genome Assemblies Tutorial Release 8.1 Golden Helix, Inc. March 18, 2014 Contents 1. Create a Genome Assembly for Danio rerio 2 2. Building Annotation Sources 5 A. Creating a Reference
More informationGeneious 5.6 Quickstart Manual. Biomatters Ltd
Geneious 5.6 Quickstart Manual Biomatters Ltd October 15, 2012 2 Introduction This quickstart manual will guide you through the features of Geneious 5.6 s interface and help you orient yourself. You should
More informationMetaPhyler Usage Manual
MetaPhyler Usage Manual Bo Liu boliu@umiacs.umd.edu March 13, 2012 Contents 1 What is MetaPhyler 1 2 Installation 1 3 Quick Start 2 3.1 Taxonomic profiling for metagenomic sequences.............. 2 3.2
More informationSolexaLIMS: A Laboratory Information Management System for the Solexa Sequencing Platform
SolexaLIMS: A Laboratory Information Management System for the Solexa Sequencing Platform Brian D. O Connor, 1, Jordan Mendler, 1, Ben Berman, 2, Stanley F. Nelson 1 1 Department of Human Genetics, David
More informationSTORAGE CONSOLIDATION WITH IP STORAGE. David Dale, NetApp
STORAGE CONSOLIDATION WITH IP STORAGE David Dale, NetApp SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA. Member companies and individuals may use this material in
More informationPreliminary Syllabus. Genomics. Introduction & Genome Assembly Sequence Comparison Gene Modeling Gene Function Identification
Preliminary Syllabus Sep 30 Oct 2 Oct 7 Oct 9 Oct 14 Oct 16 Oct 21 Oct 25 Oct 28 Nov 4 Nov 8 Introduction & Genome Assembly Sequence Comparison Gene Modeling Gene Function Identification OCTOBER BREAK
More informationIntroduction to Genome Browsers
Introduction to Genome Browsers Rolando Garcia-Milian, MLS, AHIP (Rolando.milian@ufl.edu) Department of Biomedical and Health Information Services Health Sciences Center Libraries, University of Florida
More informationBovineMine Documentation
BovineMine Documentation Release 1.0 Deepak Unni, Aditi Tayal, Colin Diesh, Christine Elsik, Darren Hag Oct 06, 2017 Contents 1 Tutorial 3 1.1 Overview.................................................
More informationBioinformatics explained: BLAST. March 8, 2007
Bioinformatics Explained Bioinformatics explained: BLAST March 8, 2007 CLC bio Gustav Wieds Vej 10 8000 Aarhus C Denmark Telephone: +45 70 22 55 09 Fax: +45 70 22 55 19 www.clcbio.com info@clcbio.com Bioinformatics
More informationTutorial 1: Exploring the UCSC Genome Browser
Last updated: May 12, 2011 Tutorial 1: Exploring the UCSC Genome Browser Open the homepage of the UCSC Genome Browser at: http://genome.ucsc.edu/ In the blue bar at the top, click on the Genomes link.
More informationWhen we search a nucleic acid databases, there is no need for you to carry out your own six frame translation. Mascot always performs a 6 frame
1 When we search a nucleic acid databases, there is no need for you to carry out your own six frame translation. Mascot always performs a 6 frame translation on the fly. That is, 3 reading frames from
More informationBLAST Exercise 2: Using mrna and EST Evidence in Annotation Adapted by W. Leung and SCR Elgin from Annotation Using mrna and ESTs by Dr. J.
BLAST Exercise 2: Using mrna and EST Evidence in Annotation Adapted by W. Leung and SCR Elgin from Annotation Using mrna and ESTs by Dr. J. Buhler Prerequisites: BLAST Exercise: Detecting and Interpreting
More informationQuality of Service (QoS) Enabled Dissemination of Managed Information Objects in a Publish-Subscribe-Query
Quality of Service (QoS) Enabled Dissemination of Managed Information Objects in a Publish-Subscribe-Query Information Broker Dr. Joe Loyall BBN Technologies The Boeing Company Florida Institute for Human
More informationFinding and Exporting Data. BioMart
September 2017 Finding and Exporting Data Not sure what tool to use to find and export data? BioMart is used to retrieve data for complex queries, involving a few or many genes or even complete genomes.
More informationFast-track to Gene Annotation and Genome Analysis
Fast-track to Gene Annotation and Genome Analysis Contents Section Page 1.1 Introduction DNA Subway is a bioinformatics workspace that wraps high-level analysis tools in an intuitive and appealing interface.
More informationUsing many concepts related to bioinformatics, an application was created to
Patrick Graves Bioinformatics Thursday, April 26, 2007 1 - ABSTRACT Using many concepts related to bioinformatics, an application was created to visually display EST s. Each EST was displayed in the correct
More informationHEP replica management
Primary actor Goal in context Scope Level Stakeholders and interests Precondition Minimal guarantees Success guarantees Trigger Technology and data variations Priority Releases Response time Frequency
More informationSecuring Grid Data Transfer Services with Active Network Portals
Securing Grid Data Transfer Services with Active Network Portals Onur Demir 1 2 Kanad Ghose 3 Madhusudhan Govindaraju 4 Department of Computer Science Binghamton University (SUNY) {onur 1, mike 2, ghose
More informationMacVector for Mac OS X
MacVector 10.6 for Mac OS X System Requirements MacVector 10.6 runs on any PowerPC or Intel Macintosh running Mac OS X 10.4 or higher. It is a Universal Binary, meaning that it runs natively on both PowerPC
More informationWSSP-10 Chapter 7 BLASTN: DNA vs DNA searches
WSSP-10 Chapter 7 BLASTN: DNA vs DNA searches 4-3 DSAP: BLASTn Page p. 7-1 NCBI BLAST Home Page p. 7-1 NCBI BLASTN search page p. 7-2 Copy sequence from DSAP or wave form program p. 7-2 Choose a database
More informationDNA sequences obtained in section were assembled and edited using DNA
Sequetyper DNA sequences obtained in section 4.4.1.3 were assembled and edited using DNA Baser Sequence Assembler v4 (www.dnabaser.com). The consensus sequences were used to interrogate the GenBank database
More informationCloud Meets Big Data For VMware Environments
Cloud Meets Big Data For VMware Environments
More informationTopics of the talk. Biodatabases. Data types. Some sequence terminology...
Topics of the talk Biodatabases Jarno Tuimala / Eija Korpelainen CSC What data are stored in biological databases? What constitutes a good database? Nucleic acid sequence databases Amino acid sequence
More informationIntegrated Genome browser (IGB) installation
Integrated Genome browser (IGB) installation Navigate to the IGB download page http://bioviz.org/igb/download.html You will see three icons for download: The three icons correspond to different memory
More informationGPFS for Life Sciences at NERSC
GPFS for Life Sciences at NERSC A NERSC & JGI collaborative effort Jason Hick, Rei Lee, Ravi Cheema, and Kjiersten Fagnan GPFS User Group meeting May 20, 2015-1 - Overview of Bioinformatics - 2 - A High-level
More informationNCGAS Makes Robust Transcriptome Assembly Easier with a Readily Usable Workflow Following de novo Assembly Best Practices
NCGAS Makes Robust Transcriptome Assembly Easier with a Readily Usable Workflow Following de novo Assembly Best Practices Sheri Sanders Bioinformatics Analyst NCGAS @ IU ss93@iu.edu Many users new to de
More informationFASTA. Besides that, FASTA package provides SSEARCH, an implementation of the optimal Smith- Waterman algorithm.
FASTA INTRODUCTION Definition (by David J. Lipman and William R. Pearson in 1985) - Compares a sequence of protein to another sequence or database of a protein, or a sequence of DNA to another sequence
More informationNo Tradeoff Low Latency + High Efficiency
No Tradeoff Low Latency + High Efficiency Christos Kozyrakis http://mast.stanford.edu Latency-critical Applications A growing class of online workloads Search, social networking, software-as-service (SaaS),
More informationMin Wang. April, 2003
Development of a co-regulated gene expression analysis tool (CREAT) By Min Wang April, 2003 Project Documentation Description of CREAT CREAT (coordinated regulatory element analysis tool) are developed
More informationMiniproject 1. Part 1 Due: 16 February. The coverage problem. Method. Why it is hard. Data. Task1
Miniproject 1 Part 1 Due: 16 February The coverage problem given an assembled transcriptome (RNA) and a reference genome (DNA) 1. 2. what fraction (in bases) of the transcriptome sequences match to annotated
More informationScientific Workflows
Scientific Workflows Overview More background on workflows Kepler Details Example Scientific Workflows Other Workflow Systems 2 Recap from last time Background: What is a scientific workflow? Goals: automate
More informationInformation Resources in Molecular Biology Marcela Davila-Lopez How many and where
Information Resources in Molecular Biology Marcela Davila-Lopez (marcela.davila@medkem.gu.se) How many and where Data growth DB: What and Why A Database is a shared collection of logically related data,
More informationFederated Array of Bricks Y Saito et al HP Labs. CS 6464 Presented by Avinash Kulkarni
Federated Array of Bricks Y Saito et al HP Labs CS 6464 Presented by Avinash Kulkarni Agenda Motivation Current Approaches FAB Design Protocols, Implementation, Optimizations Evaluation SSDs in enterprise
More informationMacVector for Mac OS X. The online updater for this release is MB in size
MacVector 17.0.3 for Mac OS X The online updater for this release is 143.5 MB in size You must be running MacVector 15.5.4 or later for this updater to work! System Requirements MacVector 17.0 is supported
More informationIdentifying and Eliminating Backup System Bottlenecks: Taking Your Existing Backup System to the Next Level
Identifying and Eliminating Backup System Bottlenecks: Taking Your Existing Backup System to the Next Level Jacob Farmer, CTO Cambridge Computer SNIA Legal Notice The material contained in this tutorial
More informationAn Introduction to Taverna Workflows Katy Wolstencroft University of Manchester
An Introduction to Taverna Workflows Katy Wolstencroft University of Manchester Download Taverna from http://taverna.sourceforge.net Windows or linux If you are using either a modern version of Windows
More informationSolid State Storage Technologies. Jin-Soo Kim Computer Systems Laboratory Sungkyunkwan University
Solid State Storage Technologies Jin-Soo Kim (jinsookim@skku.edu) Computer Systems Laboratory Sungkyunkwan University http://csl.skku.edu NVMe (1) The industry standard interface for high-performance NVM
More informationiscsi Technology Brief Storage Area Network using Gbit Ethernet The iscsi Standard
iscsi Technology Brief Storage Area Network using Gbit Ethernet The iscsi Standard On February 11 th 2003, the Internet Engineering Task Force (IETF) ratified the iscsi standard. The IETF was made up of
More informationNGS Data Analysis. Roberto Preste
NGS Data Analysis Roberto Preste 1 Useful info http://bit.ly/2r1y2dr Contacts: roberto.preste@gmail.com Slides: http://bit.ly/ngs-data 2 NGS data analysis Overview 3 NGS Data Analysis: the basic idea http://bit.ly/2r1y2dr
More informationSecuring Grid Data Transfer Services with Active Network Portals
Securing with Active Network Portals Onur Demir 1 2 Kanad Ghose 3 Madhusudhan Govindaraju 4 Department of Computer Science Binghamton University (SUNY) {onur 1, mike 2, ghose 3, mgovinda 4 }@cs.binghamton.edu
More informationTutorial 4 BLAST Searching the CHO Genome
Tutorial 4 BLAST Searching the CHO Genome Accessing the CHO Genome BLAST Tool The CHO BLAST server can be accessed by clicking on the BLAST button on the home page or by selecting BLAST from the menu bar
More informationIntroduction to Grid Computing
Milestone 2 Include the names of the papers You only have a page be selective about what you include Be specific; summarize the authors contributions, not just what the paper is about. You might be able
More informationSun N1: Storage Virtualization and Oracle
OracleWorld 2003 Session 36707 - Sun N1: Storage Virtualization and Oracle Glenn Colaco Performance Engineer Sun Microsystems Performance and Availability Engineering September 9, 2003 Background PAE works
More informationSequence Alignment: BLAST
E S S E N T I A L S O F N E X T G E N E R A T I O N S E Q U E N C I N G W O R K S H O P 2015 U N I V E R S I T Y O F K E N T U C K Y A G T C Class 6 Sequence Alignment: BLAST Be able to install and use
More informationHymenopteraMine Documentation
HymenopteraMine Documentation Release 1.0 Aditi Tayal, Deepak Unni, Colin Diesh, Chris Elsik, Darren Hagen Apr 06, 2017 Contents 1 Welcome to HymenopteraMine 3 1.1 Overview of HymenopteraMine.....................................
More informationPublic Repositories Tutorial: Bulk Downloads
Public Repositories Tutorial: Bulk Downloads Almost all of the public databases, genome browsers, and other tools you have explored so far offer some form of access to rapidly download all or large chunks
More informationThe Design and Implementation of AQuA: An Adaptive Quality of Service Aware Object-Based Storage Device
The Design and Implementation of AQuA: An Adaptive Quality of Service Aware Object-Based Storage Device Joel Wu and Scott Brandt Department of Computer Science University of California Santa Cruz MSST2006
More informationUser Guide for DNAFORM Clone Search Engine
User Guide for DNAFORM Clone Search Engine Document Version: 3.0 Dated from: 1 October 2010 The document is the property of K.K. DNAFORM and may not be disclosed, distributed, or replicated without the
More informationProteome Comparison: A fine-grained tool for comparative genomics
Proteome Comparison: A fine-grained tool for comparative genomics In addition to the Protein Family Sorter that allows researchers to examine up to the protein families from up to 500 genomes at a time,
More informationCAP BIOINFORMATICS Su-Shing Chen CISE. 8/19/2005 Su-Shing Chen, CISE 1
CAP 5510-2 BIOINFORMATICS Su-Shing Chen CISE 8/19/2005 Su-Shing Chen, CISE 1 Building Local Genomic Databases Genomic research integrates sequence data with gene function knowledge. Gene ontology to represent
More informationDatabase Services at CERN with Oracle 10g RAC and ASM on Commodity HW
Database Services at CERN with Oracle 10g RAC and ASM on Commodity HW UKOUG RAC SIG Meeting London, October 24 th, 2006 Luca Canali, CERN IT CH-1211 LCGenève 23 Outline Oracle at CERN Architecture of CERN
More informationExon Probeset Annotations and Transcript Cluster Groupings
Exon Probeset Annotations and Transcript Cluster Groupings I. Introduction This whitepaper covers the procedure used to group and annotate probesets. Appropriate grouping of probesets into transcript clusters
More informationvisualize and recover Grapegen Affymetrix Genechip Probeset Initial page: Optimized for Mozilla Firefox 3 (recommended browser)
GrapeGenDB is an application to visualize and recover Grapegen Affymetrix Genechip Probeset annotations. Initial page: http://bioinfogp.cnb.csic.es/tools/grapegendb/ Optimized for Mozilla Firefox 3 (recommended
More informationNetApp Clustered Data ONTAP 8.2 Storage QoS Date: June 2013 Author: Tony Palmer, Senior Lab Analyst
ESG Lab Spotlight NetApp Clustered Data ONTAP 8.2 Storage QoS Date: June 2013 Author: Tony Palmer, Senior Lab Analyst Abstract: This ESG Lab Spotlight explores how NetApp Data ONTAP 8.2 Storage QoS can
More informationExercise 2: Browser-Based Annotation and RNA-Seq Data
Exercise 2: Browser-Based Annotation and RNA-Seq Data Jeremy Buhler July 24, 2018 This exercise continues your introduction to practical issues in comparative annotation. You ll be annotating genomic sequence
More informationTBtools, a Toolkit for Biologists integrating various HTS-data
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 TBtools, a Toolkit for Biologists integrating various HTS-data handling tools with a user-friendly interface Chengjie Chen 1,2,3*, Rui Xia 1,2,3, Hao Chen 4, Yehua
More informationSarah Cohen-Boulakia. Université Paris Sud, LRI CNRS UMR
Sarah Cohen-Boulakia Université Paris Sud, LRI CNRS UMR 8623 cohen@lri.fr 01 69 15 32 16 https://www.lri.fr/~cohen/bigdata/biodata-ami2b.html Understanding Life Sciences Progress in multiple domains: biology,
More informationSummary. Introduction. Susan M. Dombrowski and Donna Maglott
20. Susan M. Dombrowski and Donna Maglott Created: October 9, 2002 Updated: August 13, 2003 Summary There are many different approaches to starting a genomic analysis. These include literature searching,
More informationIntroduction. Application Performance in the QLinux Multimedia Operating System. Solution: QLinux. Introduction. Outline. QLinux Design Principles
Application Performance in the QLinux Multimedia Operating System Sundaram, A. Chandra, P. Goyal, P. Shenoy, J. Sahni and H. Vin Umass Amherst, U of Texas Austin ACM Multimedia, 2000 Introduction General
More informationEBI services. Jennifer McDowall EMBL-EBI
EBI services Jennifer McDowall EMBL-EBI The SLING project is funded by the European Commission within Research Infrastructures of the FP7 Capacities Specific Programme, grant agreement number 226073 (Integrating
More informationCategorized software tools: (this page is being updated and links will be restored ASAP. Click on one of the menu links for more information)
Categorized software tools: (this page is being updated and links will be restored ASAP. Click on one of the menu links for more information) 1 / 5 For array design, fabrication and maintaining a database
More informationArcGIS Server Architecture Considerations. Andrew Sakowicz
ArcGIS Server Architecture Considerations Andrew Sakowicz Introduction Andrew Sakowicz - Esri Professional Services - asakowicz@esri.com 2 Audience Audience - System Architects - Project Managers - Developers
More informationWelcome to the MSI Cargill Computer Lab. Center for Mass Spectrometry and Proteomics Phone (612) (612)
Welcome to the MSI Cargill Computer Lab CMSP and MSI collaboration. TINT (https://tint.msi.umn.edu) Proteomics Software. Data storage. Galaxy-P (https://galaxyp.msi.umn.edu) GALAXY PLATFORM Benefits of
More informationBLAST, Profile, and PSI-BLAST
BLAST, Profile, and PSI-BLAST Jianlin Cheng, PhD School of Electrical Engineering and Computer Science University of Central Florida 26 Free for academic use Copyright @ Jianlin Cheng & original sources
More informationRNA-seq. Manpreet S. Katari
RNA-seq Manpreet S. Katari Evolution of Sequence Technology Normalizing the Data RPKM (Reads per Kilobase of exons per million reads) Score = R NT R = # of unique reads for the gene N = Size of the gene
More informationTRAPPIST: A toolkit for comparative analysis and visualization of genomic regions
TRAPPIST: A toolkit for comparative analysis and visualization of genomic regions Geraldine A. Van der Auwera, PhD https://github.com/gglobster/trappist " TRAPPIST: A toolkit for comparative analysis and
More informationSimilarity Searches on Sequence Databases
Similarity Searches on Sequence Databases Lorenza Bordoli Swiss Institute of Bioinformatics EMBnet Course, Zürich, October 2004 Swiss Institute of Bioinformatics Swiss EMBnet node Outline Importance of
More informationExamining De Novo Transcriptome Assemblies via a Quality Assessment Pipeline
Examining De Novo Transcriptome Assemblies via a Quality Assessment Pipeline Noushin Ghaffari, Osama A. Arshad, Hyundoo Jeong, John Thiltges, Michael F. Criscitiello, Byung-Jun Yoon, Aniruddha Datta, Charles
More informationPairwise Sequence Alignment. Zhongming Zhao, PhD
Pairwise Sequence Alignment Zhongming Zhao, PhD Email: zhongming.zhao@vanderbilt.edu http://bioinfo.mc.vanderbilt.edu/ Sequence Similarity match mismatch A T T A C G C G T A C C A T A T T A T G C G A T
More informationSolid State Storage Technologies. Jin-Soo Kim Computer Systems Laboratory Sungkyunkwan University
Solid State Storage Technologies Jin-Soo Kim (jinsookim@skku.edu) Computer Systems Laboratory Sungkyunkwan University http://csl.skku.edu NVMe (1) NVM Express (NVMe) For accessing PCIe-based SSDs Bypass
More informationDeploying Software Defined Storage for the Enterprise with Ceph. PRESENTATION TITLE GOES HERE Paul von Stamwitz Fujitsu
Deploying Software Defined Storage for the Enterprise with Ceph PRESENTATION TITLE GOES HERE Paul von Stamwitz Fujitsu Agenda Yet another attempt to define SDS Quick Overview of Ceph from a SDS perspective
More informationaccess addresses/addressing advantages agents allocation analysis
INDEX A access control of multipath port fanout, LUN issues, 122 of SAN devices, 154 virtualization server reliance on, 173 DAS characteristics (table), 19 conversion to SAN fabric storage access, 105
More informationRapid Deployment of VS Workflows. Meta Scheduling Service
Rapid Deployment of VS Workflows on PHOSPHORUS using Meta Scheduling Service M. Shahid, Bjoern Hagemeier Fraunhofer Institute SCAI, Research Center Juelich. (TNC 2009) Outline Introduction and Motivation
More informationPath-based systems to guide scientists in the maze of biological data sources
University of Pennsylvania ScholarlyCommons Departmental Papers (CIS) Department of Computer & Information Science August 2006 Path-based systems to guide scientists in the maze of biological data sources
More informationEMC Virtual Infrastructure for Microsoft Exchange 2010 Enabled by EMC Symmetrix VMAX, VMware vsphere 4, and Replication Manager
EMC Virtual Infrastructure for Microsoft Exchange 2010 Enabled by EMC Symmetrix VMAX, VMware vsphere 4, and Replication Manager Reference Architecture Copyright 2010 EMC Corporation. All rights reserved.
More informationQuality of Service in US Air Force Information Management Systems
Quality of Service in US Air Force Information Management Systems Co-hosted by: Dr. Joseph P. Loyall BBN Technologies Sponsored by: 12/11/2009 Material Approved for Public Release. Quality of Service is
More informationBrowser Exercises - I. Alignments and Comparative genomics
Browser Exercises - I Alignments and Comparative genomics 1. Navigating to the Genome Browser (GBrowse) Note: For this exercise use http://www.tritrypdb.org a. Navigate to the Genome Browser (GBrowse)
More informationAs of August 15, 2008, GenBank contained bases from reported sequences. The search procedure should be
48 Bioinformatics I, WS 09-10, S. Henz (script by D. Huson) November 26, 2009 4 BLAST and BLAT Outline of the chapter: 1. Heuristics for the pairwise local alignment of two sequences 2. BLAST: search and
More information