I/O, 2002 Journal of Software. Vol.13, No /2002/13(08)

Size: px
Start display at page:

Download "I/O, 2002 Journal of Software. Vol.13, No /2002/13(08)"

Transcription

1 1-9825/22/13(8) Journal of Software Vol13, No8 I/O, (,184) :, I/O,,, : ; I/O ; ; ; - : TP311 : A,, [1], 1 12 (Terabyte), [2],,,, I/O, [3,4] [5~8],,,, I/O, -, - Exabyte22, : ; : : 973 (G ) : (1969 ),,,,, ; (1947 ),,,,,Web

2 : I/O , I/O ( ):(1) ( zone, zone );(2), ;(3), ;(4), ;(5), ;(6), 1 ;(7), 1 :,,,,,,, Request arrival Input wait queue Drive-1 Drive-2 Drive-n Tape rewind+ drive unload (tape) Robot arm wait queue Robot arm Unload old tape+ load new tape,,, + ( ), +, ( )+ + Fig1 The system model of tape library 1 Drive Drive load (tape)+ seek+transfer data 1, I/O :, I/O, I/O :(1) ;(2) ;(3) 12, 11 11, Exabyte 22 Eliant 82 EXABTYE 8mm, 1 EXABTYE 8mm [5]

3 1614 Journal of Software 22,13(8) Table 1 Measurement of tape library Exabyte 22 1 Exabyte 22 Tape (2) Capacity 7GB(uncompressed ) Tape drive (2) Data transfer rate Mean drive load time Mean drive eject time Rewind startup time Rewind rate Seek startup time Seek rate 92MB/sec (uncompressed) 25s 23s 7s 22MB/s 85s 32MB/s (uncompressed) Tape robot (1) Mean tape unload time 72s Mean tape load time 742s,,,,,,,,, 2, [5~8] - 21 : (1),, ; (2) ( DTL, [3] ) ; (3), (round robin), (MB) ( ) [5], 22 ( ),,,,, ( ), ( ), :,, ;,,

4 : I/O ( ) 2%,,,, :(1), ;, (2) (1), (3),, (1), (2),, 24 -,, ( ),, -, -, ;, - ( ): St Tt Et = Wbw + Wwt (1) S T avg E t t, E t S t t,t t t S avg,t avg,, W bw,w wt, Wwt R w/b ( R w / b = ), ( ), W bw ( ) - -,, - ( ) 3 :(1) COMPAQ -45,Linux ;(2) 11 ;(3), ;(4) 2, 3 :, a/b, a% b%, a>b, b% 3 64M, 7/1, 31 2(a)~(c) ( ) 4 avg

5 1616 Journal of Software 22,13(8),, Static Dynamic Relication-Based Replication-Based-Dynamic ( ), / ( ) ( ( ) ( ) (a) Performance comparison of several scheduling algorithms (light workload) (a) ( ) 45 Static 4 Dynmic 35 Relication-Based 3 Replication-Based-Dynamic ( ), / ( ) ( ( ) ( ) (b) Performance comparison of several scheduling algorithms (moderate workload) (b) ( ) Static Dynmic Relication-Based Replication-Based-Dynamic ( ), / ( ) ( ( ) ( ) (c) Performance comparison of several scheduling algorithms (heavy workload) (c) ( ) Fig2 2 2(a)~(c),,4 (

6 : I/O 1617 <5), (5 <16),, ( 16),, -, -, 3 - ( 2 ), -, - (>15),,, -, Max-Effective-bandwidth-Base d Benefit-Cost-Based scheduling ( ), / Fig3 Benefit-Cost-Based scheduling 3-2(a)~(c), 4,, 4 ( <5),, ;,, ( 25),,, ( 9% ),,, 5( 1) ( 1~1 1/1~1/1),,,,, 4

7 1618 Journal of Software 22,13(8) Improvement ratio (%) Fig Improvement ratio (%) Request skew rate, /, Impact of workload upon dynamic scheduling Fig5 Impact of request skew upon dynamic scheduling (a)~(c),,,,,,,,,, 6( 1) 6,,, 6,,,,, 7 16M 64M Improvement ratio of response time (%) Request skew rate On the head of type In the middle of type In the tail of tape Improvement ratio of response time (%) Request size 16M Request size 64M,, ( ),,, /, 16M, 64M Fig6 Impact of replacement polices of hot Fig7 Impact of request size upon data upon replication-based scheduling replication-based scheduling ,, 2

8 : I/O , >15, Mean response time (s) R w/b, ,, R w/b, 628, , Weight ratio of wait time and effective bandwidth 8( 2, 64M) Fig8 Impact of weight ratio upon benefit- 8, cost-based scheduling 8-4, 9 2 6, 3 1,, experimental 2-simulation 6-experimental 6-simulation Workload(MB/minue): arrival rate*request size ( ), (MB/ ): *, 2-, 2-, 6-, 6- Fig9 Result comparison of simulation and experiment 9 5,,, -,

9 162 Journal of Software 22,13(8) References: [1] Cariño, F, Kaufmann, A, Kostamaa, P Are you ready for Yottabytes? In: Kobler, B, ed Proceedings of the 17th IEEE Symposium on Mass Storage Systems in Cooperation with the 8th NASA GSFC Conference on Mass Storage Systems and Technologies Maryland: IEEE Computer Society Press, 2 476~485 [2] Cariño, F, Burgess, J, O Connell, W, et al Active storage hierarchy, database systems and applications socratic exegesis In: Malcolm, PA, Maria, EO, et al, eds Proceedings of the 25th International Conference on Very Large Data Bases Edinburgh: Morgan Kaufmann Publishers Inc, ~614 [3] Hillyer, BK, Silberschatz, A Random I/O scheduling in online tertiary storage Systems In: Jagadish, HV, Mumick, IS, eds Proceeding of the 1996 ACM SIGMOD International Conference on Management of Data Quebec: ACM Press, ~24 [4] Hillyer, BK, Silberschatz, A Scheduling non-contiguous tape retrievals In: Kobler, B, ed Proceedings of the 15th IEEE Symposium on Mass Storage Systems in Cooperation with the 6th NASA GSFC Conference on Mass Storage Systems and Technologies Maryland: IEEE Computer Society Press, ~124 [5] Hillyer, BK, Rastogi, R, Silberschatz, A Scheduling and data replication to improve tape jukebox performance In: Papazoglou, M, Pu, C, Kitsuregawa, M, eds Proceeding of the 15th International Conference on Data Engineering Sydney: IEEE Computer Society Press, ~541 [6] Nemoto, T, Kitsuegawa, M Scalable tape archiver for satellite image database and its performance analysis with access logs hot declustering and hot replication In: Miller, E, ed Proceedings of the 16th IEEE Symposium on Mass Storage Systems in Cooperation with the 7th NASA GSFC Conference on Mass Storage Systems and Technologies San Diego: IEEE Computer Society Press, ~71 [7] Triantafillou, P, Georgiadis, I Hierarchical scheduling algorithms for near-line tape libraries In: Cammelli, A, Wagner, RR, eds Proceedings of the 1th International Conference and Workshop on Database and Expert Systems Applications Florence: IEEE Computer Society Press, ~54 [8] Prabhakar, S, Dvyakant, A, Amr, El A, et al Scheduling tertiary I/O in database applications In: Roland, W, ed Proceedings of the 8th International Workshop on Database and Expert Systems Applications Toulouse: IEEE Computer Society Press, ~727 Random I/O Scheduling Algorithms in Online Tape Library Systems SHI Jing, ZHOU Li-zhu (Department of Computer Science and Technology, Tsinghua University, Beijing 184, China) {shijing,dcszlz}@mailstsinghuaeducn Abstract: Since the tape libraries have very poor random access performance, it is critical to study random I/O scheduling strategies and algorithms in order to improve the performance of tape library In this paper, the existing scheduling algorithms are summarized first, and then the analytical results of the effectiveness of static scheduling, dynamic scheduling and replication-based scheduling are presented through simulations In particular, a benefit-cost-based scheduling algorithm is given, which aims to improve the effectiveness of existing scheduling algorithms under heavy workloads by tuning the weight ratio of cost and benefit of scheduling policies according to workloads This algorithm is significantly effective under heavy workloads The research of this paper forms the basis of the design of adaptive scheduling algorithms that can be used in massive storage systems Key words: tape library system; random I/O scheduling algorithm; static scheduling; dynamic scheduling; replication-based scheduling; benefit-cost-based scheduling Received February 26, 21; accepted June 13, 21 Supported by the National Grand Fundamental Research 973 Program of China under Grant NoG

Tertiary Storage Organization for Large Multidimensional Datasets

Tertiary Storage Organization for Large Multidimensional Datasets Tertiary Storage Organization for Large Multidimensional Datasets Sachin More, Alok Choudhary Department of Electrical and Computer Engineering Northwestern University Evanston, IL 60028 fssmore,choudharg@ece.nwu.edu

More information

A Flexible Real-time Hierarchical Multimedia Archive

A Flexible Real-time Hierarchical Multimedia Archive A Flexible Real-time Hierarchical Multimedia Archive Maria Eva Lijding, Pierre Jansen, and Sape Mullender Fac. of Computer Science, University of Twente P.O.Box 217, 7500AE Enschede, The Netherlands lijding@cs.utwente.nl

More information

Data Placement for Tertiary Storage

Data Placement for Tertiary Storage Data Placement for Tertiary Storage Jiangtao Li Department of Computer Sciences Purdue University West Lafayette, IN 47907 U.S.A. jtli@cs.purdue.edu Phone: + 1 765 494-6008 Fax: + 1 765 494-0739 Sunil

More information

Benchmarking Tape System Performance

Benchmarking Tape System Performance Benchmarking Tape System Performance Theodore Johnson AT\&T Labs - Research 18 Park Ave., Bldg. 13 Florham Park, NJ 7932 +1 973 36-8779, fax +1 973 36-85 johnsont@research.att.com Ethan L. Miller Computer

More information

Are you ready for Yottabytes?

Are you ready for Yottabytes? Are you ready for Yottabytes? StorHouse Federated and Object/Relational Solution Felipe Cariño Jr. Art Kaufmann Pekka Kostamaa FileTek, Inc 360 N. Sepulveda Blvd. Suite 1080 El Segundo, California 90245

More information

Video 2. Video 1. Video 3. Audio 2. Time

Video 2. Video 1. Video 3. Audio 2. Time Minimizing Latency and Jitter for Large-Scale Multimedia Repositories through Prefix Caching SUNIL PRABHAKAR Department of Computer Sciences Purdue University West Lafayette, IN 47907 U.S.A. sunil@cs.purdue.edu

More information

1 PERFORMANCE ANALYSIS OF SUPERCOMPUTING ENVIRONMENTS. Department of Computer Science, University of Illinois at Urbana-Champaign

1 PERFORMANCE ANALYSIS OF SUPERCOMPUTING ENVIRONMENTS. Department of Computer Science, University of Illinois at Urbana-Champaign 1 PERFORMANCE ANALYSIS OF TAPE LIBRARIES FOR SUPERCOMPUTING ENVIRONMENTS Ilker Hamzaoglu and Huseyin Simitci Department of Computer Science, University of Illinois at Urbana-Champaign {hamza, simitci}@cs.uiuc.edu

More information

Random I/O Performance of a Tandberg MLR1 Tape Drive

Random I/O Performance of a Tandberg MLR1 Tape Drive Random I/O Performance of a Tandberg MLR1 Tape Drive Roger Midtstraum and Olav Sandstå 1 Department of Computer and Information Science Norwegian University of Science and Technology Abstract This paper

More information

Chapter 12: Mass-Storage Systems. Operating System Concepts 8 th Edition,

Chapter 12: Mass-Storage Systems. Operating System Concepts 8 th Edition, Chapter 12: Mass-Storage Systems, Silberschatz, Galvin and Gagne 2009 Chapter 12: Mass-Storage Systems Overview of Mass Storage Structure Disk Structure Disk Attachment Disk Scheduling Disk Management

More information

Predicting the response time of a new task on a Beowulf cluster

Predicting the response time of a new task on a Beowulf cluster Predicting the response time of a new task on a Beowulf cluster Marta Beltrán and Jose L. Bosque ESCET, Universidad Rey Juan Carlos, 28933 Madrid, Spain, mbeltran@escet.urjc.es,jbosque@escet.urjc.es Abstract.

More information

Distributed File Systems Part IV. Hierarchical Mass Storage Systems

Distributed File Systems Part IV. Hierarchical Mass Storage Systems Distributed File Systems Part IV Daniel A. Menascé Hierarchical Mass Storage Systems On-line data requirements Mass Storage Systems Concepts Mass storage system architectures Example systems Performance

More information

Volume 3, Issue 9, September 2013 International Journal of Advanced Research in Computer Science and Software Engineering

Volume 3, Issue 9, September 2013 International Journal of Advanced Research in Computer Science and Software Engineering Volume 3, Issue 9, September 2013 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Optimal Round

More information

Replication in Mirrored Disk Systems

Replication in Mirrored Disk Systems Replication in Mirrored Disk Systems Athena Vakali and Yannis Manolopoulos Department of Informatics, Aristotle University 54006 Thessaloniki, Greece {avakali,manolopo}@athena.auth.gr Abstract. In this

More information

Silberschatz, et al. Topics based on Chapter 13

Silberschatz, et al. Topics based on Chapter 13 Silberschatz, et al. Topics based on Chapter 13 Mass Storage Structure CPSC 410--Richard Furuta 3/23/00 1 Mass Storage Topics Secondary storage structure Disk Structure Disk Scheduling Disk Management

More information

Implementing and Evaluating Jukebox Schedulers Using JukeTools

Implementing and Evaluating Jukebox Schedulers Using JukeTools Implementing and Evaluating Schedulers Using JukeTools Maria Eva Lijding Sape Mullender Pierre Jansen Fac. of Computer Science, University of Twente P.O.Box 217, 7500AE Enschede, The Netherlands E-mail:

More information

Multimedia Storage Servers

Multimedia Storage Servers Multimedia Storage Servers Cyrus Shahabi shahabi@usc.edu Computer Science Department University of Southern California Los Angeles CA, 90089-0781 http://infolab.usc.edu 1 OUTLINE Introduction Continuous

More information

Access Time Modeling of a MLR1 Tape Drive

Access Time Modeling of a MLR1 Tape Drive Access Time Modeling of a MLR1 Tape Drive Olav Sandstå, Thomas Maukon Andersen, Roger Midtstraum, and Rune Sætre Department of Computer and Information Science Norwegian University of Science and Technology

More information

Chapter 14: Mass-Storage Systems

Chapter 14: Mass-Storage Systems Chapter 14: Mass-Storage Systems Disk Structure Disk Scheduling Disk Management Swap-Space Management RAID Structure Disk Attachment Stable-Storage Implementation Tertiary Storage Devices Operating System

More information

Today: Secondary Storage! Typical Disk Parameters!

Today: Secondary Storage! Typical Disk Parameters! Today: Secondary Storage! To read or write a disk block: Seek: (latency) position head over a track/cylinder. The seek time depends on how fast the hardware moves the arm. Rotational delay: (latency) time

More information

2002 Journal of Software.. (stacking).

2002 Journal of Software.. (stacking). 1000-9825/2002/13(02)0245-05 2002 Journal of Software Vol13, No2,,, (,200433) E-mail: {wyji,ayzhou,zhangl}@fudaneducn http://wwwcsfudaneducn : (GA) (stacking), 2,,, : ; ; ; ; : TP18 :A, [1],,, :,, :,,,,

More information

Tape pictures. CSE 30341: Operating Systems Principles

Tape pictures. CSE 30341: Operating Systems Principles Tape pictures 4/11/07 CSE 30341: Operating Systems Principles page 1 Tape Drives The basic operations for a tape drive differ from those of a disk drive. locate positions the tape to a specific logical

More information

IMPLEMENTATION OF CONGESTION CONTROL MECHANISMS USING OPNET

IMPLEMENTATION OF CONGESTION CONTROL MECHANISMS USING OPNET Nazy Alborz IMPLEMENTATION OF CONGESTION CONTROL MECHANISMS USING OPNET TM Communication Networks Laboratory School of Engineering Science Simon Fraser University Road map Introduction to congestion control

More information

Nowadays data-intensive applications play a

Nowadays data-intensive applications play a Journal of Advances in Computer Engineering and Technology, 3(2) 2017 Data Replication-Based Scheduling in Cloud Computing Environment Bahareh Rahmati 1, Amir Masoud Rahmani 2 Received (2016-02-02) Accepted

More information

Scheduling Queries for Tape-Resident Data

Scheduling Queries for Tape-Resident Data Scheduling Queries for Tape-Resident Data Sachin More and Alok Choudhary Department of Electrical and Computer Engineering Northwestern University Abstract. Tertiary storage systems are used when secondary

More information

Module 13: Secondary-Storage

Module 13: Secondary-Storage Module 13: Secondary-Storage Disk Structure Disk Scheduling Disk Management Swap-Space Management Disk Reliability Stable-Storage Implementation Tertiary Storage Devices Operating System Issues Performance

More information

Datasets Size: Effect on Clustering Results

Datasets Size: Effect on Clustering Results 1 Datasets Size: Effect on Clustering Results Adeleke Ajiboye 1, Ruzaini Abdullah Arshah 2, Hongwu Qin 3 Faculty of Computer Systems and Software Engineering Universiti Malaysia Pahang 1 {ajibraheem@live.com}

More information

A New Approach to Network Servers: Bridging the Gap Between Tape and Disk

A New Approach to Network Servers: Bridging the Gap Between Tape and Disk A New Approach to Network Servers: Bridging the Gap Between Tape and Disk by Timothy R. Bratton VP, Licensing and Business Development MultiDisc Technologies, Inc. 101 First Street, Suite 549, Los Altos,

More information

Taccumulation of the social network data has raised

Taccumulation of the social network data has raised International Journal of Advanced Research in Social Sciences, Environmental Studies & Technology Hard Print: 2536-6505 Online: 2536-6513 September, 2016 Vol. 2, No. 1 Review Social Network Analysis and

More information

Transport, Network, and Data-Link Layer Protocol Design Specifications that improve Near-Earth Data Communication Performance.

Transport, Network, and Data-Link Layer Protocol Design Specifications that improve Near-Earth Data Communication Performance. Transport, Network, and Data-Link Layer Protocol Design Specifications that improve Near-Earth Data Communication Performance Paul D. Wiedemeier Computer Science Department University of Missouri Columbia

More information

TCP Nicer: Support for Hierarchical Background Transfers

TCP Nicer: Support for Hierarchical Background Transfers TCP Nicer: Support for Hierarchical Background Transfers Neil Alldrin and Alvin AuYoung Department of Computer Science University of California at San Diego La Jolla, CA 9237 Email: nalldrin, alvina @cs.ucsd.edu

More information

Jun Li, Ph.D. School of Computing and Information Sciences Phone:

Jun Li, Ph.D. School of Computing and Information Sciences Phone: Jun Li, Ph.D. School of Computing and Information Sciences Phone: + 1-305-348-4964 Florida International University Email: junli @ cs. fiu. edu 11200 SW 8th St, ECS 380, Miami, FL 33199 Web: http://users.cs.fiu.edu/

More information

A Hybrid Scheme for Object Allocation in a Distributed Object-Storage System

A Hybrid Scheme for Object Allocation in a Distributed Object-Storage System A Hybrid Scheme for Object Allocation in a Distributed Object-Storage System Fang Wang **, Shunda Zhang, Dan Feng, Hong Jiang, Lingfang Zeng, and Song Lv Key Laboratory of Data Storage System, Ministry

More information

A Highly Efficient FC-SAN Based on Load Stream

A Highly Efficient FC-SAN Based on Load Stream A Highly Efficient FC-SAN Based on Load Stream Jiwu Shu, Jun Yao, Changdong Fu, and Weimin Zheng Dept. of Computer Science and Technology, Tsinghua University, Beijing 100084, P.R.C. {shujw,zwm-dcs}@mail.tsinghua.edu.cn

More information

Interactive Progressive Encoding System For Transmission of Complex Images

Interactive Progressive Encoding System For Transmission of Complex Images Interactive Progressive Encoding System For Transmission of Complex Images Borko Furht 1, Yingli Wang 1, and Joe Celli 2 1 NSF Multimedia Laboratory Florida Atlantic University, Boca Raton, Florida 33431

More information

Deduplication File System & Course Review

Deduplication File System & Course Review Deduplication File System & Course Review Kai Li 12/13/13 Topics u Deduplication File System u Review 12/13/13 2 Storage Tiers of A Tradi/onal Data Center $$$$ Mirrored storage $$$ Dedicated Fibre Clients

More information

Alternative Approaches for Deduplication in Cloud Storage Environment

Alternative Approaches for Deduplication in Cloud Storage Environment International Journal of Computational Intelligence Research ISSN 0973-1873 Volume 13, Number 10 (2017), pp. 2357-2363 Research India Publications http://www.ripublication.com Alternative Approaches for

More information

Switching/Flow Control Overview. Interconnection Networks: Flow Control and Microarchitecture. Packets. Switching.

Switching/Flow Control Overview. Interconnection Networks: Flow Control and Microarchitecture. Packets. Switching. Switching/Flow Control Overview Interconnection Networks: Flow Control and Microarchitecture Topology: determines connectivity of network Routing: determines paths through network Flow Control: determine

More information

Association Rules Mining using BOINC based Enterprise Desktop Grid

Association Rules Mining using BOINC based Enterprise Desktop Grid Association Rules Mining using BOINC based Enterprise Desktop Grid Evgeny Ivashko and Alexander Golovin Institute of Applied Mathematical Research, Karelian Research Centre of Russian Academy of Sciences,

More information

Silberschatz and Galvin Chapter 14

Silberschatz and Galvin Chapter 14 Silberschatz and Galvin Chapter 14 Tertiary Storage Structure CPSC 410--Richard Furuta 3/29/99 1 Tertiary Storage Structure Tertiary storage devices Operating system issues Performance issues CPSC 410--Richard

More information

An Efficient Storage Mechanism to Distribute Disk Load in a VoD Server

An Efficient Storage Mechanism to Distribute Disk Load in a VoD Server An Efficient Storage Mechanism to Distribute Disk Load in a VoD Server D.N. Sujatha 1, K. Girish 1, K.R. Venugopal 1,andL.M.Patnaik 2 1 Department of Computer Science and Engineering University Visvesvaraya

More information

A QoS aware Packet Scheduling Scheme for WiMAX

A QoS aware Packet Scheduling Scheme for WiMAX A QoS aware Packet Scheduling Scheme for WiMAX Mahasweta Sarkar and Harpreet Sachdeva ABSTRACT WiMAX is one of the most promising broadband wireless technologies today. The WiMAX standard-802.16-is designed

More information

Mass Storage System Performance Prediction Using a Trace-Driven Simulator

Mass Storage System Performance Prediction Using a Trace-Driven Simulator Mass Storage System Performance Prediction Using a Trace-Driven Simulator Bill Anderson National Center for Atmospheric Research (NCAR) * Boulder, CO 80305 andersnb@ucar.edu Abstract * Performance prediction

More information

THE TCP specification that specifies the first original

THE TCP specification that specifies the first original 1 Median Filtering Simulation of Bursty Traffic Auc Fai Chan, John Leis Faculty of Engineering and Surveying University of Southern Queensland Toowoomba Queensland 4350 Abstract The estimation of Retransmission

More information

Analysis of Striping Techniques in Robotic. Leana Golubchik y Boelter Hall, Graduate Student Oce

Analysis of Striping Techniques in Robotic. Leana Golubchik y Boelter Hall, Graduate Student Oce Analysis of Striping Techniques in Robotic Storage Libraries Abstract Leana Golubchik y 3436 Boelter Hall, Graduate Student Oce UCLA Computer Science Department Los Angeles, CA 90024-1596 (310) 206-1803,

More information

A Lossless Quality Transmission Algorithm for Stored VBR Video

A Lossless Quality Transmission Algorithm for Stored VBR Video 1 A Lossless Quality Transmission Algorithm for Stored VBR Video Fei Li, Yan Liu and Ishfaq Ahmad Department of Computer Science The Hong Kong University of Science and Technology Clear Water Bay, Kowloon,

More information

DYNAMIC REPLICATION OF CONTENT IN THE HAMMERHEAD MULTIMEDIA SERVER

DYNAMIC REPLICATION OF CONTENT IN THE HAMMERHEAD MULTIMEDIA SERVER DYNAMIC REPLICATION OF CONTENT IN THE HAMMERHEAD MULTIMEDIA SERVER Jonathan Dukes Jeremy Jones Department of Computer Science Trinity College Dublin, Ireland Email: Jonathan.Dukes@cs.tcd.ie KEYWORDS Multimedia

More information

An Out-of-band Approach to SAN-level Cache Management

An Out-of-band Approach to SAN-level Cache Management An Out-of-band Approach to SAN-level Cache Management Da Xiao xiaoda99@mails.tsinghua.edu.cn Jiwu Shu shujw@tsinghua.edu.cn Weimin Zheng zwm-dcs@tsinghua.edu.cn Department of Computer Science and Technology

More information

Performance of Multihop Communications Using Logical Topologies on Optical Torus Networks

Performance of Multihop Communications Using Logical Topologies on Optical Torus Networks Performance of Multihop Communications Using Logical Topologies on Optical Torus Networks X. Yuan, R. Melhem and R. Gupta Department of Computer Science University of Pittsburgh Pittsburgh, PA 156 fxyuan,

More information

A Hierarchial Model for Visual Perception

A Hierarchial Model for Visual Perception A Hierarchial Model for Visual Perception Bolei Zhou 1 and Liqing Zhang 2 1 MOE-Microsoft Laboratory for Intelligent Computing and Intelligent Systems, and Department of Biomedical Engineering, Shanghai

More information

Design and Implementation of a Random Access File System for NVRAM

Design and Implementation of a Random Access File System for NVRAM This article has been accepted and published on J-STAGE in advance of copyediting. Content is final as presented. IEICE Electronics Express, Vol.* No.*,*-* Design and Implementation of a Random Access

More information

Linux Software RAID Level 0 Technique for High Performance Computing by using PCI-Express based SSD

Linux Software RAID Level 0 Technique for High Performance Computing by using PCI-Express based SSD Linux Software RAID Level Technique for High Performance Computing by using PCI-Express based SSD Jae Gi Son, Taegyeong Kim, Kuk Jin Jang, *Hyedong Jung Department of Industrial Convergence, Korea Electronics

More information

Chapter 12: Mass-Storage

Chapter 12: Mass-Storage Chapter 12: Mass-Storage Systems Chapter 12: Mass-Storage Systems Revised 2010. Tao Yang Overview of Mass Storage Structure Disk Structure Disk Attachment Disk Scheduling Disk Management Swap-Space Management

More information

A New Hashing and Caching Approach for Reducing Call Delivery Cost and Location Server s Load in Wireless Mobile Networks

A New Hashing and Caching Approach for Reducing Call Delivery Cost and Location Server s Load in Wireless Mobile Networks Proceedings of 2009 12 th International Conference on Computer and Information Technology (ICCIT 2009) 21-23 December, 2009, Dhaka, Bangladesh A New Hashing and Caching Approach for Reducing Call Delivery

More information

Title Grid for Multimedia Communication Ne. The original publication is availabl. Press

Title Grid for Multimedia Communication Ne. The original publication is availabl. Press JAIST Reposi https://dspace.j Title Grid for Multimedia Communication Ne A Double Helix Architecture of Knowl Discovery System Based Data Grid and Author(s)Jing, He; Wuyi, Yue; Yong, Shi Citation Issue

More information

RAID. Redundant Array of Inexpensive Disks. Industry tends to use Independent Disks

RAID. Redundant Array of Inexpensive Disks. Industry tends to use Independent Disks RAID Chapter 5 1 RAID Redundant Array of Inexpensive Disks Industry tends to use Independent Disks Idea: Use multiple disks to parallelise Disk I/O for better performance Use multiple redundant disks for

More information

Hard Disk Drives. Nima Honarmand (Based on slides by Prof. Andrea Arpaci-Dusseau)

Hard Disk Drives. Nima Honarmand (Based on slides by Prof. Andrea Arpaci-Dusseau) Hard Disk Drives Nima Honarmand (Based on slides by Prof. Andrea Arpaci-Dusseau) Storage Stack in the OS Application Virtual file system Concrete file system Generic block layer Driver Disk drive Build

More information

Processing Satellite Images on Tertiary Storage: A Study of the Impact of Tile Size on Performance i

Processing Satellite Images on Tertiary Storage: A Study of the Impact of Tile Size on Performance i 1. Introduction Processing Satellite Images on Tertiary Storage: A Study of the Impact of Tile Size on Performance i JieBing Yu David J. DeWitt Computer Sciences Department University of Wisconsin-Madison

More information

A Note on Interfacing Object Warehouses and Mass Storage Systems for Data Mining Applications *

A Note on Interfacing Object Warehouses and Mass Storage Systems for Data Mining Applications * A Note on Interfacing Object Warehouses and Mass Storage Systems for Data Mining Applications * Robert L. Grossman Magnify, Inc. University of Illinois at Chicago 815 Garfield Street Laboratory for Advanced

More information

Random Early Detection Web Servers for Dynamic Load Balancing

Random Early Detection Web Servers for Dynamic Load Balancing 2009 10th International Symposium on Pervasive Systems, Algorithms, and Networks Random Early Detection Web Servers for Dynamic Load Balancing Chih-Chiang Yang, Chien Chen, and Jing-Ying Chen Department

More information

Mass-Storage Systems. Mass-Storage Systems. Disk Attachment. Disk Attachment

Mass-Storage Systems. Mass-Storage Systems. Disk Attachment. Disk Attachment TDIU11 Operating systems Mass-Storage Systems [SGG7/8/9] Chapter 12 Copyright Notice: The lecture notes are mainly based on Silberschatz s, Galvin s and Gagne s book ( Operating System Copyright Concepts,

More information

Chapter 14: Mass-Storage Systems

Chapter 14: Mass-Storage Systems Chapter 14: Mass-Storage Systems Disk Structure Disk Scheduling Disk Management Swap-Space Management RAID Structure Disk Attachment Stable-Storage Implementation Tertiary Storage Devices Operating System

More information

Parallel Algorithms on Clusters of Multicores: Comparing Message Passing vs Hybrid Programming

Parallel Algorithms on Clusters of Multicores: Comparing Message Passing vs Hybrid Programming Parallel Algorithms on Clusters of Multicores: Comparing Message Passing vs Hybrid Programming Fabiana Leibovich, Laura De Giusti, and Marcelo Naiouf Instituto de Investigación en Informática LIDI (III-LIDI),

More information

Access Coordination Of Tertiary Storage For High Energy Physics Applications

Access Coordination Of Tertiary Storage For High Energy Physics Applications Access Coordination Of Tertiary Storage For High Energy Physics Applications Luis M. Bernardo, Arie Shoshani, Alexander Sim, Henrik Nordberg Scientific Data Management Research Group NERSC Division Lawrence

More information

QoS-Aware Hierarchical Multicast Routing on Next Generation Internetworks

QoS-Aware Hierarchical Multicast Routing on Next Generation Internetworks QoS-Aware Hierarchical Multicast Routing on Next Generation Internetworks Satyabrata Pradhan, Yi Li, and Muthucumaru Maheswaran Advanced Networking Research Laboratory Department of Computer Science University

More information

Load Balancing Algorithms for Internet Vhdeo and Audio Server

Load Balancing Algorithms for Internet Vhdeo and Audio Server Load Balancing Algorithms for nternet Vhdeo and Audio Server Dusit Niyato Chutim.et Srinilta s2061036@kmitl.ac.th chutimet@ce.kmitl.ac. th Department of Computer Engineering, Engineering Faculty, King

More information

Twelfth IEEE Symposium on Mass Storage Systems. Striped Tape Arrays. Ann L. Drapeau, Randy H. Katz University of California Berkeley, California

Twelfth IEEE Symposium on Mass Storage Systems. Striped Tape Arrays. Ann L. Drapeau, Randy H. Katz University of California Berkeley, California Striped Tape Arrays Ann L. Drapeau, Randy H. Katz University of California Berkeley, California Abstract A growing number of applications require high-capacity, high-throughput tertiary storage systems

More information

OASIS: Self-tuning Storage for Applications

OASIS: Self-tuning Storage for Applications OASIS: Self-tuning Storage for Applications Kostas Magoutis, Prasenjit Sarkar, Gauri Shah 14 th NASA Goddard- 23 rd IEEE Mass Storage Systems Technologies, College Park, MD, May 17, 2006 Outline Motivation

More information

Case Studies on Cache Performance and Optimization of Programs with Unit Strides

Case Studies on Cache Performance and Optimization of Programs with Unit Strides SOFTWARE PRACTICE AND EXPERIENCE, VOL. 27(2), 167 172 (FEBRUARY 1997) Case Studies on Cache Performance and Optimization of Programs with Unit Strides pei-chi wu and kuo-chan huang Department of Computer

More information

Simulating a Finite State Mobile Agent System

Simulating a Finite State Mobile Agent System Simulating a Finite State Mobile Agent System Liu Yong, Xu Congfu, Chen Yanyu, and Pan Yunhe College of Computer Science, Zhejiang University, Hangzhou 310027, P.R. China Abstract. This paper analyzes

More information

Evaluation of Performance of Cooperative Web Caching with Web Polygraph

Evaluation of Performance of Cooperative Web Caching with Web Polygraph Evaluation of Performance of Cooperative Web Caching with Web Polygraph Ping Du Jaspal Subhlok Department of Computer Science University of Houston Houston, TX 77204 {pdu, jaspal}@uh.edu Abstract This

More information

Mining Frequent Itemsets for data streams over Weighted Sliding Windows

Mining Frequent Itemsets for data streams over Weighted Sliding Windows Mining Frequent Itemsets for data streams over Weighted Sliding Windows Pauray S.M. Tsai Yao-Ming Chen Department of Computer Science and Information Engineering Minghsin University of Science and Technology

More information

CS 471 Operating Systems. Yue Cheng. George Mason University Fall 2017

CS 471 Operating Systems. Yue Cheng. George Mason University Fall 2017 CS 471 Operating Systems Yue Cheng George Mason University Fall 2017 Review: Disks 2 Device I/O Protocol Variants o Status checks Polling Interrupts o Data PIO DMA 3 Disks o Doing an disk I/O requires:

More information

An Extended Shortest Path Problem with Switch Cost Between Arcs

An Extended Shortest Path Problem with Switch Cost Between Arcs An Extended Shortest Path Problem with Switch Cost Between Arcs Xiaolong Ma, Jie Zhou Abstract Computing the shortest path in a graph is an important problem and it is very useful in various applications.

More information

An Enhanced Binning Algorithm for Distributed Web Clusters

An Enhanced Binning Algorithm for Distributed Web Clusters 1 An Enhanced Binning Algorithm for Distributed Web Clusters Hann-Jang Ho Granddon D. Yen Jack Lee Department of Information Management, WuFeng Institute of Technology SingLing Lee Feng-Wei Lien Department

More information

Stretch-Optimal Scheduling for On-Demand Data Broadcasts

Stretch-Optimal Scheduling for On-Demand Data Broadcasts Stretch-Optimal Scheduling for On-Demand Data roadcasts Yiqiong Wu and Guohong Cao Department of Computer Science & Engineering The Pennsylvania State University, University Park, PA 6 E-mail: fywu,gcaog@cse.psu.edu

More information

Adaptive Lock. Madhav Iyengar < >, Nathaniel Jeffries < >

Adaptive Lock. Madhav Iyengar < >, Nathaniel Jeffries < > Adaptive Lock Madhav Iyengar < miyengar@andrew.cmu.edu >, Nathaniel Jeffries < njeffrie@andrew.cmu.edu > ABSTRACT Busy wait synchronization, the spinlock, is the primitive at the core of all other synchronization

More information

Congestion Control for High Bandwidth-delay Product Networks. Dina Katabi, Mark Handley, Charlie Rohrs

Congestion Control for High Bandwidth-delay Product Networks. Dina Katabi, Mark Handley, Charlie Rohrs Congestion Control for High Bandwidth-delay Product Networks Dina Katabi, Mark Handley, Charlie Rohrs Outline Introduction What s wrong with TCP? Idea of Efficiency vs. Fairness XCP, what is it? Is it

More information

Optimal Query Mapping in Mobile OLAP

Optimal Query Mapping in Mobile OLAP Optimal Query Mapping in Mobile OLAP Ilias Michalarias and Hans -J. Lenz Freie Universität Berlin {ilmich,hjlenz}@wiwiss.fu-berlin.de Overview I. mobile OLAP Research Context II. Query Mapping in molap

More information

MASS-STORAGE STRUCTURE

MASS-STORAGE STRUCTURE UNIT IV MASS-STORAGE STRUCTURE Mass-Storage Systems ndescribe the physical structure of secondary and tertiary storage devices and the resulting effects on the uses of the devicesnexplain the performance

More information

A Remote Hot Standby System of Oracle

A Remote Hot Standby System of Oracle 2012 International Conference on Image, Vision and Computing (ICIVC 2012) IPCSIT vol. 50 (2012) (2012) IACSIT Press, Singapore DOI: 10.7763/IPCSIT.2012.V50.51 A Remote Hot Standby System of Oracle Qiu

More information

Huge market -- essentially all high performance databases work this way

Huge market -- essentially all high performance databases work this way 11/5/2017 Lecture 16 -- Parallel & Distributed Databases Parallel/distributed databases: goal provide exactly the same API (SQL) and abstractions (relational tables), but partition data across a bunch

More information

Improvements and Implementation of Hierarchical Clustering based on Hadoop Jun Zhang1, a, Chunxiao Fan1, Yuexin Wu2,b, Ao Xiao1

Improvements and Implementation of Hierarchical Clustering based on Hadoop Jun Zhang1, a, Chunxiao Fan1, Yuexin Wu2,b, Ao Xiao1 3rd International Conference on Machinery, Materials and Information Technology Applications (ICMMITA 2015) Improvements and Implementation of Hierarchical Clustering based on Hadoop Jun Zhang1, a, Chunxiao

More information

Replicate It! Scalable Content Delivery: Why? Scalable Content Delivery: How? Scalable Content Delivery: How? Scalable Content Delivery: What?

Replicate It! Scalable Content Delivery: Why? Scalable Content Delivery: How? Scalable Content Delivery: How? Scalable Content Delivery: What? Accelerating Internet Streaming Media Delivery using Azer Bestavros and Shudong Jin Boston University http://www.cs.bu.edu/groups/wing Scalable Content Delivery: Why? Need to manage resource usage as demand

More information

CORAL: A Multi-Core Lock-Free Rate Limiting Framework

CORAL: A Multi-Core Lock-Free Rate Limiting Framework : A Multi-Core Lock-Free Rate Limiting Framework Zhe Fu,, Zhi Liu,, Jiaqi Gao,, Wenzhe Zhou, Wei Xu, and Jun Li, Department of Automation, Tsinghua University, China Research Institute of Information Technology,

More information

FastScale: Accelerate RAID Scaling by

FastScale: Accelerate RAID Scaling by FastScale: Accelerate RAID Scaling by Minimizing i i i Data Migration Weimin Zheng, Guangyan Zhang gyzh@tsinghua.edu.cn Tsinghua University Outline Motivation Minimizing data migration Optimizing data

More information

A Scalable, Cache-Based Queue Management Subsystem for Network Processors

A Scalable, Cache-Based Queue Management Subsystem for Network Processors A Scalable, Cache-Based Queue Management Subsystem for Network Processors Sailesh Kumar and Patrick Crowley Applied Research Laboratory Department of Computer Science and Engineering Washington University

More information

Processing Satellite Images on Tertiary Storage: A Study of the Impact of Tile Size on Performance i

Processing Satellite Images on Tertiary Storage: A Study of the Impact of Tile Size on Performance i Proceedings of the 1996 NASA Conference on Mass Storage Systems, College Park, Maryland, September 1996. Processing Satellite Images on Tertiary Storage: A Study of the Impact of Tile Size on Performance

More information

Performance Evaluation of XHTML encoding and compression

Performance Evaluation of XHTML encoding and compression Performance Evaluation of XHTML encoding and compression Sathiamoorthy Manoharan Department of Computer Science, University of Auckland, Auckland, New Zealand Abstract. The wireless markup language (WML),

More information

SCALING UP OF E-MSR CODES BASED DISTRIBUTED STORAGE SYSTEMS WITH FIXED NUMBER OF REDUNDANCY NODES

SCALING UP OF E-MSR CODES BASED DISTRIBUTED STORAGE SYSTEMS WITH FIXED NUMBER OF REDUNDANCY NODES SCALING UP OF E-MSR CODES BASED DISTRIBUTED STORAGE SYSTEMS WITH FIXED NUMBER OF REDUNDANCY NODES Haotian Zhao, Yinlong Xu and Liping Xiang School of Computer Science and Technology, University of Science

More information

DDSF: A Data Deduplication System Framework for Cloud Environments

DDSF: A Data Deduplication System Framework for Cloud Environments DDSF: A Data Deduplication System Framework for Cloud Environments Jianhua Gu, Chuang Zhang and Wenwei Zhang School of Computer Science and Technology, High Performance Computing R&D Center Northwestern

More information

Improving VoD System Efficiency with Multicast and Caching

Improving VoD System Efficiency with Multicast and Caching Improving VoD System Efficiency with Multicast and Caching Jack Yiu-bun Lee Department of Information Engineering The Chinese University of Hong Kong Contents 1. Introduction 2. Previous Works 3. UVoD

More information

VFS Interceptor: Dynamically Tracing File System Operations in real. environments

VFS Interceptor: Dynamically Tracing File System Operations in real. environments VFS Interceptor: Dynamically Tracing File System Operations in real environments Yang Wang, Jiwu Shu, Wei Xue, Mao Xue Department of Computer Science and Technology, Tsinghua University iodine01@mails.tsinghua.edu.cn,

More information

Introduction Disks RAID Tertiary storage. Mass Storage. CMSC 420, York College. November 21, 2006

Introduction Disks RAID Tertiary storage. Mass Storage. CMSC 420, York College. November 21, 2006 November 21, 2006 The memory hierarchy Red = Level Access time Capacity Features Registers nanoseconds 100s of bytes fixed Cache nanoseconds 1-2 MB fixed RAM nanoseconds MBs to GBs expandable Disk milliseconds

More information

Overview of Mass Storage Structure

Overview of Mass Storage Structure Overview of Mass Storage Structure Magnetic disks provide bulk of secondary storage Drives rotate at 70 to 250 times per second Ipod disks: 4200 rpm Laptop disks: 4200, 5400 rpm or 7200 rpm Desktop disks:

More information

Implementation and Evaluation of Prefetching in the Intel Paragon Parallel File System

Implementation and Evaluation of Prefetching in the Intel Paragon Parallel File System Implementation and Evaluation of Prefetching in the Intel Paragon Parallel File System Meenakshi Arunachalam Alok Choudhary Brad Rullman y ECE and CIS Link Hall Syracuse University Syracuse, NY 344 E-mail:

More information

An Improvement of an Approach for Representation of Tree Structures in Relational Tables

An Improvement of an Approach for Representation of Tree Structures in Relational Tables An Improvement of an Approach for Representation of Tree Structures in Relational Tables Ivaylo Atanassov Abstract: The paper introduces an improvement of an approach for tree representation in relational

More information

High-Performance Storage Systems

High-Performance Storage Systems High-Performance Storage Systems I/O Systems Processor interrupts Cache Memory - I/O Bus Main Memory I/O Controller I/O Controller I/O Controller Disk Disk Graphics Network 2 Storage Technology Drivers

More information

Proceedings of the Meeting & workshop on Development of a National IT Strategy Focusing on Indigenous Content Development

Proceedings of the Meeting & workshop on Development of a National IT Strategy Focusing on Indigenous Content Development Ministry of Science, Research & Technology Iranian Information & Documentation Center (Research Center) Proceedings of the Meeting & workshop on Development of a National IT Strategy Focusing on Indigenous

More information

Storage Hierarchy Management for Scientific Computing

Storage Hierarchy Management for Scientific Computing Storage Hierarchy Management for Scientific Computing by Ethan Leo Miller Sc. B. (Brown University) 1987 M.S. (University of California at Berkeley) 1990 A dissertation submitted in partial satisfaction

More information

IN recent years, the amount of traffic has rapidly increased

IN recent years, the amount of traffic has rapidly increased , March 15-17, 2017, Hong Kong Content Download Method with Distributed Cache Management Masamitsu Iio, Kouji Hirata, and Miki Yamamoto Abstract This paper proposes a content download method with distributed

More information