Chapter 11 DISTRIBUTED FILE SYSTEMS

Similar documents
Advanced Operating Systems

CPE731 Distributed System Models

Distributed File Systems. Distributed Systems IT332

Distributed File Systems

File Locking in NFS. File Locking: Share Reservations

CS 470 Spring Distributed Web and File Systems. Mike Lam, Professor. Content taken from the following:

Today: Distributed File Systems. File System Basics

Today: Distributed File Systems

CS 470 Spring Distributed Web and File Systems. Mike Lam, Professor. Content taken from the following:

Cloud Computing CS

DISTRIBUTED SYSTEMS. Second Edition. Andrew S. Tanenbaum Maarten Van Steen. Vrije Universiteit Amsterdam, 7'he Netherlands PEARSON.

Distributed File Systems. CS432: Distributed Systems Spring 2017

Distributed File Systems. CS 537 Lecture 15. Distributed File Systems. Transfer Model. Naming transparency 3/27/09

Cloud Computing CS

Chapter 10 DISTRIBUTED OBJECT-BASED SYSTEMS

Today CSCI Coda. Naming: Volumes. Coda GFS PAST. Instructor: Abhishek Chandra. Main Goals: Volume is a subtree in the naming space

Distributed File Systems. Case Studies: Sprite Coda

Lecture 19. NFS: Big Picture. File Lookup. File Positioning. Stateful Approach. Version 4. NFS March 4, 2005

DISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S. TANENBAUM MAARTEN VAN STEEN. Chapter 2 ARCHITECTURES

Module 7 File Systems & Replication CS755! 7-1!

Chapter 18 Distributed Systems and Web Services

Ch. 7 Distributed File Systems

Distributed File Systems (Chapter 14, M. Satyanarayanan) CS 249 Kamal Singh

NFSv4 as the Building Block for Fault Tolerant Applications

Distributed File Systems. Jonathan Walpole CSE515 Distributed Computing Systems

Service and Cloud Computing Lecture 10: DFS2 Prof. George Baciu PQ838

DISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S. TANENBAUM MAARTEN VAN STEEN. Chapter 1. Introduction

DISTRIBUTED SYSTEMS [COMP9243] Lecture 9b: Distributed File Systems INTRODUCTION. Transparency: Flexibility: Slide 1. Slide 3.

DISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S. TANENBAUM MAARTEN VAN STEEN. Chapter 1. Introduction

DISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S. TANENBAUM MAARTEN VAN STEEN. Chapter 5 Naming

Chapter 8 Fault Tolerance

DISTRIBUTED FILE SYSTEMS & NFS

Chapter 2 ARCHITECTURES

NFS Version 4.1. Spencer Shepler, Storspeed Mike Eisler, NetApp Dave Noveck, NetApp

Chapter 2 ARCHITECTURES

NFSv4.1 Using pnfs PRESENTATION TITLE GOES HERE. Presented by: Alex McDonald CTO Office, NetApp

Distributed Systems Principles and Paradigms. Chapter 12: Distributed Web-Based Systems

Distributed File Systems. Directory Hierarchy. Transfer Model

Distributed Systems. Hajussüsteemid MTAT Distributed File Systems. (slides: adopted from Meelis Roos DS12 course) 1/25

Chapter 12 Distributed File Systems. Copyright 2015 Prof. Amr El-Kadi

Introduction to Distributed Systems

Distributed File Systems. File Systems

PART B UNIT II COMMUNICATION IN DISTRIBUTED SYSTEM PART A

Lecture 14: Distributed File Systems. Contents. Basic File Service Architecture. CDK: Chapter 8 TVS: Chapter 11

NFS: Naming indirection, abstraction. Abstraction, abstraction, abstraction! Network File Systems: Naming, cache control, consistency

Operating Systems Design 16. Networking: Remote File Systems


Distributed File Systems

Introduction to Cloud Computing

Distributed file systems

Today: Coda, xfs! Brief overview of other file systems. Distributed File System Requirements!

CS555: Distributed Systems [Fall 2017] Dept. Of Computer Science, Colorado State University

Chapter 2 ARCHITECTURES

Chapter 7 Consistency And Replication

Lecture 7: Distributed File Systems

Distributed File Systems

Distributed File Systems I

NFS in Userspace: Goals and Challenges

DISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S. TANENBAUM MAARTEN VAN STEEN. Chapter 3 Processes

Introduction to Distributed Systems. Fabienne Boyer, LIG,

Sun Certified System Administrator for the Solaris 10 OS Bootcamp

AN OVERVIEW OF DISTRIBUTED FILE SYSTEM Aditi Khazanchi, Akshay Kanwar, Lovenish Saluja

Distributed Information Processing

Disconnected Operation in the Coda File System

Chapter 5 Naming (2)

Example File Systems Using Replication CS 188 Distributed Systems February 10, 2015

CA464 Distributed Programming

GridNFS: Scaling to Petabyte Grid File Systems. Andy Adamson Center For Information Technology Integration University of Michigan

Distributed File Systems

Distributed Systems. 14. Network File Systems. Paul Krzyzanowski. Rutgers University. Fall 2016

Naming in Distributed Systems

Distributed Systems Final Exam

Large Systems: Design + Implementation: Communication Coordination Replication. Image (c) Facebook

A Survey on Peer-to-Peer File Systems

CS /15/16. Paul Krzyzanowski 1. Question 1. Distributed Systems 2016 Exam 2 Review. Question 3. Question 2. Question 5.

CS6601 DISTRIBUTED SYSTEM / 2 MARK

Today: Distributed File Systems

NFS version 4 LISA `05. Mike Eisler Network Appliance, Inc.

Distributed Systems COMP 212. Lecture 1 Othon Michail

Professor: Ioan Raicu. TA: Wei Tang. Everyone else

Chapter 4 Communication

Distributed Systems. Distributed File Systems. Paul Krzyzanowski

System that permanently stores data Usually layered on top of a lower-level physical storage medium Divided into logical units called files

Network File System (NFS)

CS 425 / ECE 428 Distributed Systems Fall Indranil Gupta (Indy) Nov 28, 2017 Lecture 25: Distributed File Systems All slides IG

CSE 5306 Distributed Systems. Course Introduction

Network File System (NFS)

CSE 5306 Distributed Systems

Squirrel case-study. Decentralized peer-to-peer web cache. Traditional centralized web cache. Based on the Pastry peer-to-peer middleware system

Distributed System. Gang Wu. Spring,2018

INSTITUTE OF AERONAUTICAL ENGINEERING (Autonomous) Dundigal, Hyderabad

IBM Tivoli Access Manager for e-business V6.1.1 Implementation

15-440/15-640: Homework 1 Due: September 23, :59pm

Operating Systems Design Exam 3 Review: Spring Paul Krzyzanowski

COSC 6374 Parallel Computation. Parallel I/O (I) I/O basics. Concept of a clusters

Distributed File Systems Part II. Distributed File System Implementation

DFS Case Studies, Part 1

Advanced Operating Systems

EI 338: Computer Systems Engineering (Operating Systems & Computer Architecture)

CSE 486/586: Distributed Systems

Transcription:

DISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S. TANENBAUM MAARTEN VAN STEEN Chapter 11 DISTRIBUTED FILE SYSTEMS

Client-Server Architectures (1) Figure 11-1. (a) The remote access model. (b) The upload/download model.

Client-Server Architectures (2) Figure 11-2. The basic NFS architecture for UNIX systems.

File System Model (1) Figure 11-3. An incomplete list of file system operations supported by NFS.

File System Model (2) Figure 11-3. An incomplete list of file system operations supported by NFS.

Cluster-Based Distributed File Systems (1) Figure 11-4. The difference between (a) distributing whole files across several servers and (b) striping files for parallel access.

Cluster-Based Distributed File Systems (2) Figure 11-5. The organization of a Google cluster of servers.

Symmetric Architectures Figure 11-6. The organization of the Ivy distributed file system.

Remote Procedure Calls in NFS Figure 11-7. (a) Reading data from a file in NFS version 3. (b) Reading data using a compound procedure in version 4.

The RPC2 Subsystem (1) Figure 11-8. Side effects in Coda s RPC2 system.

The RPC2 Subsystem (2) Figure 11-9. (a) Sending an invalidation message one at a time. (b) Sending invalidation messages in parallel.

File-Oriented Communication in Plan 9 Figure 11-10. Files associated with a single TCP connection in Plan 9.

Naming in NFS (1) Figure 11-11. Mounting (part of) a remote file system in NFS.

Naming in NFS (2) Figure 11-12. Mounting nested directories from multiple servers in NFS.

Automounting (1) Figure 11-13. A simple automounter for NFS.

Automounting (2) Figure 11-14. Using symbolic links with automounting.

Constructing a Global Name Space Figure 11-15. Junctions in GNS.

Semantics of File Sharing (1) Figure 11-16. (a) On a single processor, when a read follows a write, the value returned by the read is the value just written.

Semantics of File Sharing (2) Figure 11-16. (b) In a distributed system with caching, obsolete values may be returned.

Semantics of File Sharing (3) Figure 11-17. Four ways of dealing with the shared files in a distributed system.

File Locking (1) Figure 11-18. NFSv4 operations related to file locking.

File Locking (2) Figure 11-19. The result of an open operation with share reservations in NFS. (a) When the client requests shared access given the current denial state.

File Locking (3) Figure 11-19. The result of an open operation with share reservations in NFS. (b) When the client requests a denial state given the current file access state.

Sharing Files in Coda Figure 11-20. The transactional behavior in sharing files in Coda.

Client-Side Caching (1) Figure 11-21. Client-side caching in NFS.

Client-Side Caching (2) Figure 11-22. Using the NFSv4 callback mechanism to recall file delegation.

Client-Side Caching in Coda Figure 11-23. The use of local copies when opening a session in Coda.

Server Replication in Coda Figure 11-24. Two clients with a different AVSG for the same replicated file.

Structured Peer-to-Peer Systems Figure 11-25. Balancing load in a peer-to-peer system by replication.

Handling Byzantine Failures Figure 11-26. The different phases in Byzantine fault tolerance.

High Availability in Peer-to-Peer Systems Figure 11-27. The ratio r rep /r ec as a function of node availability a.

Security in NFS Figure 11-28. The NFS security architecture.

Secure RPCs Figure 11-29. Secure RPC in NFSv4.

Access Control Figure 11-30. The various kinds of users and processes distinguished by NFS with respect to access control.

Decentralized Authentication (1) Figure 11-31. The organization of SFS.

Decentralized Authentication (2) Figure 11-32. A self-certifying pathname in SFS.

Secure Lookups in DHT-Based Systems Secure routing requires that three issues are dealt with: 1. Nodes are assigned identifiers in a secure way. 2. Routing tables are securely maintained. 3. Lookup requests are securely forwarded between nodes.

Secure Collaborative Storage Figure 11-33. The principle of storage claims in the Samsara peer-to-peer system.