Yet another redirection mechanism for the World-Wide Web?

Size: px
Start display at page:

Download "Yet another redirection mechanism for the World-Wide Web?"

Transcription

1 Yet another redirection mechanism for the World-Wide Web? Aline Baggio Vrije Universiteit Department of Computer Science De Boelelaan 1081a 1081HV Amsterdam The Netherlands baggio/ Abstract Replication in the World-Wide Web covers a wide range of techniques. Often, the redirection of a client browser towards a given replica of a Web page has to be explicit and is performed after the client s request has reached the Web storing the requested page. We believe the redirection has to take place as close to the client as possible and in a fully distributed manner. This paper present a distributed redirection scheme that ensures we find a replica wherever it is stored and that the closest possible replica is always found first. By exploiting locality, we can keep latency low. Applications of such a redirection scheme are found in CDNs (Content Distribution Networks). We are mostly targeting non-commercial CDNs. 1 Introduction Replication in the World-Wide Web encompasses a wide range of techniques, from proxy caches to mirrors and Content Distribution Networks (CDNs). The use of location-dependent URLs does not facilitate transparent access to the replicated Web pages. Instead, it is often necessary to explicitly redirect clients towards a given replica. in the case of proxy caches occurs in an implicit way: each HTTP request is routed through the cache or the hierarchy of caches and, in the best case, the replica of the requested Web page is retrieved directly from the cache storage space. With mirrors or CDNs, the client browser has to be explicitly redirected to a machine which is normally not on the route followed by the request. in these cases is generally achieved in a centralized way. A client is redirected only after its request has reached the home, that is, the host named in the document s URL, which then decides on the replica that should further handle the request. The main disadvantage of centralized redirection mechanisms is the induced latency. We believe that a client request should not go to a page s home to be redirected. The redirection should take place as soon and as close to the client as possible. We have devised a distributed redirection scheme in which the redirection decision can be taken locally at the client machine or, in the worst case, before the HTTP request leaves the client s network. In this paper, we present our design and show how it can be more or less transparently integrated with the current Web. The paper is organized as follow. Section gives a brief overview of the existing redirection methods for the World-Wide Web. Section presents the principle of our distributed redirection scheme. Section discusses the integration of the redirection mechanism in the current Web. Finally, Section concludes and gives some future work directions. PhD thesis submission date: June nd,

2 Alternatives for redirecting clients in the Web in today s World-Wide Web is achieved using mainly application-level redirection or -based redirection. The HyperText Transfer Protocol (HTTP) can be used to achieve application-level redirection. Whenever a client browser requests a Web page, it contacts the Web named in the URL. Instead of directly sending back the page contents, the Web can decide to redirect the client browser to another. This redirection takes the form of another URL naming the where a replica of the requested page can be found [, ]. The browser has to issue a new HTTP request to fetch the Web page at the replica site. The Domain Name System () can be used for redirection purposes [, ]. -based redirection exploits the fact that a browser needs to resolve the domain name contained in a URL to a network address. Unless the name-to-address mapping is already cached at the client s, the client s request reaches the responsible for the Web s domain (i.e., the authoritative ). As a reply, the authoritative can decide to send any appropriate network address and not only the address of the Web designated in the URL. In particular, the can respond with the address of a Web holding a replica of the Web page. The returned address is cached at the client s. The subsequent requests for this domain are therefore resolved to the replica s network address until the address is flushed from the cache. Each of these Web redirection methods have their own characteristics that make them not entirely satisfactory. Most importantly, with both HTTP- and -based redirection, a large number of requests travels to the side before the redirection takes place. The worst case is HTTP-based redirection where each single request has to be redirected independently of the others. Latency is thus an important disadvantage of HTTP-based redirection []. -based redirection performs better in that respect thanks to its caching mechanisms. However, since subsequent redirections are independent of each other, HTTP-based redirection provides a fine granularity that -based redirection can not achieve. Another disadvantage of HTTP-based redirection is that it does not provide support for redirection transparency. Clients are aware of the redirection since the replica s address is passed to the client. This allows a client to cache and reuse references towards replicas, which may conflict with the redirection policy of the Web. HTTP is, however, widely used for communication between browsers, s and proxy caches []. This makes it attractive with respect to deployment and simplicity of use. A more detailed comparison of redirection mechanisms can be found in [1,,, 6]. Principles of distributed redirection Considering the disadvantages of HTTP-based and -based redirection, we want to devise a redirection method offering a fine granularity in redirection without loss of scalability or transparency. We consider scalability by locality important: a request to look for a replica of a Web page has to avoid traveling a long distance. In addition, the selected replica should remain the nearest possible to the client browser. Consider a non-commercial CDN where the users are sharing computing resources and mostly disk space to replicate their Web pages. An example of such a system is Globule []. The Globe Web page is replicated in this CDN and is referred to as It is available at four Web s: Amsterdam, the home location of the document; Naples; San Francisco and Sydney (see Figure 1). A client browser located in San Diego issues an HTTP request for the page. This request should be redirected so that the client can use the replica of the Web page located in San Francisco. With the current redirection mechanisms, the request travels, in principle, to the home in Amsterdam and only there is it redirected. We can improve locality by using a collection of redirection s installed close to the clients. In our example, the browser s HTTP request is processed first by its local redirection in San Diego.

3 World San Francisco Americas USA San Francisco San Diego Europe The Netherlands Italy Amsterdam Naples Asia-Pacific Australia San Diego USA The Netherlands Amsterdam Americas World Asia-Pacific Europe Italy Sydney Naples with replica Sydney Figure 1: Building a hierarchy of redirection s For preserving locality when looking up replicas, a redirection knows only about pages that are available in its own area. Since the Globe Web page is not replicated locally, the redirection in San Diego itself issues a lookup request to find the page. To keep the communication costs relatively low and to preserve locality, a redirection always tries first to find a requested Web page in its neighboring areas. This is achieved by organizing the collection of redirection s hierarchically. Such an organization is done on a per-page basis and as such it naturally cares for balancing the load on the redirection s. Figure 1 shows the hierarchy for the Globe page. This hierarchy is organized around the Amsterdam redirection which is the home location of the Web page. The hierarchy of redirection s of the Globe page can be shared with other pages whose home Web is in Amsterdam. The lookup request issued by the redirection in San Diego is further treated as follows. It reaches the parent redirection USA. For preserving locality, only leaf s store addresses of replicas. The intermediate US thus does not have an address for the Web page. However, it holds a pointer to the redirection in San Francisco, which is known to have information about a replica of the page (for more information about how these pointers are installed, see [1]). The US further forwards the lookup request to the redirection in San Francisco. San Francisco eventually replies with the address of the Web page completing the lookup request. The client s redirection in San Diego is in charge of actually retrieving the Web page from the San Francisco Web as a Web proxy would do. The San Diego can finally decide to cache the address of the replica for handling subsequent client requests, for example, when downloading the inline images of the document. By contacting its local redirection, a client browser implicitly initiates a lookup for a replica at the lowest level of the redirection service. In the best case, the address of a replica can be found at this (local replica or cached address). If not, the forwarding of the lookup request takes place. Each step up in the hierarchy broadens the search. Having replica lookups always starting locally at the client site and gradually expanding the search area guarantees that the potential local and close-by replicas are found first. This also guarantees us to find a replica wherever it is stored. The forwarding of the requests along the hierarchy allows us to avoid unnecessary communication with parties that are far apart. In addition, by keeping the number of levels in the hierarchy relatively small, we can ensure that we do not introduce too much latency when forwarding the requests. Integrating the redirection service with the existing A client browser interacts with its local redirection to look for replicas of Web pages. We want this interaction to occur as transparently as possible. First, a client should not be aware it is dealing with a replica of the Web page it requested. At no point a client should be able to keep an

4 1 name resolution of HTTP request to supposedly Lookup request in the redirection service HTTP request to the Web hosting the replica HTTP reply with the contents of the page Home Web Amsterdam domain 1 San Diego domain Client browser Web Initial user request for San Francisco domain Figure : Interaction of the distributed redirection components explicit reference towards a replica of a Web page, for example by bookmarking it as it can be the case with HTTP-based redirection. Not preventing this can, first, lead to dangling pointers when the replica is removed. This is unacceptable if the original page is itself still accessible. Second, discovering new replicas closer to the client would require an explicit action from the end user, which is also unsatisfying. This is what we call replication transparency. It is the task of the client s redirection to maintain replication transparency. This is achieved by not displaying the addresses of the replicas to the client browser. The client sees only the home location of a Web page. It has no way of discovering the address of a replica when using the redirection service and of accessing the replica directly. The redirection at the client side thus takes care of fetching the replica for the client and acts as if it were the home Web. Internally, the redirection service translates the home location into a unique identifier and performs the lookup. An identifier is associated with URLs of replicas. At the end of the lookup, the client s redirection returns the page to the browser, referring to it with the home location. Note that no page rewriting is necessary and would even be counter-productive in presence of address caching at the redirection side. Second, a client browser should not be aware its requests are going through a redirection service. The end user should have the least possible to do to take benefit of the redirection service. This makes the deployment and the use of the redirection service at client sites easier. We can achieve this by carefully integrating the components of the redirection service with their environment. This is what we call transparency of use. To satisfy the transparency of use requirement, we decided to integrate our distributed redirection scheme at the level. A distributed redirection has to act as authoritative. Client browsers automatically access the redirection service, being redirected by their authoritative as it is the case with todays -based redirection. Figure shows the message exchanges between the client browser, its authoritative (component of the redirection service) and the local redirection. The client site s s needed for the redirection service can be integrated into a single component. The modified may just be a front-end to the local redirection. The redirection component has therefore to act as (1) a, resolving names; () a Web proxy, receiving client browser HTTP requests and fetching pages from Web s; and () a redirection, performing lookups in the redirection service. We can improve efficiency by relaxing the transparency constraint: we can let the client browser consider the redirection as a Web proxy. The browser proxy configuration has thus to be adjusted accordingly. The browser has only to send HTTP requests to the redirection

5 which performs the subsequent lookup. To preserve transparency, the redirection service could be directly integrated at the router or switch level, as it is the case for transparent caches. It would then intercept TCP traffic for port 80. Finally, to facilitate installation and deployment, we implemented our redirection as a module in the Apache. Apache is a well-known and widely-used Web. It has the advantage of being implemented in a modular way and as such is extendable with new features. Moreover, similar experiments with integrating replication [] or -based redirection [6] features in Apache modules have shown the approach to be feasible. Conclusion The redirection mechanisms used in today s World-Wide Web such as HTTP-based redirection or -based redirection exhibit characteristics that make them not fully satisfactory. The main concern is that with any of these methods, a home-based approach is used. The request of a client is in most cases redirected only after it has reached the Web page home location. Not only does this put load on the home Web and does it generate traffic on the network, but it induces latency that can be perceived by the end user. We devised a scheme where the redirection is fully distributed. An important aspect is that the locality has to be preserved: the redirection decision has to take place as locally to the client as possible and the selected replica of the requested Web page has to remain close to the client. In such a way, we avoid unnecessary communication for both finding a replica and contacting it. Latency is kept as low as possible. Distributed redirection makes use of a world-wide collection of redirection s organized as a collection of trees, one per Web page or group of Web pages from the same leaf domain. Leaf s store addresses of replicas and perform lookup requests on behalf of clients. A redirection supports both and HTTP protocols for interacting with clients, as well as its own protocol for looking up and updating addresses of replicas. Each participating client or site has to run its redirection. The distributed redirection mechanisms have to integrate seamlessly in the current World- Wide Web. A redirection is implemented as an Apache module and used transparently by being configured as an authoritative. We are currently in the process of running simulations and comparing both -based and distributed redirection. Future work encompasses experiments and performance measurements of our redirection scheme as well as the addition of optimizations such as address caching mechanisms. References [1] A. Baggio. Distributed redirection mechanisms for the World-Wide Web. Technical report, Vrije Universiteit, 00. In preparation. [] B. Cain, A. Barbir, F. Douglis, M. Green, M. Hofmann, R. Nair, D. Potter, and O. Spatscheck. Known cn request-routing mechanisms. Internet draft, May 00. [] R. Fielding, J. Gettys, J. C. Mogul, H. Frystyk, L. Masinter, P. Leach, and T. Berners-Lee. Hypertext Transfer Protocol HTTP/1.1. RFC 616, June [] G. Pierre and M. van Steen. Globule: a platform for self-replicating web documents. In 6th Int. Conf. on Protocols for Multimedia Systems, pages 1 11, Enschede, The Netherlands, Oct [] M. Rabinovich and O. Spastscheck. Web Caching and Replication. Addison-Wesley, Reading, MA., 00. [6] M. Szymaniak. -based client redirector for the Apache HTTP. Master s thesis, Warsaw University and Vrije Universiteit, June 00.

Transparent Distributed Redirection of HTTP Requests

Transparent Distributed Redirection of HTTP Requests Transparent Distributed Redirection of HTTP Requests Aline Baggio Maarten van Steen Vrije Universiteit Department of Computer Science De Boelelaan 1081a 1081HV Amsterdam The Netherlands baggio,steen @cs.vu.nl

More information

Distributed redirection for the World-Wide Web

Distributed redirection for the World-Wide Web Computer Networks 49 (2005) 743 765 www.elsevier.com/locate/comnet Distributed redirection for the World-Wide Web Aline Baggio *, Maarten van Steen Vriji Universiteit, Computer Science, De Boelelaan 1081a,

More information

Distributed redirection for the Globule platform

Distributed redirection for the Globule platform Distributed redirection for the Globule platform Aline Baggio October 2004 Technical report IR-CS-010 Abstract Replication in the World-Wide Web covers a wide range of techniques. Often, the redirection

More information

NetAirt: A Flexible Redirection System for Apache

NetAirt: A Flexible Redirection System for Apache NetAirt: A Flexible Redirection System for Apache Michał Szymaniak Guillaume Pierre Maarten van Steen Department of Computer Science Vrije Universiteit Amsterdam michal,gpierre,steen @cs.vu.nl Abstract:

More information

A Location Service for Worldwide Distributed Objects

A Location Service for Worldwide Distributed Objects A Location Service for Worldwide Distributed Objects 1 A Location Service for Worldwide Distributed Objects Franz J. Hauck 1, Maarten van Steen, Andrew S. Tanenbaum Dept. of Math. and Computer Science,

More information

殷亚凤. Naming. Distributed Systems [5]

殷亚凤. Naming. Distributed Systems [5] Naming Distributed Systems [5] 殷亚凤 Email: yafeng@nju.edu.cn Homepage: http://cs.nju.edu.cn/yafeng/ Room 301, Building of Computer Science and Technology Review Concepts about faults How to improve dependability

More information

Modelling and Analysis of Push Caching

Modelling and Analysis of Push Caching Modelling and Analysis of Push Caching R. G. DE SILVA School of Information Systems, Technology & Management University of New South Wales Sydney 2052 AUSTRALIA Abstract: - In e-commerce applications,

More information

Globule: a Platform for Self-Replicating Web Documents

Globule: a Platform for Self-Replicating Web Documents Globule: a Platform for Self-Replicating Web Documents Guillaume Pierre gpierre@cs.vu.nl Maarten van Steen steen@cs.vu.nl Vrije Universiteit, Division of Mathematics and Computer Science, de Boelelaan

More information

A Peer-to-Peer System to Bring Content Distribution Networks to the Masses Guillaume Pierre Vrije Universiteit, Amsterdam

A Peer-to-Peer System to Bring Content Distribution Networks to the Masses Guillaume Pierre Vrije Universiteit, Amsterdam A Peer-to-Peer System to Bring Content Distribution Networks to the Masses Guillaume Pierre Vrije Universiteit, Amsterdam 1 Introduction The nature and intensity of the traffic addressed to any given Web

More information

Achieving Scalability in Hierarchical Location Services

Achieving Scalability in Hierarchical Location Services Achieving Scalability in Hierarchical Location Services Maarten van Steen, Gerco Ballintijn Vrije Universiteit Amsterdam fsteen,gercog@cs.vu.nl Abstract Services for locating mobile objects are often organized

More information

Distributed Systems Principles and Paradigms. Chapter 12: Distributed Web-Based Systems

Distributed Systems Principles and Paradigms. Chapter 12: Distributed Web-Based Systems Distributed Systems Principles and Paradigms Maarten van Steen VU Amsterdam, Dept. Computer Science steen@cs.vu.nl Chapter 12: Distributed -Based Systems Version: December 10, 2012 Distributed -Based Systems

More information

Efficient Tracking of Mobile Objects in Globe

Efficient Tracking of Mobile Objects in Globe Efficient Tracking of Mobile Objects in Globe ALINE BAGGIO, GERCO BALLINTIJN, MAARTEN VAN STEEN AND ANDREW S. TANENBAUM Department Mathematics and Computer Science, Vrije Universiteit De Boelelaan 1081a,

More information

Computer Networks. Wenzhong Li. Nanjing University

Computer Networks. Wenzhong Li. Nanjing University Computer Networks Wenzhong Li Nanjing University 1 Chapter 8. Internet Applications Internet Applications Overview Domain Name Service (DNS) Electronic Mail File Transfer Protocol (FTP) WWW and HTTP Content

More information

Server Selection Mechanism. Server Selection Policy. Content Distribution Network. Content Distribution Networks. Proactive content replication

Server Selection Mechanism. Server Selection Policy. Content Distribution Network. Content Distribution Networks. Proactive content replication Content Distribution Network Content Distribution Networks COS : Advanced Computer Systems Lecture Mike Freedman Proactive content replication Content provider (e.g., CNN) contracts with a CDN CDN replicates

More information

Network Working Group

Network Working Group Network Working Group Internet-Draft Intended status: Experimental Expires: January 13, 2011 R. Penno S. Raghunath J. Medved M. Bakshi Juniper Networks R. Alimi Yale University S. Previdi Cisco Systems

More information

A New Architecture for HTTP Proxies Using Workstation Caches

A New Architecture for HTTP Proxies Using Workstation Caches A New Architecture for HTTP Proxies Using Workstation Caches Author Names : Prabhakar T V (tvprabs@cedt.iisc.ernet.in) R. Venkatesha Prasad (vprasad@cedt.iisc.ernet.in) Kartik M (kartik_m@msn.com) Kiran

More information

TECHNISCHE UNIVERSITEIT EINDHOVEN Faculteit Wiskunde en Informatica

TECHNISCHE UNIVERSITEIT EINDHOVEN Faculteit Wiskunde en Informatica TECHNISCHE UNIVERSITEIT EINDHOVEN Faculteit Wiskunde en Informatica Examination Architecture of Distributed Systems (2IMN10 / 2II45), on Monday November 2, 2015, from 13.30 to 16.30 hours. Indicate on

More information

Web, HTTP, Caching, CDNs

Web, HTTP, Caching, CDNs Web, HTTP, Caching, CDNs Outline Web HyperText Transfer Protocol (HTTP) Inefficiencies in HTTP HTTP Persistent Connections Caching CDNs Consistent Hashing CS 640 1 Web Original goal of the web: mechanism

More information

Internet Caching Architecture

Internet Caching Architecture GET http://server.edu/file.html HTTP/1.1 Caching Architecture Proxy proxy.net #/bin/csh #This script NCSA mosaic with a proxy setenv http_proxy http://proxy.net:8001 setenv ftp_proxy http://proxy.net:8001

More information

CS555: Distributed Systems [Fall 2017] Dept. Of Computer Science, Colorado State University

CS555: Distributed Systems [Fall 2017] Dept. Of Computer Science, Colorado State University CS 555: DISTRIBUTED SYSTEMS [P2P SYSTEMS] Shrideep Pallickara Computer Science Colorado State University Frequently asked questions from the previous class survey Byzantine failures vs malicious nodes

More information

Web File Transmission by Object Packaging Performance Comparison with HTTP 1.0 and HTTP 1.1 Persistent Connection

Web File Transmission by Object Packaging Performance Comparison with HTTP 1.0 and HTTP 1.1 Persistent Connection Web File Transmission by Performance Comparison with and Hiroshi Fujinoki, Murugesan Sanjay, and Chintan Shah Department of Computer Science Southern Illinois University at Edwardsville Edwardsville, Illinois

More information

Distributed System: Definition

Distributed System: Definition 2 / 25 Introduction Distributed System: Definition Definition A distributed system is a piece of software that ensures that: a collection of independent computers appears to its users as a single coherent

More information

Distributed Systems Principles and Paradigms

Distributed Systems Principles and Paradigms Distributed Systems Principles and Paradigms Chapter 01 (version September 5, 2007) Maarten van Steen Vrije Universiteit Amsterdam, Faculty of Science Dept. Mathematics and Computer Science Room R4.20.

More information

Chapter 6: Distributed Systems: The Web. Fall 2012 Sini Ruohomaa Slides joint work with Jussi Kangasharju et al.

Chapter 6: Distributed Systems: The Web. Fall 2012 Sini Ruohomaa Slides joint work with Jussi Kangasharju et al. Chapter 6: Distributed Systems: The Web Fall 2012 Sini Ruohomaa Slides joint work with Jussi Kangasharju et al. Chapter Outline Web as a distributed system Basic web architecture Content delivery networks

More information

Internet Mail: The SMTP Model

Internet Mail: The SMTP Model Internet Mail: The SMTP Model User File System Sender- SMTP SMTP Commands Replies Receiver- SMTP File System Simple Mail Transfer Protocol (SMTP) to transfer e-mails Depending on the operating system,

More information

Today: World Wide Web! Traditional Web-Based Systems!

Today: World Wide Web! Traditional Web-Based Systems! Today: World Wide Web! WWW principles Case Study: web caching as an illustrative example Invalidate versus updates Push versus Pull Cooperation between replicas Lecture 22, page 1 Traditional Web-Based

More information

Seamlessly Selecting the Best Copy from Internet-Wide Replicated Web Servers

Seamlessly Selecting the Best Copy from Internet-Wide Replicated Web Servers Seamlessly Selecting the Best Copy from Internet-Wide Replicated Web Servers Yair Amir, Alec Peterson, and David Shaw Department of Computer Science Johns Hopkins University {yairamir, chuckie, dshaw}@cs.jhu.edu

More information

EECS 122: Introduction to Computer Networks DNS and WWW. Internet Names & Addresses

EECS 122: Introduction to Computer Networks DNS and WWW. Internet Names & Addresses EECS 122: Introduction to Computer Networks DNS and WWW Computer Science Division Department of Electrical Engineering and Computer Sciences University of California, Berkeley Berkeley, CA 94720-1776 Internet

More information

Replication in Distributed Systems

Replication in Distributed Systems Replication in Distributed Systems Replication Basics Multiple copies of data kept in different nodes A set of replicas holding copies of a data Nodes can be physically very close or distributed all over

More information

Applying Sequential Consistency to Web Caching

Applying Sequential Consistency to Web Caching Applying Sequential Consistency to Web Caching Francisco J. Torres-Rojas and Esteban Meneses Abstract Web caches have several advantages for reducing the server load, minimizing the network traffic and

More information

Exploiting Location Awareness for Scalable Location-Independent Object IDs

Exploiting Location Awareness for Scalable Location-Independent Object IDs Exploiting Location Awareness for Scalable Location-Independent Object IDs Gerco Ballintijn Maarten van Steen Andrew S. Tanenbaum Vrije Universiteit, Department of Mathematics and Computer Science, De

More information

Chapter 3: Naming Page 38. Clients in most cases find the Jini lookup services in their scope by IP

Chapter 3: Naming Page 38. Clients in most cases find the Jini lookup services in their scope by IP Discovery Services - Jini Discovery services require more than search facilities: Discovery Clients in most cases find the Jini lookup services in their scope by IP multicast/broadcast Multicast UDP for

More information

OpenCache. A Platform for Efficient Video Delivery. Matthew Broadbent. 1 st Year PhD Student

OpenCache. A Platform for Efficient Video Delivery. Matthew Broadbent. 1 st Year PhD Student OpenCache A Platform for Efficient Video Delivery Matthew Broadbent 1 st Year PhD Student Motivation Consumption of video content on the Internet is constantly expanding Video-on-demand is an ever greater

More information

State-of-the-art of Content Delivery Network

State-of-the-art of Content Delivery Network State-of-the-art of Content Delivery Network Manish Gupta, Dharmendra Kumar Department of Computer Science & Engineering, Uttar Pradesh Technical University United College of Engineering & Research, Allahabad,

More information

EEC-682/782 Computer Networks I

EEC-682/782 Computer Networks I EEC-682/782 Computer Networks I Lecture 20 Wenbing Zhao w.zhao1@csuohio.edu http://academic.csuohio.edu/zhao_w/teaching/eec682.htm (Lecture nodes are based on materials supplied by Dr. Louise Moser at

More information

PERSONAL communications service (PCS) provides

PERSONAL communications service (PCS) provides 646 IEEE/ACM TRANSACTIONS ON NETWORKING, VOL. 5, NO. 5, OCTOBER 1997 Dynamic Hierarchical Database Architecture for Location Management in PCS Networks Joseph S. M. Ho, Member, IEEE, and Ian F. Akyildiz,

More information

1 Connectionless Routing

1 Connectionless Routing UCSD DEPARTMENT OF COMPUTER SCIENCE CS123a Computer Networking, IP Addressing and Neighbor Routing In these we quickly give an overview of IP addressing and Neighbor Routing. Routing consists of: IP addressing

More information

Send me up to 5 good questions in your opinion, I ll use top ones Via direct message at slack. Can be a group effort. Try to add some explanation.

Send me up to 5 good questions in your opinion, I ll use top ones Via direct message at slack. Can be a group effort. Try to add some explanation. Notes Midterm reminder Second midterm next week (04/03), regular class time 20 points, more questions than midterm 1 non-comprehensive exam: no need to study modules before midterm 1 Online testing like

More information

DISTRIBUTED SYSTEMS. Second Edition. Andrew S. Tanenbaum Maarten Van Steen. Vrije Universiteit Amsterdam, 7'he Netherlands PEARSON.

DISTRIBUTED SYSTEMS. Second Edition. Andrew S. Tanenbaum Maarten Van Steen. Vrije Universiteit Amsterdam, 7'he Netherlands PEARSON. DISTRIBUTED SYSTEMS 121r itac itple TAYAdiets Second Edition Andrew S. Tanenbaum Maarten Van Steen Vrije Universiteit Amsterdam, 7'he Netherlands PEARSON Prentice Hall Upper Saddle River, NJ 07458 CONTENTS

More information

Distributed Systems Principles and Paradigms

Distributed Systems Principles and Paradigms Distributed Systems Principles and Paradigms Chapter 02 (version September 5, 2007) Maarten van Steen Vrije Universiteit Amsterdam, Faculty of Science Dept. Mathematics and Computer Science Room R4.20.

More information

Hypertext Transport Protocol HTTP/1.1

Hypertext Transport Protocol HTTP/1.1 Hypertext Transport Protocol HTTP/1.1 Jim Gettys Digital Equipment Corporation, ISBU Visiting Scientist, World Wide Web Consortium 10/17/96 20-Apr-01 1 Acknowledgments HTTP/1.1 Authors Roy Fielding (UCI)

More information

expires in six months October 1997 Internet Public Key Infrastructure Operational Protocols: FTP and HTTP <draft-ietf-pkix-opp-ftp-http-01.

expires in six months October 1997 Internet Public Key Infrastructure Operational Protocols: FTP and HTTP <draft-ietf-pkix-opp-ftp-http-01. HTTP/1.1 200 OK Date: Tue, 09 Apr 2002 06:26:48 GMT Server: Apache/1.3.20 (Unix) Last-Modified: Tue, 21 Oct 1997 17:15:00 GMT ETag: "361b18-2953-344ce314" Accept-Ranges: bytes Content-Length: 10579 Connection:

More information

Information About NAT

Information About NAT CHAPTER 27 This chapter provides an overview of how Network Address Translation (NAT) works on the adaptive security appliance. This chapter includes the following sections: Why Use NAT?, page 27-1 NAT

More information

Internet Content Distribution

Internet Content Distribution Internet Content Distribution Chapter 1: Introduction Jussi Kangasharju Chapter Outline Introduction into content distribution Basic concepts TCP DNS HTTP Outline of the rest of the course Kangasharju:

More information

Distributed Systems. 21. Content Delivery Networks (CDN) Paul Krzyzanowski. Rutgers University. Fall 2018

Distributed Systems. 21. Content Delivery Networks (CDN) Paul Krzyzanowski. Rutgers University. Fall 2018 Distributed Systems 21. Content Delivery Networks (CDN) Paul Krzyzanowski Rutgers University Fall 2018 1 2 Motivation Serving web content from one location presents problems Scalability Reliability Performance

More information

CS November 2018

CS November 2018 Distributed Systems 21. Delivery Networks (CDN) Paul Krzyzanowski Rutgers University Fall 2018 1 2 Motivation Serving web content from one location presents problems Scalability Reliability Performance

More information

Web File Transmission by Object Packaging Performance Comparison with HTTP 1.0 and HTTP 1.1 Persistent Connection

Web File Transmission by Object Packaging Performance Comparison with HTTP 1.0 and HTTP 1.1 Persistent Connection Web File Transmission by Performance Comparison with HTTP 1. and Hiroshi Fujinoki, Murugesan Sanjay, and Chintan Shah Department of Computer Science Southern Illinois University at Edwardsville Edwardsville,

More information

Web Replica Hosting Systems Design

Web Replica Hosting Systems Design Web Replica Hosting Systems Design Swaminathan Sivasubramanian Michał Szymaniak Guillaume Pierre Maarten van Steen Dept. of Computer Science Vrije Universiteit, Amsterdam, The Netherlands swami,michal,gpierre,steen

More information

TECHNISCHE UNIVERSITEIT EINDHOVEN Faculteit Wiskunde en Informatica

TECHNISCHE UNIVERSITEIT EINDHOVEN Faculteit Wiskunde en Informatica TECHNISCHE UNIVERSITEIT EINDHOVEN Faculteit Wiskunde en Informatica Examination Architecture of Distributed Systems (2IMN10), on Monday November 7, 2016, from 13.30 to 16.30 hours. Before you start, read

More information

Naming. Naming entities

Naming. Naming entities Naming Naming entities Locating mobile entities Removing unreferenced entities 1 Name: Just a string Naming entities used to denote entity in a system Identifier: Uniquely refers to an entity Each entity

More information

Computer Networks. More on Standards & Protocols Quality of Service. Week 10. College of Information Science and Engineering Ritsumeikan University

Computer Networks. More on Standards & Protocols Quality of Service. Week 10. College of Information Science and Engineering Ritsumeikan University Computer Networks More on Standards & Protocols Quality of Service Week 10 College of Information Science and Engineering Ritsumeikan University Introduction to Protocols l A protocol is a set of rules

More information

Democratizing Content Publication with Coral

Democratizing Content Publication with Coral Democratizing Content Publication with Mike Freedman Eric Freudenthal David Mazières New York University NSDI 2004 A problem Feb 3: Google linked banner to julia fractals Users clicking directed to Australian

More information

Content Distribu-on Networks (CDNs)

Content Distribu-on Networks (CDNs) Second Half of the Course Content Distribu-on Networks (CDNs) Mike Freedman COS 461: Computer Networks h@p://www.cs.princeton.edu/courses/archive/spr14/cos461/ Applica-on case studies Content distribu-on,

More information

Last Class: Consistency Models. Today: Implementation Issues

Last Class: Consistency Models. Today: Implementation Issues Last Class: Consistency Models Need for replication Data-centric consistency Strict, linearizable, sequential, causal, FIFO Lecture 15, page 1 Today: Implementation Issues Replica placement Use web caching

More information

A Content Delivery Service for Federated PaaS Environments

A Content Delivery Service for Federated PaaS Environments Parallel and Distributed Computer Systems Master Thesis A Content Delivery Service for Federated PaaS Environments Author: Claudiu Dan Gheorghe Student no. 2115786 Advisor: Prof. Guillaume Pierre Abstract

More information

LECTURE 8. Mobile IP

LECTURE 8. Mobile IP 1 LECTURE 8 Mobile IP What is Mobile IP? The Internet protocol as it exists does not support mobility Mobile IP tries to address this issue by creating an anchor for a mobile host that takes care of packet

More information

SaaS Providers. ThousandEyes for. Summary

SaaS Providers. ThousandEyes for. Summary USE CASE ThousandEyes for SaaS Providers Summary With Software-as-a-Service (SaaS) applications rapidly replacing onpremise solutions, the onus of ensuring a great user experience for these applications

More information

Integrating Fragmented Objects into a CORBA Environment

Integrating Fragmented Objects into a CORBA Environment Integrating ed Objects into a CORBA Environment Hans P. Reiser 1, Franz J. Hauck 2, Rüdiger Kapitza 1, and Andreas I. Schmied 2 1 Dept. of Distributed Systems and Operating System, University of Erlangen-

More information

3GPP TSG SA WG3 Security SA3#33 S May 2004 Beijing, China

3GPP TSG SA WG3 Security SA3#33 S May 2004 Beijing, China 3GPP TSG SA WG3 Security SA3#33 S3-040337 10-14 May 2004 Beijing, China Source: Title: Nokia Shared key TLS usage within Ua interface Document for: Discussion and decision Agenda Item: GAA 1 Introduction

More information

CONSISTENCY IN DISTRIBUTED SYSTEMS

CONSISTENCY IN DISTRIBUTED SYSTEMS CONSISTENCY IN DISTRIBUTED SYSTEMS 35 Introduction to Consistency Need replication in DS to enhance reliability/performance. In Multicasting Example, major problems to keep replicas consistent. Must ensure

More information

Assignment 5. Georgia Koloniari

Assignment 5. Georgia Koloniari Assignment 5 Georgia Koloniari 2. "Peer-to-Peer Computing" 1. What is the definition of a p2p system given by the authors in sec 1? Compare it with at least one of the definitions surveyed in the last

More information

Module 7 - Replication

Module 7 - Replication Module 7 - Replication Replication Why replicate? Reliability Avoid single points of failure Performance Scalability in numbers and geographic area Why not replicate? Replication transparency Consistency

More information

What is the relationship between a domain name (e.g., youtube.com) and an IP address?

What is the relationship between a domain name (e.g., youtube.com) and an IP address? DNS, CDNs March 30, 2009 Lecture 14 Sam Madden DNS What is the relationship between a domain name (e.g., youtube.com) and an IP address? DNS is the system that determines this mapping. Basic idea: You

More information

Infoblox Authenticated DHCP

Infoblox Authenticated DHCP Infoblox Authenticated DHCP Unified Visitor Management amigopod Technical Note Revision 1.1 5 July 2010 United States of America +1 (888) 590-0882 Europe, Middle East & Asia +34 91 766 57 22 Australia

More information

TECHNISCHE UNIVERSITEIT EINDHOVEN Faculteit Wiskunde en Informatica

TECHNISCHE UNIVERSITEIT EINDHOVEN Faculteit Wiskunde en Informatica TECHNISCHE UNIVERSITEIT EINDHOVEN Faculteit Wiskunde en Informatica Examination Architecture of Distributed Systems (2IMN10), on Thursday, January 25, 2018, from 18.00 to 21.00 hours. Before you start,

More information

Content Delivery on the Web: HTTP and CDNs

Content Delivery on the Web: HTTP and CDNs Content Delivery on the Web: HTTP and CDNs Mark Handley UCL Computer Science CS 3035/GZ01 Outline The Web: HTTP and caching The Hypertext Transport Protocol: HTTP HTTP performance Persistent and concurrent

More information

Presented By: Devarsh Patel

Presented By: Devarsh Patel : Amazon s Highly Available Key-value Store Presented By: Devarsh Patel CS5204 Operating Systems 1 Introduction Amazon s e-commerce platform Requires performance, reliability and efficiency To support

More information

ECE 7650 Scalable and Secure Internet Services and Architecture ---- A Systems Perspective

ECE 7650 Scalable and Secure Internet Services and Architecture ---- A Systems Perspective ECE 7650 Scalable and Secure Internet Services and Architecture ---- A Systems Perspective Part II: Data Center Software Architecture: Topic 3: Programming Models CIEL: A Universal Execution Engine for

More information

UNIVERSITY OF CAGLIARI

UNIVERSITY OF CAGLIARI UNIVERSITY OF CAGLIARI DIEE - Department of Electrical and Electronic Engineering Infrastrutture ed Applicazioni Avanzate nell Internet SDN: Control Plane ACK: content taken from Foundations of Modern

More information

Web caches (proxy server) Applications (part 3) Applications (part 3) Caching example (1) More about Web caching

Web caches (proxy server) Applications (part 3) Applications (part 3) Caching example (1) More about Web caching By the end of this lecture, you should be able to. Explain the idea of edge delivery Explain the operation of CDNs Explain the operation of P2P file sharing systems such as Napster and Gnutella Web caches

More information

Democratizing Content Publication with Coral

Democratizing Content Publication with Coral Democratizing Content Publication with Mike Freedman Eric Freudenthal David Mazières New York University www.scs.cs.nyu.edu/coral A problem Feb 3: Google linked banner to julia fractals Users clicking

More information

Naming. To do. q What s in a name q Flat naming q Structured naming q Attribute-based naming q Next: Content distribution networks

Naming. To do. q What s in a name q Flat naming q Structured naming q Attribute-based naming q Next: Content distribution networks Naming To do q What s in a name q Flat naming q Structured naming q Attribute-based naming q Next: Content distribution networks What's in a name? That which we call a rose By any other name would smell

More information

Locating Objects in Wide-Area Systems

Locating Objects in Wide-Area Systems Locating Objects in Wide-Area Systems Maarten van Steen (contact) Vrije Universiteit, Department of Mathematics & Computer Science De Boelelaan 1081a, 1081 HV, Amsterdam, The Netherlands tel: +31 (0)20

More information

Analysis of the effects of removing redundant header information in persistent HTTP connections

Analysis of the effects of removing redundant header information in persistent HTTP connections Analysis of the effects of removing redundant header information in persistent HTTP connections Timothy Bower, Daniel Andresen, David Bacon Department of Computing and Information Sciences 234 Nichols

More information

Configuring WebConnect

Configuring WebConnect CHAPTER 6 WebConnect provides seamless integration between multiple internal and external web servers through a single URL. Making use of a single database and a customer-defined rollover sequence, WebConnect

More information

A Protocol for exchanging performance data in Content Distribution Internetworks*

A Protocol for exchanging performance data in Content Distribution Internetworks* A Protocol for exchanging performance data in Content Distribution Internetworks* Elisa Turrini, Vittorio Ghini Dipartimento di Scienze dell Informazione via Mura Anteo Zanboni, 7-40127 Bologna Tel: +39

More information

Dolby Conference Phone 3.1 configuration guide for West

Dolby Conference Phone 3.1 configuration guide for West Dolby Conference Phone 3.1 configuration guide for West 17 January 2017 Copyright 2017 Dolby Laboratories. All rights reserved. For information, contact: Dolby Laboratories, Inc. 1275 Market Street San

More information

DEPLOYMENT GUIDE Version 1.1. DNS Traffic Management using the BIG-IP Local Traffic Manager

DEPLOYMENT GUIDE Version 1.1. DNS Traffic Management using the BIG-IP Local Traffic Manager DEPLOYMENT GUIDE Version 1.1 DNS Traffic Management using the BIG-IP Local Traffic Manager Table of Contents Table of Contents Introducing DNS server traffic management with the BIG-IP LTM Prerequisites

More information

Distributed Systems are Everywhere!" CS162 Operating Systems and Systems Programming Lecture 22 Client-Server" Client-Server" Message Passing"

Distributed Systems are Everywhere! CS162 Operating Systems and Systems Programming Lecture 22 Client-Server Client-Server Message Passing CS162 Operating Systems and Systems Programming Lecture 22 Client- April 18, 2011! Ion Stoica! http://inst.eecs.berkeley.edu/~cs162! Distributed Systems are Everywhere!" We need (want?) to share physical

More information

Distributed Systems Principles and Paradigms

Distributed Systems Principles and Paradigms Distributed Systems Principles and Paradigms Chapter 03 (version February 11, 2008) Maarten van Steen Vrije Universiteit Amsterdam, Faculty of Science Dept. Mathematics and Computer Science Room R4.20.

More information

Announcements. The World Wide Web. Retrieving From the Server. Goals of Today s Lecture. The World Wide Web. POP3 Protocol

Announcements. The World Wide Web. Retrieving  From the Server. Goals of Today s Lecture. The World Wide Web. POP3 Protocol Announcements The World Wide Web Project #2 out Checkpoint due Weds Oct 18 Full project due Thurs Oct 26 EE 122: Intro to Communication Networks Fall 2006 (MW 4-5:30 in Donner 155) Vern Paxson TAs: Dilip

More information

Improving HTTP Caching Proxy Performance with TCP Tap

Improving HTTP Caching Proxy Performance with TCP Tap Improving HTTP Caching Proxy Performance with TCP Tap David A. Maltz Dept. of Computer Science Carnegie Mellon University dmaltz@cs.cmu.edu Pravin Bhagwat IBM T.J. Watson Research Center pravin@watson.ibm.com

More information

The World Wide Web. EE 122: Intro to Communication Networks. Fall 2006 (MW 4-5:30 in Donner 155) Vern Paxson TAs: Dilip Antony Joseph and Sukun Kim

The World Wide Web. EE 122: Intro to Communication Networks. Fall 2006 (MW 4-5:30 in Donner 155) Vern Paxson TAs: Dilip Antony Joseph and Sukun Kim The World Wide Web EE 122: Intro to Communication Networks Fall 2006 (MW 4-5:30 in Donner 155) Vern Paxson TAs: Dilip Antony Joseph and Sukun Kim http://inst.eecs.berkeley.edu/~ee122/ Materials with thanks

More information

Mul$media Networking. #9 CDN Solu$ons Semester Ganjil 2012 PTIIK Universitas Brawijaya

Mul$media Networking. #9 CDN Solu$ons Semester Ganjil 2012 PTIIK Universitas Brawijaya Mul$media Networking #9 CDN Solu$ons Semester Ganjil 2012 PTIIK Universitas Brawijaya Schedule of Class Mee$ng 1. Introduc$on 2. Applica$ons of MN 3. Requirements of MN 4. Coding and Compression 5. RTP

More information

mslp - Mesh-enhanced Service Location Protocol Λ

mslp - Mesh-enhanced Service Location Protocol Λ mslp - Mesh-enhanced Service Location Protocol Λ Weibin Zhao and Henning Schulzrinne Department of Computer Science Columbia University, New York, NY 10027 fzwb, hgsg@cs.columbia.edu Abstract The Service

More information

Deployment Scenarios for Standalone Content Engines

Deployment Scenarios for Standalone Content Engines CHAPTER 3 Deployment Scenarios for Standalone Content Engines This chapter introduces some sample scenarios for deploying standalone Content Engines in enterprise and service provider environments. This

More information

416 Distributed Systems. March 23, 2018 CDNs

416 Distributed Systems. March 23, 2018 CDNs 416 Distributed Systems March 23, 2018 CDNs Outline DNS Design (317) Content Distribution Networks 2 Typical Workload (Web Pages) Multiple (typically small) objects per page File sizes are heavy-tailed

More information

Outline Computer Networking. HTTP Basics (Review) How to Mark End of Message? (Review)

Outline Computer Networking. HTTP Basics (Review) How to Mark End of Message? (Review) Outline 15-441 Computer Networking Lecture 25 The Web HTTP review and details (more in notes) Persistent HTTP review HTTP caching Content distribution networks Lecture 19: 2006-11-02 2 HTTP Basics (Review)

More information

Traditional Web Based Systems

Traditional Web Based Systems Chapter 12 Distributed Web Based Systems 1 Traditional Web Based Systems The Web is a huge distributed system consisting of millions of clients and servers for accessing linked documents Servers maintain

More information

Practical Large-Scale Latency Estimation

Practical Large-Scale Latency Estimation Practical Large-Scale Latency Estimation Michal Szymaniak David Presotto Guillaume Pierre Maarten van Steen Vrije Universiteit Amsterdam, The Netherlands Google Inc. Abstract We present the implementation

More information

ThousandEyes for. Application Delivery White Paper

ThousandEyes for. Application Delivery White Paper ThousandEyes for Application Delivery White Paper White Paper Summary The rise of mobile applications, the shift from on-premises to Software-as-a-Service (SaaS), and the reliance on third-party services

More information

Advanced Network Approaches for Wireless Environment

Advanced Network Approaches for Wireless Environment Advanced Network Approaches for Wireless Environment Branislav JARÁBEK Slovak University of Technology Faculty of Informatics and Information Technologies Ilkovičova 3, 842 16 Bratislava, Slovakia beejay@orangemail.sk

More information

Efficient Handoff using Mobile IP and Simplified Cellular IP

Efficient Handoff using Mobile IP and Simplified Cellular IP Presented at GNSS 2004 The 2004 International Symposium on GNSS/GPS Sydney, Australia 6 8 December 2004 Efficient Handoff using Mobile IP and Simplified Cellular IP S. Omar School of Surveying & Spatial

More information

Load Balancing Overview

Load Balancing Overview The "Load Balancing" feature is available only in the Barracuda Web Application Firewall 460 and above. A load balancer is a networking device that distributes traffic across multiple back-end servers

More information

Remote Patron Authentication Service (RPAS)

Remote Patron Authentication Service (RPAS) Remote Patron Authentication Service (RPAS) Technical Bulletin Last Updated: 01/22/2001 Table of Contents 1 About this Technical Bulletin... 1 1.1 Purpose...1 1.2 Intended Audience...1 1.3 Additional

More information

CSE561 Naming and DNS. David Wetherall

CSE561 Naming and DNS. David Wetherall CSE561 Naming and DNS David Wetherall djw@cs.washington.edu Naming and DNS Focus: How do we resolve names to addresses Names and addresses Application DNS as a system design Transport Network Link Physical

More information

Vital Security Supported Topologies

Vital Security Supported Topologies Vital Security Supported Topologies Software Release 9.0 Vital Security Supported Topologies Copyright Copyright 1996-2008. Finjan Software Inc. and its affiliates and subsidiaries ( Finjan ). All rights

More information

ARCHITECTURE AND IMPLEMENTATION OF A NEW USER INTERFACE FOR INTERNET SEARCH ENGINES

ARCHITECTURE AND IMPLEMENTATION OF A NEW USER INTERFACE FOR INTERNET SEARCH ENGINES ARCHITECTURE AND IMPLEMENTATION OF A NEW USER INTERFACE FOR INTERNET SEARCH ENGINES Fidel Cacheda, Alberto Pan, Lucía Ardao, Angel Viña Department of Tecnoloxías da Información e as Comunicacións, Facultad

More information

Multicast Technology White Paper

Multicast Technology White Paper Multicast Technology White Paper Keywords: Multicast, IGMP, IGMP Snooping, PIM, MBGP, MSDP, and SSM Mapping Abstract: The multicast technology implements high-efficiency point-to-multipoint data transmission

More information

Distributed Composite Objects: A New Object Model for Cooperative Applications

Distributed Composite Objects: A New Object Model for Cooperative Applications Distributed Composite Objects: A New Object Model for Cooperative Applications Guray Yilmaz 1, Nadia Erdogan 2 1 Turkish Air Force Academy, Computer Eng. Dept., Yeşilyurt, 34149 İstanbul, Turkey g.yilmaz@hho.edu.tr

More information