Chapter 6: Distributed Systems: The Web. Fall 2012 Sini Ruohomaa Slides joint work with Jussi Kangasharju et al.

Similar documents
Today: World Wide Web! Traditional Web-Based Systems!

Today: World Wide Web

Today: World Wide Web. Traditional Web-Based Systems

TechNote AltitudeCDN Multicast+ and OmniCache Support for Citrix

Internet Content Distribution

Web as a Distributed System

Distributed Systems Principles and Paradigms. Chapter 12: Distributed Web-Based Systems

From Internet Data Centers to Data Centers in the Cloud

Last Class: Consistency Models. Today: Implementation Issues

CPE731 Distributed System Models

Computer Networks. HTTP and more. Jianping Pan Spring /20/17 CSC361 1

Web caches (proxy server) Applications (part 3) Applications (part 3) Caching example (1) More about Web caching

CCDP-ARCH. Section 11. Content Networking

What is the relationship between a domain name (e.g., youtube.com) and an IP address?

Help! I need more servers! What do I do?

Outline. Distributed Computing Systems. The Rise of Distributed Systems. Depiction of a Distributed System 4/15/2014

Web, HTTP, Caching, CDNs

CSE 123b Communications Software

Deployment Scenarios for Standalone Content Engines

Today s class. CSE 123b Communications Software. Telnet. Network File System (NFS) Quick descriptions of some other sample applications

Lecture 9: MIMD Architectures

416 Distributed Systems. March 23, 2018 CDNs

Large-Scale Web Applications

CSc 450/550 Computer Networks Domain Name System

Distributed Systems. 21. Content Delivery Networks (CDN) Paul Krzyzanowski. Rutgers University. Fall 2018

CS November 2018

CS4513 Distributed Computer Systems

Chapter 2 Application Layer

Replication. Consistency models. Replica placement Distribution protocols

Design and implementation of an MPLS based load balancing architecture for Web switching

Mul$media Networking. #9 CDN Solu$ons Semester Ganjil 2012 PTIIK Universitas Brawijaya

CompSci 356: Computer Network Architectures Lecture 21: Overlay Networks Chap 9.4. Xiaowei Yang

Consistency and Replication

CSE398: Network Systems Design

Replication architecture

Database Management Systems

Overview Computer Networking Lecture 16: Delivering Content: Peer to Peer and CDNs Peter Steenkiste

Consistency and Replication (part b)

TechNote AltitudeCDN OmniCache Integration with Microsoft Teams Live Events

Content Distribution Networks

Democratizing Content Publication with Coral

COMP6218: Content Caches. Prof Leslie Carr

Fundamentals of Windows Server 2008 Network and Applications Infrastructure

AD FS v3. Deployment Guide

OpenCache. A Platform for Efficient Video Delivery. Matthew Broadbent. 1 st Year PhD Student

Announcements. me your survey: See the Announcements page. Today. Reading. Take a break around 10:15am. Ack: Some figures are from Coulouris

Configuring Cache Services Using the Web Cache Communication Protocol

Course AZ-100T01-A: Manage Subscriptions and Resources

Computer Networks. Domain Name System. Jianping Pan Spring /25/17 CSC361 1

Client Server & Distributed System. A Basic Introduction

Write a technical report Present your results Write a workshop/conference paper (optional) Could be a real system, simulation and/or theoretical

Computer Networks. Wenzhong Li. Nanjing University

Part 12 殷亚凤. Homepage: Room 301, Building of Computer Science and Technology

Chapter 4: Distributed Systems: Replication and Consistency. Fall 2013 Jussi Kangasharju

What If Everyone Did It? Geoff Huston APNIC Labs

TECHNISCHE UNIVERSITEIT EINDHOVEN Faculteit Wiskunde en Informatica

Configuring Web Cache Services By Using WCCP

Send me up to 5 good questions in your opinion, I ll use top ones Via direct message at slack. Can be a group effort. Try to add some explanation.

Democratizing Content Publication with Coral

Server Selection Mechanism. Server Selection Policy. Content Distribution Network. Content Distribution Networks. Proactive content replication

CSE 124: QUANTIFYING PERFORMANCE AT SCALE AND COURSE REVIEW. George Porter December 6, 2017

CS November 2017

internet technologies and standards

Distributed Data Infrastructures, Fall 2017, Chapter 2. Jussi Kangasharju

Service Mesh and Microservices Networking

Chapter 1: Distributed Systems: What is a distributed system? Fall 2013

Distributed Systems LEEC (2006/07 2º Sem.)

Content Delivery on the Web: HTTP and CDNs

EEC-682/782 Computer Networks I

Consistency & Replication

Department of Computer Science Institute for System Architecture, Chair for Computer Networks. Caching, Content Distribution and Load Balancing

Yet another redirection mechanism for the World-Wide Web?

Verifying the Internet Streamer CDS

Deploying the BIG-IP System v10 with Oracle s BEA WebLogic

Introduction to Distributed Systems. INF5040/9040 Autumn 2018 Lecturer: Eli Gjørven (ifi/uio)

MEMORY. Objectives. L10 Memory

elasticsearch The Road to a Distributed, (Near) Real Time, Search Engine Shay Banon

TechNote AltitudeCDN Multicast+ Integration with IBM Cloud Streaming Manager for Enterprise

THE DATACENTER AS A COMPUTER AND COURSE REVIEW

John S. Otto Mario A. Sánchez John P. Rula Fabián E. Bustamante

CS 347 Parallel and Distributed Data Processing

Scaling Data Center Application Infrastructure. Gary Orenstein, Gear6

WCCPv2 and WCCP Enhancements

CSE/EE 461 HTTP and the Web

CS 347 Parallel and Distributed Data Processing

Organisasi Sistem Komputer

Agha Mohammad Haidari General ICT Manager in Ministry of Communication & IT Cell#

State-of-the-art of Content Delivery Network

Network Address Translation (NAT)

Parallel Processors. Session 1 Introduction

Files/News/Software Distribution on Demand. Replicated Internet Sites. Means of Content Distribution. Computer Networks 11/9/2009

Content Distribution. Today. l Challenges of content delivery l Content distribution networks l CDN through an example

Reza Tourani, Satyajayant (Jay) Misra, Travis Mick

CE693: Adv. Computer Networking

More on Testing and Large Scale Web Apps

Distributed redirection for the World-Wide Web

Handout 3 Multiprocessor and thread level parallelism

ETSI TS V3.1.1 ( ) Technical Specification

A Guide to Architecting the Active/Active Data Center

Lecture 1: January 22

Transcription:

Chapter 6: Distributed Systems: The Web Fall 2012 Sini Ruohomaa Slides joint work with Jussi Kangasharju et al.

Chapter Outline Web as a distributed system Basic web architecture Content delivery networks Replication of web applications 2

Web: Distributed or Not? Is the web a distributed system? Recall our definition: Collection of independent computers OK Appears as single coherent system?!? Single coherent system = transparencies fulfilled? Sharing of resources OK 3

Traditional Web-Based Systems 4

Multitiered Architectures 5

Important Elements Browser Servers and server farms Proxies Caching proxies 6

Browsers the stereotypical Web Clients Figure 12-5. The logical components of a Web browser. 7

Clients With a Proxy Terminology: Proxy = simply proxying of requests and responses Caching proxy = proxy with a cache Commonly proxy = caching proxy 8

Web Server Clusters: Against Overload (1) Redirection independent of requested content 9

Web Server Clusters (2) Figure 12-9. A scalable content-aware cluster of Web servers. A content-aware cluster redirecting requests selectively. 10

Content-aware vs. Content-agnostic Content-aware server selection: Allows fine-grained selection and allocation of resources Higher overhead at redirection point No need to replicate all content on all servers Content-agnostic server selection: Typically DNS load balancing All servers must have identical content Very high traffic Even load distribution 11

Web Proxy Cooperative Caching 12

Refresher: Names in the Web 13

Why Are Names Important? (1) URLs identify content on the web URL is location-based: data lives on a server URL typically identifies origin server by name DNS Can do many tricks with DNS DNS load balancing for server farms DNS redirection for Content Delivery Networks (CDN) 14

Why Are Names Important? (2) DNS as a distributed system: See homework 3. Alternative approach: Content-Centric Networking Content floats around in the web Location-independent names: e.g. URNs, DOIs (cf. ISBN) Identify content by name, not the server it is on Need a tracking service to find a server for a document Current research topic: how to route content effectively E.g. multicast for a video stream instead of 10k separate connections one for each concurrent viewer 15

Web Hosting With a Cloudful of Servers The principal working of the Akamai Content Delivery Network. 16

Total Redirection in Content Delivery Networks Any request for origin server is redirected to CDN CDN takes control of content provider s DNS zone Benefit: All requests are automatically redirected Disadvantage: May send lots of traffic to CDN, hence expensive for the content provider 17

Selective Redirection Content provider marks which objects are to be served from CDN Typically, larger objects like images are selected Refer to images as: <img src=http://cdn.com/foo/bar/img.gif> When client wants to retrieve image, DNS request for cdn.com gets resolved by CDN and image is fetched from the selected content server Pro: Fine-grained control over what gets delivered Con: Have to (manually) mark content for CDN 18

Replication of Applications Originally only replication of static content Can also replicate applications Recall: Application = Server + Database Replication of applications = Replication of database Full or partial replication of database? Amount of data? Updates? Query containment? Warehouse-scale computing (see next chapter) 19

Replication of Applications Figure 12-21. Alternatives for caching and replication with Web applications. 20

Chapter Summary Web as a distributed system Basic web architecture Content delivery networks Replication of web applications 21