An HTTP-Based Versioning Mechanism for Linked Data. Presentation at

Size: px
Start display at page:

Download "An HTTP-Based Versioning Mechanism for Linked Data. Presentation at"

Transcription

1 Herbert Van de Sompel Robert Sanderson Michael L. Nelson Lyudmila Balakireva Harihar Shankar Scott Ainsworth Memento is partially funded by the Library of Congress Presentation at

2 Time-Series Analysis across DBpedia Versions Data collected through HTTP Navigation

3 Outline Memento - Time Travel for the Web Resource Versioning suggested by Memento Resource Versioning for Linked Data DBpedia Demonstrator

4 Outline Memento - Time Travel for the Web Resource Versioning suggested by Memento Resource Versioning for Linked Data DBpedia Demonstrator

5 Resources have Representations that Change over Time

6 Archived Resources serve prior Representations

7 Dec , 4:51:00 UTC Sep , 20:36:10 UTC Archived Resources w.cnn.com/ archived resource for title=september_11_attacks&oldid= archived resource for

8 Current and Past Web are Not Integrated Current and Past Web based on same technology. But, going from Current to Past Web is a matter of (manual) discovery. Memento wants to make going from Current to Past Web a (HTTP) protocol matter. Memento wants to integrate the Current And Past Web.

9 Vision: Navigate the Web of the Past Robots_exclusion_protocol

10 Vision: Navigate the Web of the Past Robots_exclusion_protocol Oct , 05:30:33 UTC Set browser time dial to

11 Vision: Navigate the Web of the Past Robots_exclusion_protocol Oct , 05:30:33 UTC From Wikipedia History: Version Sep , 20:49:00 UTC

12 Vision: Navigate the Web of the Past Robots Exclusion

13 Vision: Navigate the Web of the Past Oct , 05:30:33 UTC Browser time dial still at

14 Vision: Navigate the Web of the Past Oct , 05:30:33 UTC Browser time dial still at From Internet Archive: Version Nov , 06:21:04 UTC

15 The Memento Approach HTTP navigation to an archived resource by leveraging: The original resource; HTTP datetime content negotiation.

16 Mementos original resource original server archival server

17 DT-conneg with URI-G to get URI-M original resource original server TimeGate Mementos transparently negotiable resource variant resources archival server

18 HTTP Link timegate original resource original server DT-conneg with URI-G to get URI-M TimeGate Mementos transparently negotiable resource variant resources archival server

19 Memento HTTP Flow HEAD R, (Accept-Datetime) Link G GET G, Accept-Datetime 302 M, Vary, TCN, Link R,M GET M, (Accept-Datetime) 200, Content-Datetime, Link R,M

20 The Memento Framework

21 Outline Memento - Time Travel for the Web Resource Versioning suggested by Memento Resource Versioning for Linked Data DBpedia Demonstrator

22

23

24

25

26

27

28

29 Prior pictures of the day Current picture of the day

30 Time Travel across Versions of a Picture of the Day Data collected through HTTP Navigation

31 Outline Memento - Time Travel for the Web Resource Versioning suggested by Memento Resource Versioning for Linked Data DBpedia Demonstrator

32

33

34

35

36 Outline Memento - Time Travel for the Web Resource Versioning suggested by Memento Resource Versioning for Linked Data DBpedia Demonstrator

37

38 Time-Series Analysis across DBpedia Versions Data collected through HTTP Navigation

39 Conclusions URI as access point to page

40 Conclusions Increased value: URI as access point to page and data

41 Conclusions Increased value: URI as access point to current & historical page and data

42 Memento wants to make navigating the Web s Past Easy

43 References Tim Berners-Lee (1996,2000) Generic Resources. Van de Sompel, H., Sanderson, R., Nelson, M.L., Balakireva, L., Ainsworth, S., Shankar, H. (2010) An HTTP-Based Versioning Mechanism for Linked Data. Proceedings of the 3rd Workshop on Linked Data on the Web. Sanderson, R., and Van de Sompel, H. (2010) Making Web Annotations Persistent over Time. Proceedings of the 10th ACM/IEEE-CS Joint Conference on Digital libraries. Van de Sompel, H., Nelson, M.L., Sanderson, R., Balakireva, L., Ainsworth, S., Shankar, H. (2009) Memento: Time Travel for the Web.

44 Memento HTTP Flow HEAD R, (Accept-Datetime) Link G GET G, Accept-Datetime 302 M, Vary, TCN, Link R,B,M GET M, (Accept-Datetime) 200, Content-Datetime, Link R,B,M

45 Memento HTTP Flow: URI-R HEAD R, (Accept-Datetime) HEAD /resource/france HTTP/1.1 Host: dbpedia.org Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8 Accept-Language: en-us,en;q=0.5 Accept-Encoding: gzip,deflate Accept-Charset: ISO ,utf-8;q=0.7,*;q=0.7

46 Memento HTTP Flow HEAD R, (Accept-Datetime) Link G GET G, Accept-Datetime 302 M, Vary, TCN, Link R,B,M GET M, (Accept-Datetime) 200, Content-Datetime, Link R,B,M

47 Memento HTTP Flow: Success URI-R Link G HTTP/ See Other Server: Virtuoso/ (Solaris) x86_64-sun-solaris VDB Connection: close Content-Type: text/html; charset=utf-8 Date: Tue, 20 Apr :48:51 GMT Accept-Ranges: bytes Location: Transfer-Encoding: chunked Content-Encoding: gzip Link: < ; rel="timegate

48 Memento HTTP Flow HEAD R, (Accept-Datetime) Link G GET G, Accept-Datetime 302 M, Vary, TCN, Link R,B,M GET M, (Accept-Datetime) 200, Content-Datetime, Link R,B,M

49 Memento HTTP Flow: URI-G GET G, Accept-Datetime GET /dbpedia/timegate/ HTTP/1.1 Host: mementoarchive.lanl.gov Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8 Accept-Language: en-us,en;q=0.5 Accept-Encoding: gzip,deflate Accept-Charset: ISO ,utf-8;q=0.7,*;q=0.7 Accept-Datetime: Wed, 08 Jul :00:00 GMT

50 Memento HTTP Flow HEAD R, (Accept-Datetime) Link G GET G, Accept-Datetime 302 M, Vary, TCN, Link R,B,M GET M, (Accept-Datetime) 200, Content-Datetime, Link R,B,M

51 Memento HTTP Flow: Success URI-G 302 M, Vary, TCN, Link R,B,M HTTP/ Found Date: Tue, 20 Apr :51:00 GMT Server: Apache TCN: choice Vary: negotiate, Accept-Datetime Location: ce.html Link: < < France.html>;rel="first-memento";datetime="Sat, 01 Sep :00:00 GMT", < France.html>;rel="last-memento next-memento";datetime="sun, 01 Nov :00:00 GMT", < France.html>;rel="prev-memento";datetime="Sat, 01 Nov :00:00 GMT", < France.html>;rel="memento";datetime="Wed, 01 Jul :00:00 GMT, < France>;rel="timebundle Transfer-Encoding: chunked

52 Memento HTTP Flow HEAD R, Accept-Datetime Link G GET G, Accept-Datetime 302 M, Vary, TCN, Link R,B,M GET M, Accept-Datetime 200, Content-Datetime, Link R,B,M

53 Memento HTTP Flow: URI-M GET M, (Accept-Datetime) GET /dbpedia/memento/ / HTTP/1.1 Host: mementoarchive.lanl.gov Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8 Accept-Language: en-us,en;q=0.5 Accept-Encoding: gzip,deflate Accept-Charset: ISO ,utf-8;q=0.7,*;q=0.7 Connection: close

54 Memento HTTP Flow HEAD R, (Accept-Datetime) Link G GET G, Accept-Datetime 302 M, Vary, TCN, Link R,B,M GET M, (Accept-Datetime) 200, Content-Datetime, Link R,B,M

55 Memento HTTP Flow: Success URI-M 200, Content-Datetime, Link R,B,M HTTP/ OK Date: Tue, 20 Apr :51:00 GMT Server: Apache Content-Datetime: Wed, 01 Jul :00:00 GMT Link: < France.html>;rel="timegate", < < France.html>;rel="first-memento";datetime="Sat, 01 Sep :00:00 GMT", < France.html>;rel="last-memento next-memento";datetime="sun, 01 Nov :00:00 GMT", < France.html>;rel="prev-memento";datetime="Sat, 01 Nov :00:00 < France.html>;rel="timebundle Connection: close Transfer-Encoding: chunked Content-Type: text/html; charset=utf-8

Memento: Time Travel for the Web

Memento: Time Travel for the Web The Memento Team Herbert Van de Sompel Michael L. Nelson Robert Sanderson Lyudmila Balakireva Scott Ainsworth Harihar Shankar Memento is partially funded by the Library of Congress Memento wants to make

More information

Memento: Time Travel for the Web

Memento: Time Travel for the Web Old Dominion University ODU Digital Commons Computer Science Presentations Computer Science 11-10-2010 Herbert Van de Sompel Michael L. Nelson Old Dominion University, mnelson@odu.edu Robert Sanderson

More information

Policies to Resolve Archived HTTP Redirection

Policies to Resolve Archived HTTP Redirection Policies to Resolve Archived HTTP Redirection ABC XYZ ABC One University Some city email@domain.com ABSTRACT HyperText Transfer Protocol (HTTP) defined a Status code (Redirection 3xx) that enables the

More information

ECE697AA Lecture 2. Today s lecture

ECE697AA Lecture 2. Today s lecture ECE697AA Lecture 2 Application Layer: HTTP Tilman Wolf Department of Electrical and Computer Engineering 09/04/08 Protocol stack Application layer Client-server architecture Example protocol: HTTP Demo

More information

Smart Routing. Requests

Smart Routing. Requests Smart Routing of Requests Martin Klein 1 Lyudmila Balakireva 1 Harihar Shankar 1 James Powell 1 Herbert Van de Sompel 2 1 Research Library Los Alamos National Laboratory 2 Data Archiving and Networked

More information

Memento: Time Travel for the Web

Memento: Time Travel for the Web Memento: Time Travel for the Web Herbert Van de Sompel Los Alamos National Laboratory, NM, USA herbertv@lanl.gov Lyudmila L. Balakireva Los Alamos National Laboratory, NM, USA ludab@lanl.gov Michael L.

More information

HashCookies A Simple Recipe

HashCookies A Simple Recipe OWASP London Chapter - 21st May 2009 HashCookies A Simple Recipe Take a cookie Add some salt Add a sequence number John Fitzpatrick Full paper at http://labs.mwrinfosecurity.com Structure What are hashcookies

More information

Getting Some REST with webmachine. Kevin A. Smith

Getting Some REST with webmachine. Kevin A. Smith Getting Some REST with webmachine Kevin A. Smith What is webmachine? Framework Framework Toolkit A toolkit for building RESTful HTTP resources What is REST? Style not a standard Resources == URLs http://localhost:8000/hello_world

More information

Application Layer: The Web and HTTP Sec 2.2 Prof Lina Battestilli Fall 2017

Application Layer: The Web and HTTP Sec 2.2 Prof Lina Battestilli Fall 2017 CSC 401 Data and Computer Communications Networks Application Layer: The Web and HTTP Sec 2.2 Prof Lina Battestilli Fall 2017 Outline Application Layer (ch 2) 2.1 principles of network applications 2.2

More information

Archival HTTP Redirection Retrieval Policies

Archival HTTP Redirection Retrieval Policies Archival HTTP Redirection Retrieval Policies Ahmed AlSum, Michael L. Nelson Old Dominion University Norfolk VA, USA {aalsum,mln}@cs.odu.edu Robert Sanderson, Herbert Van de Sompel Los Alamos National Laboratory

More information

CSCI-1680 WWW Rodrigo Fonseca

CSCI-1680 WWW Rodrigo Fonseca CSCI-1680 WWW Rodrigo Fonseca Based partly on lecture notes by Scott Shenker and John Jannotti Precursors 1945, Vannevar Bush, Memex: a device in which an individual stores all his books, records, and

More information

The HTTP protocol. Fulvio Corno, Dario Bonino. 08/10/09 http 1

The HTTP protocol. Fulvio Corno, Dario Bonino. 08/10/09 http 1 The HTTP protocol Fulvio Corno, Dario Bonino 08/10/09 http 1 What is HTTP? HTTP stands for Hypertext Transfer Protocol It is the network protocol used to delivery virtually all data over the WWW: Images

More information

CSCI-1680 WWW Rodrigo Fonseca

CSCI-1680 WWW Rodrigo Fonseca CSCI-1680 WWW Rodrigo Fonseca Based partly on lecture notes by Sco2 Shenker and John Janno6 Administrivia HW3 out today Will cover HTTP, DNS, TCP TCP Milestone II coming up on Monday Make sure you sign

More information

ResourceSync Towards a Web-Based Approach for Resource Synchronization

ResourceSync Towards a Web-Based Approach for Resource Synchronization ResourceSync Towards a Web-Based Approach for Resource Synchronization Herbert Van de Sompel Los Alamos National Laboratory @hvdsomp ResourceSync is funded by The Sloan Foundation ResourceSync Problem

More information

Establishing New Levels of Interoperability for Web-Based Scholarship

Establishing New Levels of Interoperability for Web-Based Scholarship Establishing New Levels of Interoperability for Web-Based Scholarship Los Alamos National Laboratory @hvdsomp Cartoon by: Patrick Hochstenbach Acknowledgments: Michael L. Nelson, David Rosenthal, Geoff

More information

Yioop Full Historical Indexing In Cache Navigation. Akshat Kukreti

Yioop Full Historical Indexing In Cache Navigation. Akshat Kukreti Yioop Full Historical Indexing In Cache Navigation Akshat Kukreti Agenda Introduction History Feature Cache Page Validation Feature Conclusion Demo Introduction Project goals History feature for enabling

More information

HTTP TRAFFIC CONSISTS OF REQUESTS AND RESPONSES. All HTTP traffic can be

HTTP TRAFFIC CONSISTS OF REQUESTS AND RESPONSES. All HTTP traffic can be 3 HTTP Transactions HTTP TRAFFIC CONSISTS OF REQUESTS AND RESPONSES. All HTTP traffic can be associated with the task of requesting content or responding to those requests. Every HTTP message sent from

More information

PASS4TEST. IT Certification Guaranteed, The Easy Way! We offer free update service for one year

PASS4TEST. IT Certification Guaranteed, The Easy Way!  We offer free update service for one year PASS4TEST IT Certification Guaranteed, The Easy Way! \ http://www.pass4test.com We offer free update service for one year Exam : 1Y0-351 Title : Citrix NetScaler 10.5 Essentials and Networking Vendor :

More information

CS144 Notes: Web Standards

CS144 Notes: Web Standards CS144 Notes: Web Standards Basic interaction Example: http://www.youtube.com - Q: what is going on behind the scene? * Q: What entities are involved in this interaction? * Q: What is the role of each entity?

More information

Lecture Notes course Software Development of Web Services

Lecture Notes course Software Development of Web Services Lecture Notes course 02267 Software Development of Web Services Hubert Baumeister huba@dtu.dk Fall 2014 Contents 1 Web Service Architecture 1 2 Monitoring Web Services with TCPMon 5 3 XML & Namespaces

More information

CS193i Handout #18. HTTP Part 5

CS193i Handout #18. HTTP Part 5 HTTP Part 5 HTTP Under The Hood Write a little echo server that listens for HTTP requests on port 8181, and then just echoes it back, so we can see the details for the browser request... Echo Server Code

More information

Introduc)on to Computer Networks

Introduc)on to Computer Networks Introduc)on to Computer Networks COSC 4377 Lecture 3 Spring 2012 January 25, 2012 Announcements Four HW0 s)ll missing HW1 due this week Start working on HW2 and HW3 Re- assess if you found HW0/HW1 challenging

More information

LAMP, WEB ARCHITECTURE, AND HTTP

LAMP, WEB ARCHITECTURE, AND HTTP CS 418 Web Programming Spring 2013 LAMP, WEB ARCHITECTURE, AND HTTP SCOTT G. AINSWORTH http://www.cs.odu.edu/~sainswor/cs418-s13/ 2 OUTLINE Assigned Reading Chapter 1 Configuring Your Installation pgs.

More information

02267: Software Development of Web Services

02267: Software Development of Web Services 02267: Software Development of Web Services Week 2 Hubert Baumeister huba@dtu.dk Department of Applied Mathematics and Computer Science Technical University of Denmark Fall 2016 1 Recap Distributed IT

More information

CS 43: Computer Networks. HTTP September 10, 2018

CS 43: Computer Networks. HTTP September 10, 2018 CS 43: Computer Networks HTTP September 10, 2018 Reading Quiz Lecture 4 - Slide 2 Five-layer protocol stack HTTP Request message Headers protocol delineators Last class Lecture 4 - Slide 3 HTTP GET vs.

More information

OAC: Alpha Data Model

OAC: Alpha Data Model Rob Sanderson rsanderson@lanl.gov azaroth42@gmail.com Herbert Van de Sompel herbertv@lanl.gov hvdsomp@gmail.com Digital Library Research and Prototyping Team Los Alamos NaDonal

More information

COMP 150-IDS: Internet Scale Distributed Systems (Spring 2017) URIs and RFC 3986

COMP 150-IDS: Internet Scale Distributed Systems (Spring 2017) URIs and RFC 3986 COMP 150-IDS: Internet Scale Distributed Systems (Spring 2017) URIs and RFC 3986 Noah Mendelsohn Tufts University Email: noah@cs.tufts.edu Web: http://www.cs.tufts.edu/~noah Copyright: 2012, 2013, 2015,

More information

Applications & Application-Layer Protocols: The Web & HTTP

Applications & Application-Layer Protocols: The Web & HTTP CS 312 Internet Concepts Applications & Application-Layer Protocols: The Web & HTTP Dr. Michele Weigle Department of Computer Science Old Dominion University mweigle@cs.odu.edu http://www.cs.odu.edu/~mweigle/cs312-f11/

More information

WEB TECHNOLOGIES CHAPTER 1

WEB TECHNOLOGIES CHAPTER 1 WEB TECHNOLOGIES CHAPTER 1 WEB ESSENTIALS: CLIENTS, SERVERS, AND COMMUNICATION Modified by Ahmed Sallam Based on original slides by Jeffrey C. Jackson THE INTERNET Technical origin: ARPANET (late 1960

More information

arxiv: v1 [cs.dl] 18 Mar 2010 ABSTRACT

arxiv: v1 [cs.dl] 18 Mar 2010 ABSTRACT An HTTP-Based Versioning Mechanism for Linked Data arxiv:1003.3661v1 [cs.dl] 18 Mar 2010 ABSTRACT Herbert Van de Sompel Los Alamos National Laboratory, NM, USA herbertv@lanl.gov Lyudmila L. Balakireva

More information

HTTP Reading: Section and COS 461: Computer Networks Spring 2013

HTTP Reading: Section and COS 461: Computer Networks Spring 2013 HTTP Reading: Section 9.1.2 and 9.4.3 COS 461: Computer Networks Spring 2013 1 Recap: Client-Server Communication Client sometimes on Initiates a request to the server when interested E.g., Web browser

More information

Introduction to HTTP. Jonathan Sillito

Introduction to HTTP. Jonathan Sillito Introduction to HTTP Jonathan Sillito If you interested in working with a professor next Summer 2011 apply for an NSERC Undergraduate Student Award. Students must have a GPA of 3.0 or higher to be eligible.

More information

Lecture 3. HTTP v1.0 application layer protocol. into details. HTTP 1.0: RFC 1945, T. Berners-Lee HTTP 1.1: RFC 2068, 2616

Lecture 3. HTTP v1.0 application layer protocol. into details. HTTP 1.0: RFC 1945, T. Berners-Lee HTTP 1.1: RFC 2068, 2616 Lecture 3. HTTP v1.0 application layer protocol into details HTTP 1.0: RFC 1945, T. Berners-Lee Lee,, R. Fielding, H. Frystyk, may 1996 HTTP 1.1: RFC 2068, 2616 Ascii protocol uses plain text case sensitive

More information

CS 43: Computer Networks. Layering & HTTP September 7, 2018

CS 43: Computer Networks. Layering & HTTP September 7, 2018 CS 43: Computer Networks Layering & HTTP September 7, 2018 Last Class: Five-layer Internet Model Application: the application (e.g., the Web, Email) Transport: end-to-end connections, reliability Network:

More information

arxiv: v1 [cs.dl] 16 Sep 2013

arxiv: v1 [cs.dl] 16 Sep 2013 Who and What Links to the Internet Archive Yasmin AlNoamany, Ahmed AlSum, Michele C. Weigle, and Michael L. Nelson Old Dominion University, Department of Computer Science Norfolk VA 23529, USA {yasmin,aalsum,mweigle,mln}@cs.odu.edu

More information

The Architecture of the World Wide Web

The Architecture of the World Wide Web The Architecture of the World Wide Web Laboratory of Computer Technologies L-A Laboratorio di Tecnologie Informatiche L-A Giulio Piancastelli & Andrea Omicini {giulio.piancastelli, andrea.omicini}@unibo.it

More information

arxiv: v1 [cs.dl] 26 Dec 2012

arxiv: v1 [cs.dl] 26 Dec 2012 How Much of the Web Is Archived? Scott G. Ainsworth, Ahmed AlSum, Hany SalahEldeen, Michele C. Weigle, Michael L. Nelson Old Dominion University Norfolk, VA, USA {sainswor, aalsum, hany, mweigle, mln}@cs.odu.edu

More information

Notes beforehand... For more details: See the (online) presentation program.

Notes beforehand... For more details: See the (online) presentation program. Notes beforehand... Notes beforehand... For more details: See the (online) presentation program. Topical overview: main arcs fundamental subjects advanced subject WTRs Lecture: 2 3 4 5 6 7 8 Today: the

More information

The Architecture of the World Wide Web

The Architecture of the World Wide Web The Architecture of the World Wide Web Distributed Systems L-A Sistemi Distribuiti L-A Andrea Omicini after Giulio Piancastelli andrea.omicini@unibo.it Ingegneria Due Alma Mater Studiorum Università di

More information

World-Wide Web Protocols CS 571 Fall Kenneth L. Calvert All rights reserved

World-Wide Web Protocols CS 571 Fall Kenneth L. Calvert All rights reserved World-Wide Web Protocols CS 571 Fall 2006 2006 Kenneth L. Calvert All rights reserved World-Wide Web The Information Universe World-Wide Web structure: hypertext Nonlinear presentation of information Key

More information

A Collaborative, Secure, and Private InterPlanetary Wayback Web Archiving System Using IPFS

A Collaborative, Secure, and Private InterPlanetary Wayback Web Archiving System Using IPFS A Collaborative, Secure, and Private InterPlanetary Wayback Web Archiving System Using IPFS Mat Kelly Old Dominion University Norfolk, Virginia, USA @machawk1 https://github.com/oduwsdl/ipwb David Dias

More information

On Tool Building and Evaluation of the Archived Web

On Tool Building and Evaluation of the Archived Web On Tool Building and Evaluation of the Archived Web Old Dominion University Web Science & Digital Libraries Research Group Department of Computer Science Norfolk, Virginia USA mkelly@cs.odu.edu Seminar,

More information

02267: Software Development of Web Services

02267: Software Development of Web Services 02267: Software Development of Web Services Week 3 Hubert Baumeister huba@dtu.dk Department of Applied Mathematics and Computer Science Technical University of Denmark Fall 2016 1 Recap www.example.com

More information

HTTP, circa HTTP protocol. GET /foo/bar.html HTTP/1.1. Sviluppo App Web 2015/ Intro 3/3/2016. Marco Tarini, Uninsubria 1

HTTP, circa HTTP protocol. GET /foo/bar.html HTTP/1.1. Sviluppo App Web 2015/ Intro 3/3/2016. Marco Tarini, Uninsubria 1 HTTP protocol HTTP, circa 1989 a resource «give me the HTML representation of thatresource» «ok, here» Client request GET /hello.txt Server response Hello, world! Client Server Http 1.1 Request line Client

More information

About the Tutorial. Audience. Prerequisites. Copyright & Disclaimer

About the Tutorial. Audience. Prerequisites. Copyright & Disclaimer About the Tutorial The Hypertext Transfer Protocol (HTTP) is an application-level protocol for distributed, collaborative, hypermedia information systems. This is the foundation for data communication

More information

CS631 - Advanced Programming in the UNIX Environment

CS631 - Advanced Programming in the UNIX Environment CS631 - Advanced Programming in the UNIX Environment Slide 1 CS631 - Advanced Programming in the UNIX Environment HTTP; Code Reading Department of Computer Science Stevens Institute of Technology Jan Schaumann

More information

Applications & Application-Layer Protocols: The Web & HTTP

Applications & Application-Layer Protocols: The Web & HTTP CPSC 360 Network Programming Applications & Application-Layer Protocols: The Web & HTTP Michele Weigle Department of Computer Science Clemson University mweigle@cs.clemson.edu http://www.cs.clemson.edu/~mweigle/courses/cpsc360

More information

timegate Documentation

timegate Documentation timegate Documentation Release 0.5.0.dev20160000 LANL Jul 16, 2018 Contents 1 About 3 2 User s Guide 5 2.1 Introduction............................................... 5 2.2 Installation................................................

More information

Announcements Fawzi Emad, Computer Science Department, UMCP

Announcements Fawzi Emad, Computer Science Department, UMCP Announcements You must come to lecture for which you are registered! If you are going to be routinely late (or leave early) please try to adjust your class schedule. Look over class webpage Lectures slides

More information

An Evaluation of Caching Policies for Memento TimeMaps

An Evaluation of Caching Policies for Memento TimeMaps An Evaluation of Caching Policies for Memento TimeMaps Justin F. Brunelle Old Dominion University Department of Computer Science Norfolk, Virginia, 23508 jbrunelle@cs.odu.edu Michael L. Nelson Old Dominion

More information

Category: Informational. G. Bilder Crossref J. Kunze California Digital Library S. Warner Cornell University April 2019

Category: Informational. G. Bilder Crossref J. Kunze California Digital Library S. Warner Cornell University April 2019 Independent Submission Request for Comments: 8574 Category: Informational ISSN: 2070-1721 H. Van de Sompel Data Archiving and Networked Services M. Nelson Old Dominion University G. Bilder Crossref J.

More information

Web Architecture and Technologies

Web Architecture and Technologies Web Architecture and Technologies Ambient intelligence Fulvio Corno Politecnico di Torino, 2015/2016 Goal Understanding Web technologies Adopted for User Interfaces Adopted for Distributed Application

More information

Web. Computer Organization 4/16/2015. CSC252 - Spring Web and HTTP. URLs. Kai Shen

Web. Computer Organization 4/16/2015. CSC252 - Spring Web and HTTP. URLs. Kai Shen Web and HTTP Web Kai Shen Web: the Internet application for distributed publishing and viewing of content Client/server model server: hosts published content and sends the content upon request client:

More information

Announcements Fawzi Emad, Computer Science Department, UMCP

Announcements Fawzi Emad, Computer Science Department, UMCP Announcements Look over class webpage Lectures slides are being posted TA Office hours will start next week Make sure you are downloading Komodo Edit and not Komodo IDE 1 Very Brief History of The Internet

More information

The file name of this version is draft-alvestrand-charset-policy-00.txt

The file name of this version is draft-alvestrand-charset-policy-00.txt HTTP/1.1 200 OK Date: Mon, 08 Apr 2002 22:29:59 GMT Server: Apache/1.3.20 (Unix) Last-Modified: Tue, 24 Jun 1997 14:45:00 GMT ETag: "2e6ce6-2dc9-33afdd6c" Accept-Ranges: bytes Content-Length: 11721 Connection:

More information

The BIG-IP System With Intelligent Compression: Cutting Application Delivery Time and Optimizing Bandwidth

The BIG-IP System With Intelligent Compression: Cutting Application Delivery Time and Optimizing Bandwidth The BIG-IP System With Intelligent Compression: Cutting Application Delivery Time and Optimizing Bandwidth Overview The number and complexity of applications delivered over the Internet continues to grow.

More information

HTTP Review. Carey Williamson Department of Computer Science University of Calgary

HTTP Review. Carey Williamson Department of Computer Science University of Calgary HTTP Review Carey Williamson Department of Computer Science University of Calgary Credit: Most of this content was provided by Erich Nahum (IBM Research) Introduction to HTTP http request http request

More information

COSC4377. Chapter 2: Outline

COSC4377. Chapter 2: Outline Lecture 5 Chapter 2: Outline 2.1 principles of network applications app architectures app requirements 2.2 Web and HTTP 2.3 FTP 2.4 electronic mail SMTP, POP3, IMAP 2.5 DNS 2.6 P2P applications 2.7 socket

More information

WWW Document Technologies

WWW Document Technologies WWW Document Technologies Michael B. Spring Department of Information Science and Telecommunications University of Pittsburgh spring@imap.pitt.edu http://www.sis.pitt.edu/~spring Overview The Internet

More information

How to work with HTTP requests and responses

How to work with HTTP requests and responses How a web server processes static web pages Chapter 18 How to work with HTTP requests and responses How a web server processes dynamic web pages Slide 1 Slide 2 The components of a servlet/jsp application

More information

DATA COMMUNICATOIN NETWORKING

DATA COMMUNICATOIN NETWORKING DATA COMMUNICATOIN NETWORKING Instructor: Ouldooz Baghban Karimi Course Book: Computer Networking, A Top-Down Approach By: Kurose, Ross Introduction Course Overview Basics of Computer Networks Internet

More information

Application Layer Introduction; HTTP; FTP

Application Layer Introduction; HTTP; FTP Application Layer Introduction; HTTP; FTP Tom Kelliher, CS 325 Feb. 4, 2011 1 Administrivia Announcements Assignment Read 2.4 2.6. From Last Time Packet-switched network characteristics; protocol layers

More information

Lecture 2: Applications and Application Programming

Lecture 2: Applications and Application Programming Lecture 2: Applications and Application Programming We re in a new room Administrivia If you are a Masters student, you need to enroll for 3, not 4 credits Prof. Levis will not have regular office hours

More information

Open Archives Initiative Object Reuse & Exchange. Resource Map Discovery

Open Archives Initiative Object Reuse & Exchange. Resource Map Discovery Open Archives Initiative Object Reuse & Exchange Resource Map Discovery Michael L. Nelson * Carl Lagoze, Herbert Van de Sompel, Pete Johnston, Robert Sanderson, Simeon Warner OAI-ORE Specification Roll-Out

More information

Produced by. Mobile Application Development. Higher Diploma in Science in Computer Science. Eamonn de Leastar

Produced by. Mobile Application Development. Higher Diploma in Science in Computer Science. Eamonn de Leastar Mobile Application Development Higher Diploma in Science in Computer Science Produced by Eamonn de Leastar (edeleastar@wit.ie) Department of Computing, Maths & Physics Waterford Institute of Technology

More information

WEB SECURITY p.1

WEB SECURITY p.1 WEB SECURITY 101 - p.1 spritzers - CTF team spritz.math.unipd.it/spritzers.html Disclaimer All information presented here has the only purpose to teach how vulnerabilities work. Use them to win CTFs and

More information

HTTP Server Application

HTTP Server Application 1 Introduction You are to design and develop a concurrent TCP server that implements the HTTP protocol in the form of what is commonly called a web server. This server will accept and process HEAD and

More information

Obsoletes: 2070, 1980, 1942, 1867, 1866 Category: Informational June 2000

Obsoletes: 2070, 1980, 1942, 1867, 1866 Category: Informational June 2000 Network Working Group Request for Comments: 2854 Obsoletes: 2070, 1980, 1942, 1867, 1866 Category: Informational D. Connolly World Wide Web Consortium (W3C) L. Masinter AT&T June 2000 The text/html Media

More information

Linked Data Semantic Web Technologies 1 (2010/2011)

Linked Data Semantic Web Technologies 1 (2010/2011) Linked Data Semantic Web Technologies 1 (2010/2011) Sebastian Rudolph Andreas Harth Institute AIFB www.kit.edu Data on the Web Increasingly, web sites provide direct access to data Using Semantic Web standards,

More information

ICS 351: Today's plan. IPv6 routing protocols (summary) HTML HTTP web scripting languages certificates (review) cookies

ICS 351: Today's plan. IPv6 routing protocols (summary) HTML HTTP web scripting languages certificates (review) cookies ICS 351: Today's plan IPv6 routing protocols (summary) HTML HTTP web scripting languages certificates (review) cookies IPv6 routing almost the same routing protocols as for IPv4: RIPng, OSPFv6, BGP with

More information

The TCPProxy. Table of contents

The TCPProxy. Table of contents Table of contents 1 Starting the TCPProxy...2 2 Using the EchoFilter...4 3 Using the HTTPPluginTCPProxyFilter...4 4 SSL and HTTPS support... 6 5 Using the TCPProxy with other proxies...7 6 Using the TCPProxy

More information

Open Archives Initiative Object Reuse & Exchange. Resource Map Discovery

Open Archives Initiative Object Reuse & Exchange. Resource Map Discovery Open Archives Initiative Object Reuse & Exchange Resource Map Discovery Michael L. Nelson * Carl Lagoze, Herbert Van de Sompel, Pete Johnston, Robert Sanderson, Simeon Warner OAI-ORE Specification Roll-Out

More information

KTH ROYAL INSTITUTE OF TECHNOLOGY. Remote Invocation. Vladimir Vlassov and Johan Montelius

KTH ROYAL INSTITUTE OF TECHNOLOGY. Remote Invocation. Vladimir Vlassov and Johan Montelius KTH ROYAL INSTITUTE OF TECHNOLOGY Remote Invocation Vladimir Vlassov and Johan Montelius Middleware Application layer Remote invocation / indirect communication Socket layer Network layer 2 Request / Reply

More information

World Wide Web, etc.

World Wide Web, etc. World Wide Web, etc. Alex S. Raw data-packets wouldn t be much use to humans if there weren t many application level protocols, such as SMTP (for e-mail), HTTP & HTML (for www), etc. 1 The Web The following

More information

The World Wide Web. Internet

The World Wide Web. Internet The World Wide Web Relies on the Internet: LAN (Local Area Network) connected via e.g., Ethernet (physical address: 00-B0-D0-3E-51-BC) IP (Internet Protocol) for bridging separate physical networks (IP

More information

2- Application Level Protocols HTTP 1.0/1.1/2

2- Application Level Protocols HTTP 1.0/1.1/2 2- Application Level Protocols HTTP 1.0/1.1/2 HTTP, (HyperText Transfer Protocol) Basis for fetching Web pages request Network CSE 461 University of Washington 2 Sir Tim Berners-Lee (1955 ) Inventor of

More information

INFOH-511 WEB SERVICES. LECTURE 1: Introduction

INFOH-511 WEB SERVICES. LECTURE 1: Introduction INFOH-511 WEB SERVICES LECTURE 1: Introduction COURSE RESPONSIBLES Stijn Vansummeren ULB, Campus Solbosch, UB4.125 stijn.vansummeren@ulb.ac.be Stefan Epe ULB, Campus Solbosch, UB4.133 Stefan.eppe@ulb.ac.be

More information

AIMMS Function Reference - Date Time Related Identifiers

AIMMS Function Reference - Date Time Related Identifiers AIMMS Function Reference - Date Time Related Identifiers This file contains only one chapter of the book. For a free download of the complete book in pdf format, please visit www.aimms.com Aimms 3.13 Date-Time

More information

World Wide Web. World Wide Web - how it works. WWW usage requires a combination of standards and protocols DHCP TCP/IP DNS HTTP HTML MIME

World Wide Web. World Wide Web - how it works. WWW usage requires a combination of standards and protocols DHCP TCP/IP DNS HTTP HTML MIME World Wide Web WWW usage requires a combination of standards and protocols DHCP TCP/IP DNS HTTP HTML MIME World Wide Web - how it works User on a machine somewhere Server machine Being more specific...

More information

HTTP Protocol and Server-Side Basics

HTTP Protocol and Server-Side Basics HTTP Protocol and Server-Side Basics Web Programming Uta Priss ZELL, Ostfalia University 2013 Web Programming HTTP Protocol and Server-Side Basics Slide 1/26 Outline The HTTP protocol Environment Variables

More information

Networking: Application Layer

Networking: Application Layer CS 4410 Operating Systems Networking: Application Layer Summer 2016 Cornell University 1 Today Two application-layer protocols: DNS HTTP Domain Name Service When a user wants to communicate with a remote

More information

Vendor: Citrix. Exam Code: 1Y Exam Name: Citrix NetScaler 10.5 Essentials for Networking. Q&As: Demo

Vendor: Citrix. Exam Code: 1Y Exam Name: Citrix NetScaler 10.5 Essentials for Networking. Q&As: Demo Vendor: Citrix Exam Code: 1Y0-351 Exam Name: Citrix NetScaler 10.5 Essentials for Networking Q&As: Demo QUESTION 1 A NetScaler Engineer has created a new custom user monitor script and needs to place it

More information

COSC 2206 Internet Tools. The HTTP Protocol

COSC 2206 Internet Tools. The HTTP Protocol COSC 2206 Internet Tools The HTTP Protocol http://www.w3.org/protocols/ What is TCP/IP? TCP: Transmission Control Protocol IP: Internet Protocol These network protocols provide a standard method for sending

More information

Network Applications and the Web

Network Applications and the Web Network Applications and the Web Antonio Carzaniga Faculty of Informatics University of Lugano September 27, 2013 2005 2007 Antonio Carzaniga 1 General concepts for network applications Outline Client/server

More information

HTTP Authentication API

HTTP Authentication API HTTP Authentication API Note: Both GET (URL format) and POST http requests are supported. Note that POST is considered better security as URL data can be cached in the browser. HTTP URL Format http(s)://your_securenvoy_server/secserver?flag=desktop&version=2.0&status=auth&userid=(my_userid)&passcode=(6

More information

Privacy defense on the Internet. Csaba Kiraly

Privacy defense on the Internet. Csaba Kiraly Advanced Networking Privacy defense on the Internet Csaba Kiraly 1 Topics Anonymity on the Internet Chaum Mix Mix network & Onion Routing Low-latency anonymous routing 2 Anonymity: Chaum mix David L. Chaum

More information

Jeff Offutt SWE 642 Software Engineering for the World Wide Web

Jeff Offutt  SWE 642 Software Engineering for the World Wide Web Networking Basics Behind the World Wide Web Jeff Offutt http://www.cs.gmu.edu/~offutt/ SWE 642 Software Engineering for the World Wide Web Adapted from chapter 1 slides for : Web Technologies : A Computer

More information

Black Box DCX3000 / DCX1000 Using the API

Black Box DCX3000 / DCX1000 Using the API Black Box DCX3000 / DCX1000 Using the API updated 2/22/2017 This document will give you a brief overview of how to access the DCX3000 / DCX1000 API and how you can interact with it using an online tool.

More information

CSE 333 Lecture HTTP

CSE 333 Lecture HTTP CSE 333 Lecture 19 -- HTTP Hal Perkins Department of Computer Science & Engineering University of Washington Administrivia Server-side programming exercise due Wed. morning HW4 due a week later - How s

More information

Link Rot + Content Drift

Link Rot + Content Drift Link Rot + Content Drift Peter Burnhill EDINA, University of Edinburgh for Hiberlink Team at University of Edinburgh & LANL Research Library Funded by the Andrew W. Mellon Foundation STM_2015 1 December

More information

A distributed network of digital heritage information

A distributed network of digital heritage information A distributed network of digital heritage information SWIB17 Enno Meijers / 6 December 2017 / Hamburg Contents 1. Introduction to Dutch Digital Heritage Network 2. The current digital heritage infrastructure

More information

Scalable applications with HTTP

Scalable applications with HTTP Scalable applications with HTTP Patrice Neff, co-founder Memonic patrice@memonic.com twitter.com/pneff 20100407 memonic Memonic Founded in 2009 Your personal digital notebook Easy web research Try it out

More information

Web Archive Profiling Through Fulltext Search

Web Archive Profiling Through Fulltext Search Web Archive Profiling Through Fulltext Search Sawood Alam 1, Michael L. Nelson 1, Herbert Van de Sompel 2, and David S. H. Rosenthal 3 1 Computer Science Department, Old Dominion University, Norfolk, VA

More information

Building next-gen Web Apps with WebSocket. Copyright Kaazing Corporation. All rights reserved.

Building next-gen Web Apps with WebSocket. Copyright Kaazing Corporation. All rights reserved. Building next-gen Web Apps with WebSocket Copyright 2011 - Kaazing Corporation. All rights reserved. Who am I? Graham Gear Solution Architect, with Kaazing, purveyors of HTML5 enabling tech Based in London,

More information

C22: Browser & Web Server Communication

C22: Browser & Web Server Communication CISC 3120 C22: Browser & Web Server Communication Hui Chen Department of Computer & Information Science CUNY Brooklyn College 11/01/2017 CUNY Brooklyn College 1 Web Application Architecture Client apps

More information

HTTP. In this chapter we give an overview of HTTP, followed by the Go APIs to manage HTTP connections.

HTTP. In this chapter we give an overview of HTTP, followed by the Go APIs to manage HTTP connections. HTTP Introduction The World Wide Web is a major distributed system, with millions of users. A site may become a Web host by running an HTTP server. While Web clients are typically users with a browser,

More information

TACACS Support APIs. curl -k -v -u "admin:cisco123" -H Accept:application/vnd.yang.data+xml -H ContentType:application/vnd.yang.

TACACS Support APIs. curl -k -v -u admin:cisco123 -H Accept:application/vnd.yang.data+xml -H ContentType:application/vnd.yang. Table 1: Action Method Payload Required API To configure TACACS server POST Yes To configure TACACS server PUT Yes To configure TACACS server DELETE No To view TACACS server configuration GET No Example:

More information

Whatever it takes. Fixing SQLIA and XSS in the process. Diploma Thesis Outline Presentation, Florian Thiel

Whatever it takes. Fixing SQLIA and XSS in the process. Diploma Thesis Outline Presentation, Florian Thiel Whatever it takes Fixing SQLIA and XSS in the process Diploma Thesis Outline Presentation, Florian Thiel Seminar Beiträge zum Software Engineering, FU Berlin, 11/06/2008 OWASP Top 10 2007 1. XSS 2. Injection

More information

10/16/2016 CPET 490 SENIOR DESIGN PROJECT PHASE I ANDROID GOLF STATISTICS TRACKER. Brad Sorensen Kory Martin PROJECT SUMMARY

10/16/2016 CPET 490 SENIOR DESIGN PROJECT PHASE I ANDROID GOLF STATISTICS TRACKER. Brad Sorensen Kory Martin PROJECT SUMMARY CPET 490 SENIOR DESIGN PROJECT PHASE I ANDROID GOLF STATISTICS TRACKER Brad Sorensen Kory Martin PROJECT SUMMARY 1 Project Summary Allow users to track and analyze statistical information about their golf

More information

Research the Past Web using Web archives.

Research the Past Web using Web archives. Research the Past Web using Web archives Daniel.Gomes@fccn.pt Daniel.Bicho@fccn.pt Fernando.Melo@fccn.pt Tutorial outline Research the Past Web using Web archives 1. Search and access The Past Web: examples

More information