2: Application Layer1 TODO r Intro to Application Level Protocols r Two specific application level...

2: Application Layer 1

TODO

Intro to Application Level Protocols Two specific application level protocols

1 that uses TCP - HTTP 1 that uses UDP - DNS

HTTP, 1.0 vs 1.1, telnet examples DNS, Bind IP addresses RIPE, APNIC, ARIN US Govt, Network solutions Needs of different applications


Internet protocol stack

Application

Transport

Network

Physical

usersnetwork

HTTP, SMTP, FTP, TELNET, DNS, …

TCP, UDP.

IP

Point-to-point links,LANs, radios, ...


Protocol stack

e-mail client

TCP server

IP server

ethernetdriver/card

user X

SMTP

TCP

IP

e-mail server

TCP server

IP server

ethernetdriver/card

user Y

IEEE 802.3 standard

electric signals

English


Network Applications Drive Network Design Important to remember that network

applications are the reason we care about building a network infrasturucture

Applications range from text based command line ones popular in the 1980s (like telnet, ftp, news, chat, etc) to multimedia applications (Web browsers, audio and video streaming, realtime videoconferencing, etc.)


Applications and application-layer protocols

Application: communicating, distributed processes running in network hosts

in “user space” exchange messages to

implement app e.g., email, file transfer,

the WebApplication-layer protocols

one “piece” of an app define messages

exchanged by apps and actions taken

user services provided by lower layer protocols

application

transportnetworkdata linkphysical

application


application



Client-server paradigm

Typical network app has two pieces: client and server

application


application


Client: initiates contact with server

(“speaks first”) typically requests service

from server, for Web, client is

implemented in browser; for e-mail, in mail reader

Server: Running first (always?) provides requested service

to client e.g., Web server sends requested Web page, mail server delivers e-mail

request

reply


How do clients and servers communicate?

API: application programming interface

defines interface between application and transport layer

socket: Internet API two processes

communicate by sending data into socket, reading data out of socket

Q: how does a process “identify” the other process with which it wants to communicate? IP address of host

running other process “port number” -

allows receiving host to determine to which local process the message should be delivered

… more on this later.


Sockets Specify Transport Services Sockets define the interfaces between

an application and the transport layer Applications choose the type of

transport layer by choosing the type of socket UDP Sockets – called DatagramSocket in

Java, SOCK_DGRAM in C TCP Sockets – called Socket/ServerSocket in

Java, SOCK_STREAM in C Client and server agree on the type of

socket, the server port number and the protocol


Roadmap

We will look at two application level protocols

HTTP runs on TCP DNS usually runs on UDP (sometimes on

TCP)


Services provided by Internet transport protocols

TCP service: connection-oriented: setup

required between client, server

reliable transport between sending and receiving process

flow control: sender won’t overwhelm receiver

congestion control: throttle sender when nework overloaded

does not providing: timing, minimum bandwidth guarantees

UDP service: unreliable data transfer

between sending and receiving process

does not provide: connection setup, reliability, flow control, congestion control, timing, or bandwidth guarantee

Q: why bother? Why is there a UDP?


The Web: the http protocol

http: hypertext transfer protocol

Web’s application layer protocol

client/server model client: browser that

requests, receives, “displays” Web objects

server: Web server has access to storage containing a set of Web documents; sends copies in response to requests

http1.0: RFC 1945 http1.1: RFC 2068

PC runningExplorer

Server running

NCSA Webserver

Mac runningNavigator

http request

http re

quest

http response

http re

sponse


Uniform Resource Locator (URL)

protocol://authority:port/p/a/th/item_name?query

protocol = http authority = server machine Port = 80 by default /p/a/th/item_name = specifies a file to

be returned or possibly a program to be executed to produce the file to be returned


The http protocol: more

http: TCP transport service:

client initiates TCP connection (creates socket) to server, port 80

server accepts TCP connection from client

http messages (application-layer protocol messages) exchanged between browser (http client) and Web server (http server)

TCP connection closed

http is “stateless” server maintains no

information about past client requests

Protocols that maintain “state” are complex!

past history (state) must be maintained

if server/client crashes, their views of “state” may be inconsistent, must be reconciled

aside


http exampleSuppose user enters URL www.someSchool.edu/someDepartment/home.index

1a. http client initiates TCP connection to http server (process) at www.someSchool.edu. Port 80 is default for http server.

2. http client sends http request message (containing URL) into TCP connection socket

1b. http server at host www.someSchool.edu waiting for TCP connection at port 80. “accepts” connection, notifying client

3. http server receives request message, forms response message containing requested object (someDepartment/home.index), sends message into socket

time

(contains text, references to 10

jpeg images)


http example (cont.)

5. http client receives response message containing html file, displays html. Parsing html file, finds 10 referenced jpeg objects

6. Steps 1-5 repeated for each of 10 jpeg objects

4. http server closes TCP connection.

time


http message format: request

two types of http messages: request, response http request message:

ASCII (human-readable format)

GET /somedir/page.html HTTP/1.0 User-agent: Mozilla/4.0 Accept: text/html, image/gif,image/jpeg Accept-language:fr

(extra carriage return, line feed)

request line(GET, POST,

HEAD commands)

header lines

Carriage return, line feed

indicates end of message


http request message: general format


http message format: response

HTTP/1.0 200 OK Date: Thu, 06 Aug 1998 12:00:15 GMT Server: Apache/1.3.0 (Unix) Last-Modified: Mon, 22 Jun 1998 …... Content-Length: 6821 Content-Type: text/html data data data data data ...

status line(protocol

status codestatus phrase)

header lines

data, e.g., requestedhtml file


http response status codes

200 OK request succeeded, requested object later in this

message

301 Moved Permanently requested object moved, new location specified later

in this message (Location:)

400 Bad Request request message not understood by server

404 Not Found requested document not found on this server

505 HTTP Version Not Supported

In first line in server->client response message.A few sample codes:


HTML overview

Markup language give general layout guidelines - not exact placement or format- so browsers may display the same document differently

Free form (i.e. Spaces don’t matter) Embedded tags give guidelines Tags often appear in pairs

beginning <TAGNAME> ending </TAGNAME>


HTTP vs HTML

HTML format is highly specified but is just considered the data or body of an HTTP message

HTML is not part of the HTTP protocol Example of layering: each layer speaks

to a peer layer in an agreed upon language or protocol

In this case, both are processed by the web browser. The web broswer is both an HTTP client and an HTML parser.


Static vs Dynamic vs Active Web Pages Static: Stored in a file and unchanging Dynamic: Formed by server on demand

in response to a request Output from a program (e.g. Common

Gateway Interface (CGI) ) Active: Executed at the client!

Computer program (not just output) that can interact with user (e.g. Java applet)


Non-persistent and persistent connections

Non-persistent HTTP/1.0 server parses

request, responds, and closes TCP connection

2 RTTs to fetch each object

Each object transfer suffers from slow start

Persistent default for HTTP/1.1 on same TCP

connection: server, parses request, responds, parses new request,..

Client sends requests for all referenced objects as soon as it receives base HTML.

Fewer RTTs and less slow start.But most 1.0 browsers use

parallel TCP connections. Do 1.1 browsers do this?


Features in HTTP 1.1

Persistent Connections Hostname Identification

Allows one physical web server to serve content for multiple logical servers

Content Negotiation Allows client to request a specific version of a

resource Chunked Transfers

For dynamic content, server needn’t specify all characteristics like size ahead of time

Byte Ranges Clients can ask for small pieces of documents

Support for Proxies and Caches


Trying out http (client side) for yourself

1. Telnet to your favorite Web server:

Opens TCP connection to port 80(default http server port) at www.eurecom.fr.Anything typed in sent to port 80 at www.eurecom.fr

telnet www.eurecom.fr 80

2. Type in a GET http request:

GET /~ross/index.html HTTP/1.0 By typing this in (hit carriagereturn twice), you sendthis minimal (but complete) GET request to http server

3. Look at response message sent by http server!


User-server interaction: authentication

Authentication goal: control access to server documents

stateless: client must present authorization in each request

authorization: typically name, password authorization: header

line in request if no authorization

presented, server refuses access, sendsWWW authenticate:

header line in response

client server

usual http request msg401: authorization req.

WWW authenticate:

usual http request msg

+ Authorization:lineusual http response

msg


+ Authorization:lineusual http response

msg

time

Browser caches name & password sothat user does not have to repeatedly enter it.


User-server interaction: cookies

server sends “cookie” to client in response mstSet-cookie: 1678453

client presents cookie in later requestscookie: 1678453

server matches presented-cookie with server-stored info authentication remembering user

preferences, previous choices

client server

usual http request msgusual http response

+Set-cookie: #


cookie: #usual http response

msg


cookie: #usual http response msg

cookie-spectificaction

cookie-spectificaction


User-server interaction: conditional GET

Goal: don’t send object if client has up-to-date stored (cached) version

client: specify date of cached copy in http requestIf-modified-since:

<date> server: response contains

no object if cached copy up-to-date: HTTP/1.0 304 Not

Modified

client server

http request msgIf-modified-since:

<date>

http responseHTTP/1.0

304 Not Modified

object not

modified

http request msgIf-modified-since:

<date>

http responseHTTP/1.1 200 OK

…

<data>

object modified


Web Caches (proxy server)

user sets browser: Web accesses via web cache

client sends all http requests to web cache if object at web cache,

web cache immediately returns object in http response

else requests object from origin server, then returns http response to client

Goal: satisfy client request without involving origin server

client

Proxyserver

client

http request

http re

quest

http response

http re

sponse

http re

quest

http re

sponse

http requesthttp response

origin server

origin server


Why Web Caching?

Assume: cache is “close” to client (e.g., in same network)

smaller response time: cache “closer” to client

decrease traffic to distant servers link out of

institutional/local ISP network often bottleneck

originservers

public Internet

institutionalnetwork 100 Mbps LAN

1.5 Mbps access link

institutionalcache


DNS: Domain Name System

People: many identifiers: SSN, name, Passport #

Internet hosts, routers: IP address (32 bit) -

used for addressing datagrams

“name”, e.g., gaia.cs.umass.edu - used by humans

Q: map between IP addresses and name ?

Domain Name System: distributed database

implemented in hierarchy of many name servers

application-layer protocol host, routers, name servers to communicate to resolve names (address/name translation) note: core Internet

function implemented as application-layer protocol

complexity at network’s “edge”


Names and addresses:why both?

Name: www.cs.cornell.edu IP address: 128.84.154.132

(Also Ethernet or other link-layer addresses.)

IP addresses are fixed-size numbers. 32 bits. 128.153.4.24 =

10000000.10001111.00000100.00001110

Names are memorizable, flexible: Variable-length Many names for a single IP address. Change address doesn’t imply change name. iPv6 addresses are 128 bit – even harder to memorize!


Mapping Not 1 to 1

One name may map to more than one IP address IP addresses are per network interface Multihomed machines have more than one

network interface - each with its own IP address

Example: routers must be like this One IP address may map to more than

one name One server machine may be the web server

(www.foo,com), mail server (mail.foo.com)etc.


How to get names and numbers? Acquistion of Names and numbers are

both regulated Why?


How to get a name?

First, get a domain name then you are free to assign sub names in that domain How to get a domain name coming up

Before you ask for a domain name though Should understand domain name structure… Know that you are responsible for providing

authoritative DNS server (actually a primary and one or more secondary DNS servers) for that domain and registration information through “whois”


Domain name structure

ccTLDs

root (unnamed)

com milgovedu grorgnet fr ukus ......

cornell ustreas second level (sub-)domainslucent

gTLDs

gTLDs= Generic Top Level Domains ccTLDs = Country Code Top Level Domains


Top-level Domains (TLDs)

Generic Top Level Domains (gTLDs) .com - commercial organizations .org - not-for-profit organizations .edu - educational organizations .mil - military organizations .gov - governmental organizations .net - network service providers New: .biz, .info, .name, …

Country code Top Level Domains (ccTLDs) One for each country


How to get a domain name?

In 1998, non-profit corporation, Internet Corporation for Assigned Names and Numbers (ICANN), was formed to assume responsibility from the US Government

ICANN authorizes other companies to register domains in com, org and net and new gTLDs Network Solutions is largest and in transitional

period between US Govt and ICANN had sole authority to register domains in com, org and net


How to get an IP Address?

Answer 1: Normally, answer is get an IP address from your upstream provider This is essential to maintain efficient routing!

Answer 2: If you need lots of IP addresses then you can acquire your own block of them. IP address space is a scarce resource - must prove

you have fully utilized a small block before can ask for a larger one and pay $$ (Jan 2002 - $2250/year for /20 and $18000/year for a /14)


How to get lots of IP Addresses? Internet RegistriesRIPE NCC (Riseaux IP Europiens Network

Coordination Centre) for Europe, Middle-East, Africa

APNIC (Asia Pacific Network Information Centre )for Asia and Pacific

ARIN (American Registry for Internet Numbers) for the Americas, the Caribbean, sub-saharan Africa

Note: Once again regional distribution is important for efficient routing!

Can also get Autonomous System Numnbers (ASNs from these registries


Checkpoint

Now you know both how to get a machine name and how to get an IP address

Now back to DNS – how to map from one to the other!


DNS: Domain Name System

People: many identifiers: SSN, name, Passport #

Internet hosts, routers: IP address (32 bit) -

used for addressing datagrams

“name”, e.g., gaia.cs.umass.edu - used by humans

Q: map between IP addresses and name ?

Domain Name System: distributed database

implemented in hierarchy of many name servers

application-layer protocol host, routers, name servers to communicate to resolve names (address/name translation) note: core Internet

function implemented as application-layer protocol

complexity at network’s “edge”


DNS name servers

Name server: process running on a host that processes DNS requests

local name servers: each ISP, company has

local (default) name server host DNS query first goes

to local name server

authoritative name server: can perform name/address

translation for a specific domain or zone

How could we provide this service? Why not centralize DNS?

single point of failure traffic volume distant centralized database maintenance

doesn’t scale!

no server has all name-to-IP address mappings


Name Server Zone Structure

root

Structure based onadministrative issues.

lucent

com miledugov grorgnet fr ukus

ustreas

www

irs Zone: subtree with commonadministration authority.


Name Servers (NS)

root

cornelllucent

com ...edugov

ustreas

customs

www

irsIRS NS

Ustreas NSLucent NS

Root NS


Name Servers (NS)

• NSs are duplicated for reliability.

•Each domain must have a primary and secondary.

• Anonymous ftp from:

ftp.rs.internic.net, netinfo/root-server.txt

gives the current root NSs (about 10).

• Each host knows the IP address of the local NS.

• Each NS knows the IP addresses of all root NSs.


DNS: Root name servers

contacted by local name server that can not resolve name

root name server: Knows the

authoritative name server for main domain

~ dozen root name servers worldwide


Simple DNS example

host surf.eurecom.fr wants IP address of gaia.cs.umass.edu

1. Contacts its local DNS server, dns.eurecom.fr

2. dns.eurecom.fr contacts root name server, if necessary

3. root name server contacts authoritative name server, dns.umass.edu, if necessary (what might be wrong with this?)

requesting hostsurf.eurecom.fr

gaia.cs.umass.edu

root name server

authorititive name serverdns.umass.edu

local name serverdns.eurecom.fr

1

23

4

5

6


DNS example

Root name server: may not know

authoritative name server

may know intermediate name server: who to contact to find authoritative name server


gaia.cs.umass.edu

root name server


1

23

4 5

6

authoritative name serverdns.cs.umass.edu

intermediate name serverdns.umass.edu

7

8


DNS: iterated queries

recursive query: puts burden of

name resolution on contacted name server

heavy load?

iterated query: contacted server

replies with name of server to contact

“I don’t know this name, but ask this server”

Takes burden off root servers


gaia.cs.umass.edu

root name server


1

23

4

5 6

authoritative name serverdns.cs.umass.edu

intermediate name serverdns.umass.edu

7

8

iterated query


DNS: caching and updating records once (any) name server learns mapping, it

caches mapping» cache entries timeout (disappear) after some time

update/notify mechanisms under design by IETF Proposed Standard: RFC 2136


DNS records: More than Name to IP AddressDNS: distributed db storing resource records (RR)

Type=NS name is domain (e.g.

foo.com) value is IP address of

authoritative name server for this domain

RR format: (name, value, type,ttl)

Type=A name is hostname value is IP address One we’ve been discussing; most

common

Type=CNAME name is an alias name

for some “cannonical” (the real) name

value is cannonical name

Type=MX value is hostname of

mailserver associated with name


PTR Records

Do reverse mapping from IP address to name

Why is that hard? Which name server is responsible for that mapping? How do you find them?

Answer: special root domain, arpa, for reverse lookups


Arpa top level domain

root

com miledugov grorgnet fr ukusarpa

In-addr

128

30 33 1

ietf

www

1.33.30.128.in-addr.arpa.

www.ietf.org.

Want to know machine name for 128.30.33.1?Issue a PTR request for 1.33.30.128.in-addr.arpa


Why is it backwards?

Notice that 1.30.33.128.in-addr.arpa is written in order of increasing scope of authority just like www.cs.foo.edu

Edu largest scope of authority; foo.edu less, down to single machine www.cs.foo.edu

Arpa largest scope of authority; in-addr.arpa less, down to single machine 1.30.33.128.in-addr.arpa (or 128.33.30.1)


In-addr.arpa domain

When an organization acquires a domain name, they receive authority over the corresponding part of the domain name space.

When an organization acquires a block of IP address space, they receive authority over the corresponding part of the in-addr.arpa space.

Example: Acquire domain berkeley.edu and acquire a class B IP Network ID 128.143


DNS protocol, messagesDNS protocol : query and repy messages, both with same message format

msg header identification: 16 bit #

for query, repy to query uses same #

flags: query or reply recursion desired recursion available reply is authoritative reply was truncated


DNS protocol, messages

Name, type fields for a query

RRs in reponseto query

records forauthoritative servers

additional “helpful”info that may be used


nslookup

Use to query DNS servers (not telnet like with http – why?)

Interactive and Non-interactive modes Examples:

nslookup www.yahoo.com nslookup –query=mx cs.cornell.edu nslookup

• Enter interactive shell• Type a host name; get its IP address info • ls –d <domain.name>• set debug, set recurse, set norecurse,…


HTTP vs DNS

Why does HTTP use TCP? Error control? Doesn’t DNS need error control? Why is UDP

usually ok? Each object small enough to go in one datagram – no

need for reorder Retransmission? Just instrument client to resend

request if doesn’t get a response When does DNS use TCP?

Truncation bit; if reply too long, set truncate bit as signal to request using TCP

Also for zone transfers from primary to secondary servers

TCP has high overhead Many apps that use UDP implement only the subset of

TCP functionality they really need


HTTP vs DNS (con’t)

Why is HTTP human readable and DNS not? Easier to think of human readable protocol

with a TCP connection and telnet Harder when sending requests that might

not go through Better answer??

2: Application Layer1 TODO r Intro to Application Level Protocols r Two specific application level...

Documents

Transcript of 2: Application Layer1 TODO r Intro to Application Level Protocols r Two specific application level...