Internet Evolution, GovernanceInternet Evolution, Governanceand the Digital Object and the Digital Object

ArchitectureArchitecture

Workshop on SCORMWorkshop on SCORMSequencing and NavigationSequencing and Navigation

Gaithersburg, MarylandGaithersburg, MarylandFebruary 23, 2005February 23, 2005

Robert E. KahnCorporation for National Research InitiativesReston, Virginia

Three Initial NetworksThree Initial Networks

About 30 – 35 years ago, DARPA funded the About 30 – 35 years ago, DARPA funded the creation of three seminal packet networks – creation of three seminal packet networks – ARPANET, Packet Radio, Packet SatelliteARPANET, Packet Radio, Packet Satellite

The Internet came about from a desire to The Internet came about from a desire to link link the three of themthe three of them

Ethernet occurred in parallel, led by Xerox Parc Ethernet occurred in parallel, led by Xerox Parc researchers, and other network types followedresearchers, and other network types followed

The resulting architecture was independent of The resulting architecture was independent of the number and type of networks or who ran the number and type of networks or who ran them.them.

Key DecisionsKey Decisions

The Internet would be a global information systemThe Internet would be a global information system An open-architectureAn open-architecture would be used to combine would be used to combine

different networks based on open and well-known different networks based on open and well-known interfaces, protocols & objectsinterfaces, protocols & objects..

A new communications-oriented host protocol A new communications-oriented host protocol ((TCP/IPTCP/IP) would be created to replace the original ) would be created to replace the original ARPANET host protocol (NCP)ARPANET host protocol (NCP)

The concept of global addressing and The concept of global addressing and IP addressesIP addresses would be introduced to identify individual machines would be introduced to identify individual machines anywhere on the global Internetanywhere on the global Internet

Comments on the Key DecisionsComments on the Key Decisions

The architecture is robust in the presence of many The architecture is robust in the presence of many different network types and many outagesdifferent network types and many outages

Gateways provided IP routing and Network Gateways provided IP routing and Network “Impedance Matching” “Impedance Matching”

TCP accommodated end-end protocolsTCP accommodated end-end protocols different packet sizes, duplicates, error detection, different packet sizes, duplicates, error detection,

losses due to tunnels, mountains, jamming, etc.losses due to tunnels, mountains, jamming, etc. Separate network administrations were permitted, Separate network administrations were permitted,

which allowed the Net to growwhich allowed the Net to grow DNS not technically critical, but helped usersDNS not technically critical, but helped users

Understanding the Big PictureUnderstanding the Big Picture

Many things were done well from the outset; with Many things were done well from the outset; with 20/20 hindsight, some could have been done better20/20 hindsight, some could have been done better

The context was criticalThe context was criticalMostly mainframes, few time-sharing systemsMostly mainframes, few time-sharing systemsNo PCs, workstations, LANsNo PCs, workstations, LANsOne dominant carrier in the USOne dominant carrier in the USGovernment facility initiallyGovernment facility initially

What is important at the time may be only apparent What is important at the time may be only apparent with hindsight; but also what seems important at the with hindsight; but also what seems important at the time may not turn out to be so important later ontime may not turn out to be so important later on

Key Management StructuresKey Management Structures

Internet Configuration Control Board (ICCB)Internet Configuration Control Board (ICCB) Internet Activities Board (IAB)Internet Activities Board (IAB) Internet Engineering Task Force (IETF)Internet Engineering Task Force (IETF) Internet Architecture Board (IAB)Internet Architecture Board (IAB) Internet Society (ISOC)Internet Society (ISOC)Domain Name System (DNS)Domain Name System (DNS) Internet Corporation for Assigned Names Internet Corporation for Assigned Names

and Numbers (ICANN)and Numbers (ICANN)

Defining the InternetDefining the Internet

Logical architecture for internetworkingLogical architecture for internetworking Independent of the underlying networksIndependent of the underlying networks

Open architectureOpen architecture at the network level at the network levelNot the routers, switches, lines, computersNot the routers, switches, lines, computersNot any one service provider on the netNot any one service provider on the netReference to the FNC definition from 1995Reference to the FNC definition from 1995

www.hpcc.gov/fnc/Internet_res.html www.hpcc.gov/fnc/Internet_res.html

Updating the “1995 Definition”Updating the “1995 Definition”

"Internet" refers to the global information system that -- "Internet" refers to the global information system that --

(i) is logically linked together by a globally unique address (i) is logically linked together by a globally unique address space based on the Internet Protocol (IP) or its subsequent space based on the Internet Protocol (IP) or its subsequent extensions/follow-ons;extensions/follow-ons;

(ii) is able to support communications using the (ii) is able to support communications using the Transmission Control Protocol/Internet Protocol (TCP/IP) Transmission Control Protocol/Internet Protocol (TCP/IP) suite or its subsequent extensions/follow-ons, and/or other suite or its subsequent extensions/follow-ons, and/or other IP-compatible protocols; and IP-compatible protocols; and

(iii) provides, uses or makes accessible, either publicly or (iii) provides, uses or makes accessible, either publicly or privately, high level services layered on privately, high level services layered on or integrated withor integrated with the communications and related infrastructure described the communications and related infrastructure described herein.herein.

Social and Political DimensionsSocial and Political Dimensions

Most Nation’s had committed to ISO protocolsMost Nation’s had committed to ISO protocols Yet TCP/IP won out in the final analysisYet TCP/IP won out in the final analysis Many reasons why; critical mass, many organizations Many reasons why; critical mass, many organizations

helped, no significant benefit to changing, etc.helped, no significant benefit to changing, etc.

Formation of ICCB, IAB, IETF, etc enabled the Formation of ICCB, IAB, IETF, etc enabled the net to evolvenet to evolve

NSF strategy of fostering independent networks NSF strategy of fostering independent networks - expanded participation without central control- expanded participation without central control

Boucher Bill allowed commercializationBoucher Bill allowed commercialization

The World Embraces the InternetThe World Embraces the Internet

Who is in Charge of the Internet?Who is in Charge of the Internet?Who is in Charge of the World Economy?Who is in Charge of the World Economy?World Summit in Geneva – December, 2003World Summit in Geneva – December, 2003And a host of follow-activities:And a host of follow-activities:

ITU Workshop – February, 2004ITU Workshop – February, 2004UN ICT Task Force Global Forum – March, 2004UN ICT Task Force Global Forum – March, 2004Working Group on Internet Governance (WGIG)Working Group on Internet Governance (WGIG)Phase II of the World Summit in Tunis – Nov. ’05Phase II of the World Summit in Tunis – Nov. ’05

Infrastructure DevelopmentInfrastructure Development

What is so hard about it?What is so hard about it? Making it scalable over platforms, size and timeMaking it scalable over platforms, size and time Achieving Critical MassAchieving Critical Mass

Getting Buy inGetting Buy in Pleasing many essential participantsPleasing many essential participants Displacing prior capabilitiesDisplacing prior capabilities Structuring matters to deal with concerns about empire Structuring matters to deal with concerns about empire

buildingbuilding

It’s a lot easier to create brand new capabilities It’s a lot easier to create brand new capabilities than to affect existing means of operationthan to affect existing means of operation

Infrastructure Creation is a Infrastructure Creation is a Subtractive ProcessSubtractive Process

Infrastructure reduces a common, shared Infrastructure reduces a common, shared capability to its basic and essential attributescapability to its basic and essential attributes

These attributes are not always recognized or These attributes are not always recognized or understood up frontunderstood up front

Upon further scrutiny, capabilities are usually Upon further scrutiny, capabilities are usually deleted from a well-conceived architecture deleted from a well-conceived architecture over timeover time

Consensus develops when no more can be Consensus develops when no more can be removed without disabling the infrastructureremoved without disabling the infrastructure

What is the Problem?What is the Problem?

Managing information in the Net over very long Managing information in the Net over very long periods of time – e.g. centuries or moreperiods of time – e.g. centuries or more

Dealing with very large amounts of information in Dealing with very large amounts of information in the Net over timethe Net over time

When information, its location(s) and even the When information, its location(s) and even the underlying systems may change dramatically underlying systems may change dramatically over timeover time

Respecting and protecting rights, interests and Respecting and protecting rights, interests and valuevalue

A Meta-level ArchitectureA Meta-level Architecture

Allows for arbitrary types of information Allows for arbitrary types of information systemssystems

Allows for dynamic formatting and data Allows for dynamic formatting and data typingtyping

Can accommodate interoperability Can accommodate interoperability between multiple different information between multiple different information systemssystems

Allows metadata schema to be identified Allows metadata schema to be identified and typedand typed

Digital Object Architecture:Digital Object Architecture:MotivationMotivation

To To reformulate the Internet architecturereformulate the Internet architecture around the around the notion of uniquely identifiable data structuresnotion of uniquely identifiable data structures

Enabling existing and new types of information to be Enabling existing and new types of information to be reliably managed and accessed in the Internet reliably managed and accessed in the Internet environment environment over long periods of timeover long periods of time

Providing mechanisms to stimulate innovation, the Providing mechanisms to stimulate innovation, the creation of dynamic new forms of expression and to creation of dynamic new forms of expression and to manifest older formsmanifest older forms

While supporting intellectual property protection, fine-While supporting intellectual property protection, fine-grained access control, and enable well-formed grained access control, and enable well-formed business practices to emergebusiness practices to emerge

Digital Object ArchitectureDigital Object Architecture Technical ComponentsTechnical Components

Digital Objects (DOs)Digital Objects (DOs) Structured data, independent of the platform on which it was Structured data, independent of the platform on which it was

createdcreated Consisting of “elements” of the form <type,value>Consisting of “elements” of the form <type,value> One of which is its unique, persistent identifierOne of which is its unique, persistent identifier

Resolution of Unique IdentifiersResolution of Unique Identifiers Maps an identifier into “state information” about the DOMaps an identifier into “state information” about the DO Handle System is a general purpose resolution systemHandle System is a general purpose resolution system

RepositoriesRepositories from which DOs may be accessed from which DOs may be accessed And into which they may be depositedAnd into which they may be deposited

Metadata RegistriesMetadata Registries Repositories that contain general information about DOsRepositories that contain general information about DOs Supports multiple metadata schemesSupports multiple metadata schemes Can map queries into unique DO specifications (via handles)Can map queries into unique DO specifications (via handles)

What is a Digital ObjectWhat is a Digital Object Defined data structureDefined data structure, machine independent, machine independent Consisting of a set of elementsConsisting of a set of elements

Each of the form Each of the form <type,value><type,value> One of which is the One of which is the unique identifierunique identifier

Identifiers are known as “Handles”Identifiers are known as “Handles” Format is Format is “prefix/suffix”“prefix/suffix” Prefix is unique to a naming authorityPrefix is unique to a naming authority Suffix can be any string of bits assigned by that authoritySuffix can be any string of bits assigned by that authority

Data structure can be parsed; types can be resolved within the Data structure can be parsed; types can be resolved within the architecturearchitecture

Associated Associated properties recordproperties record and and transaction record transaction record containing containing metadata and usage informationmetadata and usage information

Interoperability & Federated Interoperability & Federated RepositoriesRepositories

Create a cohesive interoperable collection Create a cohesive interoperable collection of repository-based systemsof repository-based systems Initially, perhaps, around a core set of Initially, perhaps, around a core set of

projects, content, applications and/or projects, content, applications and/or organizations as in ADL organizations as in ADL

Demonstrate interoperability between Demonstrate interoperability between different repository collectionsdifferent repository collections

Develop procedures to insure continued Develop procedures to insure continued accessibility to key archival information accessibility to key archival information

Repository NotionRepository Notion

Any Hardware & SoftwareConfiguration

Logical External Interface

RAP

RepositoryAccess Protocol

Repositories & Digital ObjectsRepositories & Digital Objects

REPOSITORY

IPv6

Each DigitalObject has itsown unique & persistent ID

Content Providerswant to assign Ids

Could be upwardsof trillions of DOsper Repository

Objects may beReplicated inMultiple Repositories

Handle SystemHandle System Distributed Identifier Service on the InternetDistributed Identifier Service on the Internet

First General Purpose Resolution systemFirst General Purpose Resolution system

Can be used to Can be used to locate repositorieslocate repositories that contain digital objects given that contain digital objects given their handlestheir handles - - and more!and more!

Other indirect referencesOther indirect references Public Keys, Authentication information for DosPublic Keys, Authentication information for Dos

Accommodates interoperability between many different information Accommodates interoperability between many different information systems; for examplesystems; for example DNS was demonstrated on the Handle System in preparation for Y2KDNS was demonstrated on the Handle System in preparation for Y2K Can support ENUM, RFID, and moreCan support ENUM, RFID, and more

Attributes of the Handle SystemAttributes of the Handle System

The basic Architecture of the Handle System The basic Architecture of the Handle System is is flat, scaleable, and extensibleflat, scaleable, and extensible

Logically central, but physically decentralizedLogically central, but physically decentralized Supports Supports Local Handle ServicesLocal Handle Services, if desired, if desired Handle resolutions return entire “Handle Handle resolutions return entire “Handle

Records” Records” or portions thereofor portions thereof Handle Records are alsoHandle Records are also

digital objectsdigital objectssigned by the serverssigned by the serversdoubly certificated by the systemdoubly certificated by the system

Resolution MechanismResolution Mechanism

Multiple SitesMultiple Servers

Handle System<www.handle.net>

Handle

HandleRecord

• System is non –nodal• Scaleable & Distributed• Supports global (and local) resolution• With backup for reliability, mirroring for efficiency

Managing Rights & InterestsManaging Rights & Interests Not just about copyrightNot just about copyright Terms and Conditions (T&Cs) for use may be Terms and Conditions (T&Cs) for use may be

contained within each DO; also information contained within each DO; also information about intrinsic value, such as monetary valueabout intrinsic value, such as monetary value

T&Cs are intended to indicate clearly what one T&Cs are intended to indicate clearly what one can and/or cannot docan and/or cannot do with a given DO, where with a given DO, where such clarity is intended by the owner of the DOsuch clarity is intended by the owner of the DO

Not an enforcement means, although it may be Not an enforcement means, although it may be used by an enforcement systemused by an enforcement system

Mobile programs that are Digital Objects may Mobile programs that are Digital Objects may apply such terms to themselves and to any apply such terms to themselves and to any digital objects they containdigital objects they contain

Handle FormatHandle Format

Prefix Authority

Item ID(any format)

Prefix Suffix

In use, a Handle is an opaque string.

2304.40/1234 Other examples ofHandles

2304/general info2304/12304. HQ/staff2304.1/memo1232304.22.Pub/2004

Direct Access and ProxiesDirect Access and Proxies

DirectAccess

One or moreProxy Servers

IndirectAccess

Redirection of Handle RequestsRedirection of Handle Requests

DirectAccess

DirectAccess

One or moreLocal Handle Services

General Registry of allNaming Authorities

RedirectionInformation

RedirectionInformation

ConclusionsConclusions

Managing Digital Objects for long-term access is a Managing Digital Objects for long-term access is a key challengekey challenge

Initial Technology Components are available; Initial Technology Components are available; Industry is expected to generate more over timeIndustry is expected to generate more over time

Third-party value-added providers in the private Third-party value-added providers in the private sector will ultimately shape the long-term evolutionsector will ultimately shape the long-term evolution

Interoperability and reliable information access is a Interoperability and reliable information access is a critical objectivecritical objective

A diversity of applications (with user-friendly A diversity of applications (with user-friendly interfaces) need to be developed & deployedinterfaces) need to be developed & deployed

The ADL Project can have a central role to play in The ADL Project can have a central role to play in demonstrating the technology and using it effectivelydemonstrating the technology and using it effectively