Lab Zero: A First Experiment using GENI
description
Transcript of Lab Zero: A First Experiment using GENI
![Page 1: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/1.jpg)
Sponsored by the National Science Foundation
Lab Zero:A First Experiment using GENI
Sarah EdwardsGENI Project Office
![Page 2: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/2.jpg)
Sponsored by the National Science Foundation 2Lab Zero – July 21, 2014
Hands On Exercise
Do a Simple Experiment in GENI
Reserve two VMs connected at Layer 2
Layer 2VMVM
![Page 3: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/3.jpg)
Sponsored by the National Science Foundation 3Lab Zero – July 21, 2014
Understand GENI Terminology
slice project
aggregate
experimenterresource
![Page 4: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/4.jpg)
Sponsored by the National Science Foundation 4Lab Zero – July 21, 2014
Use the GENI Portal and Flack
![Page 5: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/5.jpg)
Sponsored by the National Science Foundation 5Lab Zero – July 21, 2014
Experiment Workflow• Part I: Design/Setup
• Part II: Execute
• Part III: Finish
![Page 6: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/6.jpg)
Sponsored by the National Science Foundation 6Lab Zero – July 21, 2014
The GENI Portal is…
A web-based tool for experimenters to manage experimenters, projects, and slices.
Includes simple tools to reserve resources.
More to come in the future.
![Page 7: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/7.jpg)
Sponsored by the National Science Foundation 7Lab Zero – July 21, 2014
Flack is …
A graphical user interface (GUI) for: – designing topologies in GENI– reserving resources in GENI
![Page 8: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/8.jpg)
Sponsored by the National Science Foundation 8Lab Zero – July 21, 2014
Experimenter
An experimenter is a researcher who uses GENI resources
Different types of experimenters have different roles and permissions:• Advisor vs Grad Student• Teacher vs TA vs Student Experimenter
![Page 9: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/9.jpg)
Sponsored by the National Science Foundation 9Lab Zero – July 21, 2014
Projects
Projects organize research in GENI
ProjectLead
Members
Slice
Projects contain both people and their experimentsA project is led by a single responsible individual:
the project lead Today we will use a
project created for this class
![Page 10: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/10.jpg)
Sponsored by the National Science Foundation 11Lab Zero – July 21, 2014
Experiment Workflow• Part I: Design/Setup
• Part II: Execute
• Part III: Finish
![Page 11: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/11.jpg)
Sponsored by the National Science Foundation 12Lab Zero – July 21, 2014
Part I: Establish Management Environment
1 Pre-work: Design your experiment
2.1 Pre-work: Create a GENI account
2.2 Pre-work: Project lead (aka professor) adds you to project
Project Name: GREESC14
2.3 Generate and Download SSH KeypairTutorial instructions:http://groups.geni.net/geni/wiki/GENIExperimenter/Tutorials/GettingStarted_PartI/Procedure
![Page 12: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/12.jpg)
Sponsored by the National Science Foundation 13Lab Zero – July 21, 2014
Creating a GENI account
• GENI Portal is at:
https://portal.geni.net • Instructions for creating an account are:
http://groups.geni.net/geni/wiki/SignMeUp
![Page 13: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/13.jpg)
Sponsored by the National Science Foundation 15Lab Zero – July 21, 2014
InCommon
For many experimenters:• no new passwords• familiar login screens
Leverage InCommon forsingle sign-on authentication
Experimenters from 304 educational and research institutions have InCommon accounts
![Page 14: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/14.jpg)
Sponsored by the National Science Foundation 16Lab Zero – July 21, 2014
Using SSH with a public/private keypair
Login to all GENI compute resources using ssh with a private key
1. The public key is loaded onto the node when you reserve resources.
2. You provide the private key when you log into the node.
There are several ways to offer your private key to ssh.
You should never be prompted for a password to log into a GENI compute node.If you are, something has always gone wrong.
No password!
![Page 15: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/15.jpg)
Sponsored by the National Science Foundation 17Lab Zero – July 21, 2014
SSH with a password
ssh
Experimenter
local> ssh [email protected] [email protected]’s password:########Welcome to remote!jdoe@remote> exitlocal> ssh [email protected]@remote2.edu’s password:########
Hash of password stored on each remote machine
User enters passwordonce for each connection to each machine
*nix-based system (Windows behavior may vary)
![Page 16: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/16.jpg)
Sponsored by the National Science Foundation 18Lab Zero – July 21, 2014
SSH with a private key
Experimenter
local> ssh-add ~/.ssh/id_rsaEnter passphrase for ~/.ssh/id_rsa:########local> ssh [email protected] Welcome to remote!jdoe@remote> exitlocal> ssh [email protected] Welcome to remote2!jdoe@remote2> exitlocal> ssh [email protected] Welcome to remote3!jdoe@remote3> exit
ssh
Public key is stored on each remote machine
User enters passphrase to unlock private key for all connections to all machine
Private key is stored only on local machine
*nix-based system (Windows behavior may vary)
![Page 17: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/17.jpg)
Sponsored by the National Science Foundation 20Lab Zero – July 21, 2014
Expiration and renewal
slice expiration time ≤ project expiration timeeach resource expiration time ≤ slice expiration time
each resource expiration time ≤ aggregate’s max expiration
project
slice
resource(optional)
project expiration time
slice expiration time
resource expiration timenow
In general, to extend the lifetime of your resource reservation, you must renew the slice and all resources
resourceresource
![Page 18: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/18.jpg)
You are here
Projects
Slices
Log Messages
HelpProfile
Tools
Map
![Page 19: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/19.jpg)
2Login
Join Project
Generate SSH Keys
![Page 20: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/20.jpg)
On your local machine…
> mv ~/Downloads/id_geni_ssh_rsa ~/.ssh/.> chmod 600 ~/.ssh/id_geni_ssh_rsa> ssh-add ~/.ssh/id_geni_ssh_rsa
2
![Page 21: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/21.jpg)
Sponsored by the National Science Foundation 24Lab Zero – July 21, 2014
Resource
A resource is a piece of infrastructure
A resource can be real or virtual.
Resource specifications (aka. RSpecs) are used to describe and request resources.
Examples:• Compute: computer vs virtual machine (VM)• Wireline Network: VLAN or OpenFlow• Wireless: WiMAX
![Page 22: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/22.jpg)
Sponsored by the National Science Foundation 25Lab Zero – July 21, 2014
Aggregate
An aggregate manages a set of reservable resources
Aggregates include:GENI racksOpenFlow WiMAX
InstaGENI Rack ExoGENI Rack
![Page 23: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/23.jpg)
Sponsored by the National Science Foundation 26Lab Zero – July 21, 2014
Slice
A slice is a container of resources used in an experiment.
A slice can contain resources from one or more aggregates
A slice is in a single project
A slice has an expiration
Slice names are public, reusable and unique (within a project)
![Page 24: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/24.jpg)
Sponsored by the National Science Foundation 27Lab Zero – July 21, 2014
Experimenter(aka Student)
Putting it all together
slice
aggregate
project Member:Lead:
Experimenter(aka Professor)
Layer 2resourceresource
![Page 25: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/25.jpg)
Sponsored by the National Science Foundation 28Lab Zero – July 21, 2014
slice
Part I continued:Obtain Resources
3.1 Create a slice
3.2 (optional) Renew your slice
3.3 Reserve two VMs at on aggregate
3.4 Check Whether VMs are Ready to be Used
Layer 2VMVM
![Page 26: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/26.jpg)
3.1
Create Slice
![Page 27: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/27.jpg)
3.2Extend slice expiration
![Page 28: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/28.jpg)
3.3
LaunchFlack
![Page 29: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/29.jpg)
LaunchFlack
username slice name
all availableaggregates
3.3
![Page 30: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/30.jpg)
Draw two VMs connected by a link
3.3
![Page 31: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/31.jpg)
Change names of VMs
3.3
![Page 32: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/32.jpg)
3.3
Set IP and mask of interfaces
![Page 33: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/33.jpg)
Reserve resources
3.3
![Page 34: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/34.jpg)
Resources are READY!!!
3.4
![Page 35: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/35.jpg)
You are trying to log in to a compute node on GENI using SSH and can’t. Which are possible explanations?
a) You entered the wrong password
b) You didn’t offer the private key that matches the
public key
c) The public key wasn’t loaded onto the node
d) Permissions on the private key are too permissive
e) (b), (c), and (d)
![Page 36: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/36.jpg)
Sponsored by the National Science Foundation 39Lab Zero – July 21, 2014
Experiment Workflow• Part I: Design/Setup
• Part II: Execute
• Part III: Finish
![Page 37: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/37.jpg)
Sponsored by the National Science Foundation 41Lab Zero – July 21, 2014
Part II: Execute Experiment
4.1 Login to nodes (two nodes: client & server)5 Execute experiment
5.1 Send IP traffic5.2 Install and use iperf5.3 Bring down the server’s data interface5.4 Bring down the server’s control interface
6.1 Logout of nodes
Internet
Data Interfaces
Control Interfaces
ssh
Layer 2
Experimenter
serverclient
![Page 38: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/38.jpg)
Login4.1
![Page 39: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/39.jpg)
Sponsored by the National Science Foundation
Working with Collaborators
![Page 40: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/40.jpg)
Sponsored by the National Science Foundation 44Lab Zero – July 21, 2014
Project Membership exampleProjects have 1 Lead and any number of Admins, Members, and Auditors
http://groups.geni.net/geni/wiki/GENIConcepts#Project
Typical Class
Expiration
Typical Research Project
![Page 41: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/41.jpg)
Sponsored by the National Science Foundation 45Lab Zero – July 21, 2014
Working with multiple members in a slice
Members of all slices in a project:
• Project Leads (Professor)• Project Admins (Post-docs, researchers)Other can be added manually
Research AsstSlice Lead Post-Doc
Slice MemberProfessor
Slice Admin
http://groups.geni.net/geni/wiki/GENIConcepts#Slice
![Page 42: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/42.jpg)
Sponsored by the National Science Foundation 46Lab Zero – July 21, 2014
Slice AccessBeing a member of a slice means you can act on a slice:
– Add resources– Check status– Delete resources– Renew resources
With any tool!
![Page 43: Lab Zero: A First Experiment using GENI](https://reader035.fdocuments.us/reader035/viewer/2022062222/5681610f550346895dd0681e/html5/thumbnails/43.jpg)
Sponsored by the National Science Foundation 47Lab Zero – July 21, 2014
To ensure access in collaborator’s resources:Option 1: Make resource reservation from Portal or omniOption 2: Use a common public key
Add slice member’s accounts to existing resources:$ omni -V 3 poa SLICE geni_update_users
--useSliceAggregates –-useSliceMembersAlternatively…$ addMemberToSliceAndSlivers myslice username
Slice Access: Logging in to resources
Slice membership does not guarantee ability to login to resources!
Only works on InstaGENI/ProtoGENI