Linux never has been and never will be “Extreme”Linux never has been and never will be...
Transcript of Linux never has been and never will be “Extreme”Linux never has been and never will be...
![Page 1: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/1.jpg)
Linux never has been and never will be “Extreme”
Arthur B. (Barney) MaccabeComputer Science Department
Center for High Performance ComputingThe University of New Mexico
Salishan April 23, 2003
![Page 2: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/2.jpg)
Sal
isha
n A
pril
23, 2
003
1
This talk was prepared on a Debain Linux box
http://www.debian.org
using OpenOffice
http://www.openoffice.org
![Page 3: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/3.jpg)
Sal
isha
n A
pril
23, 2
003
1
Outline
● My background: lightweight operating systems
● Linux and world domination
● Adapting to innovative technologies
● What is Linux?
● OS Research
● Summary
![Page 4: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/4.jpg)
Sal
isha
n A
pril
23, 2
003
1
SUNMOS: Sandia/UNM OS
● Lightweight, Compute Node OS– Developed for 1024 node nCUBE 2– Ran on Intel Paragon (1800+ nodes)
OSF-1/AD didn't scale until a few years later
● Intel Paragon– SUNMOS 256KB
OSF-1/AD 10-12MB16 MB memory / node
– 4KB to 4MB page: 25% application improvement4 TLB entries
![Page 5: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/5.jpg)
Sal
isha
n A
pril
23, 2
003
1
Puma/Cougar
● Follow-on to SUNMOS
● Compute node OS forIntel Tflops, ASCI/Red
– 4500+ compute nodes
● 2 333MHz Pentium II/node
● 256MB/node
– Applications show 60-70% scaling efficiency
● Is it the OS or the machine?
● Rogue OS effects (daemons, etc)
![Page 6: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/6.jpg)
Sal
isha
n A
pril
23, 2
003
1
CPlant(tm)
● 1500+ 466MHz Alpha EV6● Myrinet LANai-7 and LANai-9● Red/Black switching● Re-create systems software
from ASCI/Red– High-performance message passing (Portals)– Application launch– System management tools
● Linux(tm) on service and compute nodes“World's largest Linux cluster”
![Page 7: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/7.jpg)
Sal
isha
n A
pril
23, 2
003
1
A Linux Mismatch
● Partition model– Specialization in
hardware and software● Linux responds to
application requests– Resources do not initiate requests
(inetd is a bit of a kludge)● Compute node OS is a slave to service
nodes– Cplant copies image to RAM disk and exec– Bproc uses process migration
Serv
ice
Compute
I/O
![Page 8: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/8.jpg)
Sal
isha
n A
pril
23, 2
003
1
Linux on Cplant Compute Nodes
● Original plan:– use Linux to start, build communication
layers– port Cougar later
● Linux turned out to be OK– Compute to communication imbalance– Linux isn't horribly broken– Open source is a good thing– People want to talk about and work on Linux
● It's not all roses– Lots of distractions (see above)
![Page 9: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/9.jpg)
Sal
isha
n A
pril
23, 2
003
1
Numbers
![Page 10: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/10.jpg)
Sal
isha
n A
pril
23, 2
003
1
Scaling & Related Issues
● ASCI/Red 60-70% scaling efficiency for applications
– Machine or OS?
– How much do the apps contribute?
● Horror stories:
– Typical scaling efficiency is closer to 10%
– Barriers that take up to an hour!
– “Rogue OS effects”
![Page 11: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/11.jpg)
Sal
isha
n A
pril
23, 2
003
1
Comparing Linux and Cougar
● Port Linux to compute nodes of ASCI/Red– started with 2.4.18, now using 2.4.20– original version was to port Cougar to Cplant
● Direct comparison of Linux and Cougar● Nighten
– ASCI/Red development system– 144 nodes
● Nodes– Dual 333 MHz Pentium II's– 256 MB
![Page 12: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/12.jpg)
Sal
isha
n A
pril
23, 2
003
1
Arrrrrrgh!
2 405
10152025303540455055606570
CG
LinuxCougar
Nodes
Mop
s/se
c
![Page 13: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/13.jpg)
Sal
isha
n A
pril
23, 2
003
1
Whew!
2 4 8 16 32 64 1280
100200300400500600700800900
1000110012001300
CG
LinuxCougar
Nodes
Mop
s/se
c
![Page 14: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/14.jpg)
Sal
isha
n A
pril
23, 2
003
1
More (good) Data
4 8 16 32 64 1280
20
40
60
80
100
120
140
160
180
ISLinux Cougar
Nodes
Mop
s/se
c
2 4 8 16 32 64 1280
500
1000
1500
2000
2500
3000
3500
4000
4500
MGLinux Cougar
Nodes
Mop
s/se
c
![Page 15: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/15.jpg)
Sal
isha
n A
pril
23, 2
003
1
Lies, lies, lies
● Bandwidth– Cougar: >300 MB/s– Linux: <35 MB/s
● Latency– Cougar: 20 usec– Linux: 90 usec
● MPI– Cougar: MPI / Portals 2.0– Linux: MPICH 1.2.5 / P4 / TCP / IP /
skbufsIntegrate Portals into Linux on ASCI/Red
![Page 16: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/16.jpg)
Sal
isha
n A
pril
23, 2
003
1
World Domination
![Page 17: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/17.jpg)
Sal
isha
n A
pril
23, 2
003
1
Linux and World Domination
Time
Syst
em S
cale
largest system
largest reasonableLinux system
Beowulf
CplantPink/MCR
2.2 2.4 2.6
![Page 18: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/18.jpg)
Sal
isha
n A
pril
23, 2
003
1
Hardware Trends Help Linux
● Memory– Paragon: 16 MB– ASCI/Red: 256 MB – Cplant: 1 GB
● TLB entries– Paragon: 4– ASCI/Red: 64– Cplant: 128(?)
● Processor speeds– Paragon: 50
MHz – ASCI/Red: 333
MHz– Cplant: 466
MHz● Relative networking
– Paragon: 200 MB/s
– ASCI/Red: 400 MB/sC l t 100
Management of node resources is not as critical
![Page 19: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/19.jpg)
Sal
isha
n A
pril
23, 2
003
1
Linux Helps Itself
● Easy to disable most daemons– Eliminate “Rogue OS” effects
● Really bad things can be turned off– malloc() uses mmap– out of memory killer– 1000 Interrupts/second on Alpha
● Good things being added– hugetlb pages
● Horrible things get fixed– Time goes backwards in 2.4.18 SMP mode
![Page 20: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/20.jpg)
Sal
isha
n A
pril
23, 2
003
1
HPC Community Helps Linux
● System environments– Cplant(tm)– Scyld(tm)– Clustermatic(tm)– OSCAR(tm)
● Hardware support– Linux BIOS– Supermon
● Vendors– Drivers available
● Myricom, Quadrics, SCI, etc.
– Major vendors support Linux
● IBM, HP, Dell– Specalized vendors
● Linux Networx, Pro Micro, Atipa, Racksaver, ....
![Page 21: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/21.jpg)
Sal
isha
n A
pril
23, 2
003
1
The Obvious Conclusion
If you wait long enough, Linux will run well on your system– Hardware improves– Linux improves– The community works
If you wait long enough, your application will run just fine on a sequential system
World Domination
![Page 22: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/22.jpg)
Sal
isha
n A
pril
23, 2
003
1
Cool Things with Linux
● Vertigo: Automatic Performance-Setting for Linux– Flauter (ARM) & Mudge (Michigan)
– OSDI, December 2002
● Transparent superpages for FreeBSD– Navarro, Iyer, Druschel & Cox (Rice)
– OSDI, December 2002
– FreeBSDIs the goal to show that Linux can work, or to build a working system?
![Page 23: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/23.jpg)
Sal
isha
n A
pril
23, 2
003
1
Some Other Observations
● Barney's favorite wine:“The Linux community doesn't care about
HPC”● We haven't made a the case for any single feature● The HPC community is hard to define:
Extreme Linux forum was not so extreme
● Linux direction is not focused on HPC– Servers and desktops
● Linux on Red Storm?– How much risk? How soon?
![Page 24: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/24.jpg)
Sal
isha
n A
pril
23, 2
003
1
Fundamental Conflict
● Working on Linux benefits more people
– Broader code base
– Well understood environment
● Specialized solutions work sooner
– More readily adaptable
– Designed specifically for the system
![Page 25: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/25.jpg)
Sal
isha
n A
pril
23, 2
003
1
Work on Linux
Work on specializedsolutions
Obvious Response
Time
Syst
em S
cale
largest system
largest reasonableLinux system
![Page 26: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/26.jpg)
Sal
isha
n A
pril
23, 2
003
1
Dealing with Innovation
![Page 27: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/27.jpg)
Sal
isha
n A
pril
23, 2
003
1
Innovative Technologies
Time
Syst
em S
cale
DARPA HPCS
largest reasonableLinux system
largest system
![Page 28: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/28.jpg)
Sal
isha
n A
pril
23, 2
003
1
Barney's Favorite Architecture
ProcessingElements
NIC
Memory
Network
When will it run Linux?
![Page 29: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/29.jpg)
Sal
isha
n A
pril
23, 2
003
1
What is Linux?
![Page 30: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/30.jpg)
Sal
isha
n A
pril
23, 2
003
1
Linux is an API
The Linux API – Resource abstraction and management
Application
Application
Application
Application
![Page 31: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/31.jpg)
Sal
isha
n A
pril
23, 2
003
1
Application
stdio
Linux is an Environment
The Linux API
socketslibrary
Linux Device Drivers
MPICH
glibc GM
libraryand
drivers
BLASMPICH-GM
![Page 32: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/32.jpg)
Sal
isha
n A
pril
23, 2
003
1
API: Syntax and Semantics
● Syntax: Operation signature– name (index) of system call– number and types of parameters– Linux has ~250 system calls
● Semantics: Relative costs– how much does fork cost?– how long does read take?– what does malloc really do?
Syntax is fairly easy, Semantics is hard
![Page 33: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/33.jpg)
Sal
isha
n A
pril
23, 2
003
1
What else is there?
![Page 34: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/34.jpg)
Sal
isha
n A
pril
23, 2
003
1
OS Research: History
● Synchronization is fundamentally hard● File systems are neat● Structure is the way to manage complexity● You can do anything as long as it is Mach
– structure is important● 100's of man-years of investment
– Middleware– Extensible OSes– OS Bypass
![Page 35: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/35.jpg)
Sal
isha
n A
pril
23, 2
003
1
OS Design Approaches
● Monolithic
– Modular
– Lightweight
● Micro-kernels
● Extensible
● Exo-kernels
● OS Bypass
OS Kernel
Application
Application
ResourceResource
Application
Application
Application
Application
ResourceResourceResourceResource
![Page 36: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/36.jpg)
Sal
isha
n A
pril
23, 2
003
1
Monolithic Approaches
● OS controls access to all resources – Modular: for variety of resources– Lightweight: limit resources and features
OS KernelOS KernelModuleModul
e
ResourceResourceResourceResourceResourceResource ResourceResource ResourceResource
Application
Application
Application
Application
Application
Application Applicatio
n
Application
Application
Application
![Page 37: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/37.jpg)
Sal
isha
n A
pril
23, 2
003
1
Micro- & Exo- kernels
Micro-kernels● OS routes messages
● Servers control resources
OS Kernel
ServerServer
Remote server
ResourceResource
Application
Application
Exo-kernels● User level OS
● Resources manage themselves
● Applications run independent OSes
Application
ApplicationOperating
System
OperatingSystem
ExoExoResourceResource
Application
ApplicationOperating
System
OperatingSystem
ExoExoResourceResource
![Page 38: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/38.jpg)
Sal
isha
n A
pril
23, 2
003
1
Extensible Kernels
● Run application code in the kernel – Direct access to resources– Avoid interrupt costs– Avoid syscall overheads
OS KernelExtension
ResourceResource ResourceResourceResourceResource
Application
Application
Application
Application
Application
Application
![Page 39: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/39.jpg)
Sal
isha
n A
pril
23, 2
003
1
OS Bypass & Splintering
OS Bypass● Bypass the OS for
resources that are used intensively
OS Kernel Use
Allocate
Allocate
ResourceResource
Application
Application
Splintering● OS remains in charge
● Control goes through OS
● Data transfer is direct
SplinterSplinter
OS Kernel
ResourceResource
Data
Control
Control
Application
Application
SplinterSplinter
![Page 40: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/40.jpg)
Sal
isha
n A
pril
23, 2
003
1
Close to the end
![Page 41: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/41.jpg)
Sal
isha
n A
pril
23, 2
003
1
Why is OS work hard?
● Design?That's the fun part
● Variety of applications?We don't care about all that many applications
● Variety of hardware?We don't really care about that much hardware:
processors, memory, timer/clock, network cards, serial interfaces
● Buggy hardware?This is a big problem
![Page 42: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/42.jpg)
Sal
isha
n A
pril
23, 2
003
1
Dealing with Buggy Hardware
ApplicationApplication● Start with Linux BIOS (Thanks Ron Minnich)
● Steal Linux drivers, without modification, whenever possible
● Write specialized drivers where needed– Communication– Memory
Standard Compile/LibraryStandard Compile/Library
Linux BIOSLinu
x dr
iver
Linu
x dr
iver
Linu
x dr
iver
Linu
x dr
iver
Spec
ial d
rive
r
Spec
ial d
rive
r
Buggy HardwareBuggy Hardware
Roll your own OS
Linux Compatibility
![Page 43: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/43.jpg)
Sal
isha
n A
pril
23, 2
003
1
Summary
● Observation: Linux will always catch up (is Windows far behind?)– If you can afford to wait, you should– If you're waiting, work on improving Linux
● My goal is to build systems that work now– Strategy: use Linux and feedback into Linux
● OS structure research is important– It's not that expensive– Selecting a winner too early is destructive– Don't over value what you have
![Page 44: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/44.jpg)
Sal
isha
n A
pril
23, 2
003
1
6/7/8/9
![Page 45: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/45.jpg)
Sal
isha
n A
pril
23, 2
003
1
Operating Systems
● Multics: Imagine what we could do● Unix: This is what we can do● BSD: Wizards may play with the code● Mach: We can do anything, with
nothing● Windows: We can make lots of money● MacOS: Isn't this pretty?● Plan 9: We can do less now● Linux: We don't need no money.
Here's the code, have fun!B OS X d C i
![Page 46: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/46.jpg)
Sal
isha
n A
pril
23, 2
003
1
Strategy
● Reductionism (in theory)– break a system into its parts and study the parts
in isolation– the fun comes when you try to re-integrate all the
parts● Reductionism (in systems)
– identify crucial features, build a simplified version of the full system
– the fun comes when you try to add features
![Page 47: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/47.jpg)
Sal
isha
n A
pril
23, 2
003
1
OS Concepts
● BIOS & High Level languages– stand alone machines– scheduling through reservations
● Multiprogramming– hide latency for long I/O operations
● users are too stupid, lazy or unmotivated to figure out nonblocking operations
– optimize processor utilization● Timesharing
– humans are really slow– optimize response time
![Page 48: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/48.jpg)
Sal
isha
n A
pril
23, 2
003
1
What is “Extreme”?
● Resource constrained computing● For my desktop, the resources are
applications and familiarity● For my laptop it's battery life, screen size,
applications and familiarity● We probably want to talk about physical
resources:– processors– memory– communication
![Page 49: Linux never has been and never will be “Extreme”Linux never has been and never will be “Extreme” Arthur B. (Barney) Maccabe Computer Science Department Center for High Performance](https://reader034.fdocuments.us/reader034/viewer/2022042709/5f3f6fda2c06a905ed0f301a/html5/thumbnails/49.jpg)
Sal
isha
n A
pril
23, 2
003
1
Extreme Systems
● OS defines resource access mechanisms– required of all processes
● Frequently, mechanisms include policies– consider malloc
● Cannot tolerate abuse of critical resource● Bypass, if possible● Hack if possible and necessary● Design and implement mechanisms that
work