Web Infrastructure Team
-
Upload
linus-jenkins -
Category
Documents
-
view
22 -
download
1
description
Transcript of Web Infrastructure Team
![Page 1: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/1.jpg)
Web Infrastructure Team
Our Services and our Hardware
Owen Le Blanc
![Page 2: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/2.jpg)
Outline
Services we provide Hardware we manage Virtual machines Software Managing it all
![Page 3: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/3.jpg)
Summary of Services
Web services Portal service Information Publication Load balancing Databases
AFS Xen External Hosting Virtual Hosts Minor services Development
![Page 4: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/4.jpg)
Web Services
Apache Software ESD Tomcat Content
Managemt User admin (ssl)
20 servers 2 servers 3 servers? 3 servers
+ devel + test
1 server
![Page 5: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/5.jpg)
Portal service
Web servers Development Mysql
8 servers 9 servers 2 servers
![Page 6: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/6.jpg)
Information Services
Anonymous FTP rsync ntp Request Tracker Web Log
processing, anal
1 server 2 servers 1 server 2 servers 2 servers
![Page 7: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/7.jpg)
Publication Services
ssh sftp
ftp
3 servers
2 servers
![Page 8: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/8.jpg)
Load Balancing
ipvsadm heartbeat,
pacemaker ssh
2 servers
![Page 9: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/9.jpg)
Databases, etc
MySQL Postgres Subversion CVS
9 servers 2 servers 3 servers 1 server
![Page 10: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/10.jpg)
Andrews File System
Kerberos servers Database servers
File servers special file servers
Backup servers
3 servers 12 servers
2 servers
2 servers
![Page 11: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/11.jpg)
![Page 12: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/12.jpg)
Xen
Xen hosts (ours) Portal EPS Manc City Art G
49 machines 4 machines 2 machines 1 machine
![Page 13: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/13.jpg)
External Servers (1)
Ensembl Phoenix Access Grid
Recording service NCESS EMU
2 servers 1 server 1 server
1 server 1 server
![Page 14: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/14.jpg)
External Servers (2)
MACE Azura Group EPS Intranet Equella project Genetic Research
Museum java devel
1 server 3? servers 6 servers 2 servers 1 server 1 server
![Page 15: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/15.jpg)
Virtual Hosts
Email development
Physics web site Status web site
1 servers 1 server 2 servers
![Page 16: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/16.jpg)
Minor Services
AFS mail Web Farm mail tftp administration cron jobs mirroring
1 server 1 server 1 server 1 server 1 server 1 server
![Page 17: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/17.jpg)
Development
Compilation Testing
AFS Java MySQL Xen IPVS/Heartbeat
4 servers
3 servers 2 servers 1 server 2 servers 2 servers
![Page 18: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/18.jpg)
Machines
Development Xen servers Other servers Portal servers External (!xen) Total
11 49 16 5 18 99 machines
![Page 19: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/19.jpg)
Virtual Hosts
151 virtual hosts under Xen: 1 fully virtualised
![Page 20: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/20.jpg)
Disk Format (Xen, standalone)
unmounted partition
/
/var
swap
LVM
![Page 21: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/21.jpg)
Software
Debian lenny,squeeze ipvsadm, heartbeat, pacemaker Xen, LVM OpenAFS Closely parallel machines Rapid deployment “Daily” security patching
![Page 22: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/22.jpg)
Documentation (1)
Mirrors of package documents http://orgs.man.ac.uk/documentation/
Wiki http://wiki.manchester.ac.uk/websupport/
My web site http://people.man.ac.uk/~zlsiial/docs/
Software and configuration area /afs/mcc.ac.gb/common/config/
![Page 23: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/23.jpg)
Documentation (2)
System backup area /afs/mcc.ac.gb/ftp/.private/misc/backups/
admin folder .../web/farm/Admin/
Email various places in /afs/
![Page 24: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/24.jpg)
Documentation (2)
System backup area /afs/mcc.ac.gb/ftp/.private/misc/backups/
admin folder .../web/farm/Admin/
Email various places in /afs/
![Page 25: Web Infrastructure Team](https://reader030.fdocuments.us/reader030/viewer/2022032805/56813211550346895d986885/html5/thumbnails/25.jpg)
Managing It All
Database of machines Automate as much as possible Use standard versions
As little local compilation as possible As little locally written software as possible
Revise and rethink