AMS IX Data Centre Standard
-
Upload
wojciech-wojcik -
Category
Documents
-
view
228 -
download
0
Transcript of AMS IX Data Centre Standard
-
8/9/2019 AMS IX Data Centre Standard
1/18
A data centre Standard for theAmsterdam Internet Exchange
A Standard defining the minimum acceptable, and also the desirable levels, of technicalimplementation, resilience of operation and business continuity management for data
centres providing services to the Amsterdam Internet Exchange
Westeinde12
NL1017ZNAmsterdam
Netherlands
www.amsix.net
-
8/9/2019 AMS IX Data Centre Standard
2/18
Amendment record
1 Draft 12-3-09 BJE
2 First issue 2-4-09 BJE
3 Second issue 6-5-09 BJE
4 Third issue 15-5-09 BJE5 Fourth issue 19-5-09 BJE
6 Fifth issue 19-10-09 BJE
TableofContents
Contents
1 Introduction........................................................................................................................ 3
2 MinimalexpectationsofAMSIX ........................................................................................ 5
3
Technicaldesign
and
implementation ............................................................................... 6
4 OperationalRequirements ............................................................................................... 13
5 BusinessContinuityrequirements ................................................................................... 14
References ............................................................................................................................... 16
Bibliography ............................................................................................................................. 16
Prepared by
B J Elliott BSc, MBA, C.Eng, MIET, MCIBSE
Capitoline LLP 2009
Capitoline LLPCapitoline House7 King Charles TerraceSovereign CloseLondon E1W 3HL
www.capitoline.eu
Amsterdam Internet Exchange Doc ref CPTL 0908-09 Copyright licensed to AMS-IX
AMS-09-001 Issue 005 19-10-09 BJE Page 2 of 18
-
8/9/2019 AMS IX Data Centre Standard
3/18
1 Introduction
Thesuccessfulandreliableprovisionofdatacentreservicesdependsuponthefollowing;
AwelldesignedandconstructedplantthattakesintoaccountappropriateStandardsandbest
practiceto
achieve
efficient
and
reliable
operation
Managementtechniquesthatputintoplaceoperatingproceduresandprotocolsthatensure
thecontinuingefficientandreliableoperationofthedatacentre
Disasterrecoveryplansthathaveanestablishedandrehearsedprocedurefordealingwithany
incident that impairs the operation of the data centre and puts in to place a recovery
programme
TechnicalStandards
TechnicalStandardsgivethebestpracticemethodsfordesigningandimplementingthedatacentre
fromaphysical,
electrical
and
mechanical
viewpoint.
Some
requirements
covering
health
and
safety
and energy management are covered by European Directives and national standards. Many
technical standards exist that cover the myriad of engineering disciplines encountered in a data
centrebuttwodocuments inparticularaddresstheengineeringaspectsofdatacentredesignand
subsequentresilienceandredundancyofthatdesign;theseare:
ANSI/TIA942:2005TelecommunicationsInfrastructureStandardsforDataCenters
and
TierClassificationsdefinesiteinfrastructureperformance.TheUpTimeInstitute,2008
TheUpTimeInstitutes(TUI)documentdefinesfourTiersofoperationthatdescribetheexpected
downtimeperyearfromadatacentrewhencertaindesignroutesaretaken.TheTIA942standard
draws heavily upon the philosophy offered in the TUI document and offers more detail in
engineeringtermsaboutwhatisrequiredtoachievetheselevels.
Onecentralplankofthephilosophy istheadoptionoftheN,N+1and2Nmethodology.Briefly,N
means enough items to do thejob at hand, N+1 means that each system has one redundant
componentand2Nmeansthatsystemsarecompletelyreplicated.Othervariantsmaybe2N+1for
example, meaning two independentsystemswhereeach systemalsohas redundantcomponents.
Ultimatelyitisariskversuscoststrategyasmorelevelsofredundancyandresiliencewillinvariably
costmore.
Organisations
are
invited
to
consider
the
costs
of
downtime
to
their
own
business
before
theydecideuponthestrategymostappropriatetotheirbusiness.
BothoftheabovestandardsareAmerican.TherearenodirectlyequivalentEuropean(CENELEC)or
international standards (ISO/IEC). The methods described in the two American documents are
mostly universal but for use in Europe the technical references contained in TIA 942 need to be
substitutedforEUDirectivesandCENELECstandardswherevernecessary.
ThehierarchyandorderofprecedenceofstandardsfortheNetherlandsis
Laws,RegulationsandStatutoryInstrumentsofTheNetherlands
Directivesof
the
European
Union
Dutchnationalstandards
Amsterdam Internet Exchange Doc ref CPTL 0908-09 Copyright licensed to AMS-IX
AMS-09-001 Issue 005 19-10-09 BJE Page 3 of 18
-
8/9/2019 AMS IX Data Centre Standard
4/18
CENELECstandards
ISO/IECstandards
Otherrelevantnationalstandards,e.g.ANSI,TIA,BSI,VDE
Industrybestpractice
BusinessContinuity
standards
Buildingadatacentretothelateststandardsandincorporatingtherequisiteavailability/redundancy
techniques isonlythefirststeptosuccessful longtermoperation. Thenextstage ismanagingthe
datacentreandbeingpreparedfortechnicalfailuresoranyothereventthatimpingesuponthedata
centreoperation.ThisareagenerallycomesundertheheadingofBusinessContinuityManagement,
BCM. BCMstandardscanbegenerallyaimedatallbusinessesandenterpriseswhereassomeare
morefocussedonInformationandCommunicationsTechnology,ICT.
ThefollowingStandardshavebeenidentifiedwhichcoverthisarea.
BS7799
3:2006
Information
security
management
systems.
Guidelines
for
information
securityriskmanagement
BSISO/IEC200001:2005Informationtechnology.Servicemanagement.Specification
BS ISO/IEC 27001:2005 Information technology. Security techniques. Information security
managementsystems.Requirements
BS ISO/IEC 27002:2005, Information technology. Security techniques.Code ofpracticefor
informationsecuritymanagement
BS25999
1:2006
Business
continuity
management,
Part
1:
Code
of
practice
BS25777:2008InformationandCommunicationsTechnologyContinuitymanagement,
CodeofPractice
BSISO/IEC17799:2005Codeofpracticeforinformationsecuritymanagement
ISO/PAS22399:2007SocietalsecurityGuidelinefor incidentpreparednessandoperational
continuitymanagement
NFPA 1600;2007 Standard on Disaster/Emergency Management and Business Continuity
Programs
InadditionwehaveITIL.ITILconsistsofaseriesofbooksgivingguidanceontheprovisionofquality
ITservices,andontheaccommodationandenvironmental facilitiesneededtosupport IT. ITILhas
been developed in recognition of organisations' growing dependency on IT and embodies best
practicesforITServiceManagement.
WealsohavePRINCE.PRINCE2isageneric,simpletofollowprojectmanagementmethod.Itcovers
howtoorganise,manageandcontrolprojects.Itisaimedatenablingyoutosuccessfullydeliverthe
rightproducts,ontimeandwithinbudget.AProjectmanagercanapplytheprinciplesofPRINCE2
and the associated training to any typeofproject. It will help to manage risk, controlqualityand
changeeffectively.
Amsterdam Internet Exchange Doc ref CPTL 0908-09 Copyright licensed to AMS-IX
AMS-09-001 Issue 005 19-10-09 BJE Page 4 of 18
-
8/9/2019 AMS IX Data Centre Standard
5/18
APRINCE2projecthasthefollowingcharacteristics:
Afiniteanddefinedlifecycle
Definedandmeasurablebusinessproducts
Acorresponding
set
of
activities
to
achieve
the
business
products
Adefinedamountofresources
Anorganisationstructure,withdefinedresponsibilities,tomanagetheproject.
InasurveybyContinuityCentralmagazineofdatacentremanagers inNorthAmericaandEurope,
BS 25999:2006 was the most widely used. In 2008 a companion standard was published, BS
25777:2008 Information and Communications Technology Continuity management, Code of
Practice. It is the opinion of Capitoline LLP that, at the time of writing, BS 25777 is the most
appropriatedocumentforuse inEuropetodescribebestpracticebusinesscontinuitymanagement
intheICTenvironment.
2 Minimal expectations ofAMS IX
2.1 Availability:
Maximumnumberofincidents;
1outagein5years,maximumdowntimeoftwohours
MeanTimeBetweenfailuresofnotlessthanfiveyears
2.2 Environmentalconditionsfornetworkequipment
Thetemperature
and
humidity
of
the
computer
room
must
remain
within
the
limits
set
by
ASHRAE
EnvironmentalGuidelinesforDatacomEquipment:2008.ThisismorefullyexplainedinSection3.6
2.3 Firesuppression:
Thefacilitymustbeprotectedbyahighsensitivityautomaticsmokedetectionsystemcoupledwith
anautomaticgaseoussuppressionsystem.
2.4 Maintenanceregime:
Maintenanceoncriticalitemsmusttakeplaceatagreedtimes
Maintenancewindows
will
be
00h00
07h00
(GMT
+1h)
Maintenancewillbeannouncedtostakeholdersinadvance
Therewillbenoroutinemaintenanceworkoncriticalitemsoutsideofthesetimewindows
2.5 Incidentmanagement
Incidentsmustbemanagedinawaythatallowsadequateresponseandanalysis
Outageannouncedwithin5mintoAMSIXNetworkOperationsCentre,NOC
Outageannouncementstobemadethroughindependentsystemthatareindependentfrom
powerequipmentproductionenvironment
2.6
Personnel
Amsterdam Internet Exchange Doc ref CPTL 0908-09 Copyright licensed to AMS-IX
AMS-09-001 Issue 005 19-10-09 BJE Page 5 of 18
-
8/9/2019 AMS IX Data Centre Standard
6/18
Onlyqualifiedpersonnelusedformaintenance
Communicateescalationprocedures&contactinformation
RegularlyinformAMSIXonupdateescalationcontactinformation
EfficientsiteaccessforauthorisedAMSIXstaff
Therequirementswillbemetthroughthreeareas;
Thetechnicaldesignandinstallationofthedatacentre
Themanagementandmaintenanceprocedurestooperatethedatacentre
Abusinesscontinuityanddisastermanagementprogramme
TheMinimumRequirementsofAMSIXshallbeprovenbyanauditofthedatacentrefacility
by an external qualified auditor acceptable to both AMSIX and the operator of the data
centre
3
Technicaldesign
and
implementation
3.1 Location
Minimumrequirements
3.1.1 Thebuildingmustbeinanareawithfloodprotection
3.1.2 The building should be no closer than 0.10 km from a railroad or major interstate
highway
3.1.3 Thebuildingmustbeatleast500mfromaradartransmitter
3.1.4 Thebuildingmustbeatleast100mfromamobiletelephonemast
3.1.5
Thebuilding
must
be
at
least
100m
from
any
source
of
electrical
interference
3.1.6 Thebuildingmusthaveadequateaccessbyroadandnearbyparkingfacilities
3.2 Architecturalandbuildingrequirements
Minimumrequirements
3.2.1 Anycomputerroomwindowsfacingeast,westorsouthmustbecoveredtopreventthermalsolargain.
3.2.2 Computerroomnottobelocatedbelowplumbedareassuchasrestrooms,janitor
closets,kitchens,
laboratories
and
mechanical
rooms
unless
aflood
containment
systemhasbeenputinplace.
3.2.3 Thebuildingmusthaveadedicatedloadingareatohandle allanticipateddeliveriesofsuppliesandequipment.
3.2.4 Thebuildingmaterialsmustbenoncombustible e.g.brick,concrete,plasterboardetc.
3.2.5 Thecomputerroomheightmustallow0.4mabovetheequipmentrackonasolidfloorand0.4maboveandbelowarackforaraisedfloor
3.2.6 Allfloorsmustbecapableofsupporting750kgequipmentracks
3.2.7 Ifaraisedfloorisfittedthenitmustbeatleast400mmhighwithairflowsnotsubstantiallyblocked
Amsterdam Internet Exchange Doc ref CPTL 0908-09 Copyright licensed to AMS-IX
AMS-09-001 Issue 005 19-10-09 BJE Page 6 of 18
-
8/9/2019 AMS IX Data Centre Standard
7/18
3.3 Securityandaccesscontrolrequirements
Minimumrequirements
3.3.1 Anywindowsatgroundfloorlevel,thatallowdirectaccessintothedatacentre,must
be
barred
3.3.2 Securitystaffpershifttobeatleastonepersonper3000m2
ofthedatacentrearea
24hoursperday.
3.3.3 Motiondetectoralarmsincomputerrooms,M&Eplantrooms,telecommunication entranceroomsand,officeareas
3.3.4 Doorsintocomputerroomstobecontrolledbypin,swipecardorbiometricaccess
3.3.5 Maindoorintothedatacentretobecontrolledbypin,swipecardorbiometricaccess
3.3.6 Mannedsecuritycounterwithsigninginandbadgeallocationtovisitors
3.3.7 DigitalCCTVmonitoringandrecordingofallexternaldoorstothecomputerrooms
3.3.8 Nounauthorisedpersonsmustbeabletoenterthecomputerrooms,M&Eplantrooms,telecommunication entranceroomsandofficeareas
3.4 Fireprecautions,smokedetectionandfiresuppression
Minimumrequirements
3.4.1 Numberandlocationoffireexitsaccordingtolocalcodes
3.4.2 Fire exits to be unblocked, opening in the right direction and with 900 mm wideapproachroutes
3.4.3 EmergencylightingtobeinplaceaccordingtolocalcodesorEUDirectives
3.4.4 ExitsignagetobeinplaceaccordingtolocalcodesorEUDirectives
3.4.5 Manualcallpointsmustbefittedaccordingtolocalcodes
3.4.6 Walls and doors to the computer room, telecommunications rooms, M&E plantroomsandothercriticalareastobefireratedtoDutchnationalstandards
3.4.7 Thecomputerroomtobeprotectedbytwocoincident(doubleknock)smokedetectionsystems.Atleastonesystemmustbeanaspiratingsmokedetector(ASD)
monitoringreturnairflows.ThesecondsystemmustbeanotherASDdeviceora
combinationoptical/ionisationdetector
3.4.8 Otherparts of thebuilding must be monitored by anASD or acombination optical/ionisationdetector
3.4.9 Allofthebuildingssmokedetectionsystemsmustbe integrated intoonecommon
alarm
3.4.10
Setting
off
of
the
alarm
must
be
transmitted
to
a
third
party
monitoring
agency
or
the
firebrigade
3.4.11 Amaintenancelogcoveringallitemsrelatedto firedetectionandsuppressionmustbeavailableforinspection
3.4.12 Evidenceofstafftrainingintheeventofafireeventmustbeavailable
3.4.13 Firemarshalswhowilloverseeevacuationofthebuildingandotheragreedactivitiesmustbeidentifiedforeveryshift
3.4.14 Analgorithmshowingthecauseandeffectstatusofallfirerelatedequipment,e.g.HVAC,UPS,firedampers,smokedetection,gasreleaseetc.,mustbeavailablefor
inspectionandapprovalbyAMSIX.
3.4.15 Thecomputerroommustbeprotectedwithagaseousfiresuppressionsystem
3.4.16 ThegasfiresuppressionsystemmustbeanEUapprovedcleanagentwithlowozone
depletionand
global
warming
potential
Amsterdam Internet Exchange Doc ref CPTL 0908-09 Copyright licensed to AMS-IX
AMS-09-001 Issue 005 19-10-09 BJE Page 7 of 18
-
8/9/2019 AMS IX Data Centre Standard
8/18
3.4.17 Thegasfiresuppressionsystemmustonlybeactivatedbytwoseparateandconcurringfiredetectionsystemsorbymanualactivation.Thesystemmustalso
haveamanualoverride.Thesystemmustbeleftinautomaticmode
3.4.18 Areasprotectedbythegasfiresuppressionsystemmustbefittedwithadequateoverpressureventilationplates
3.4.19 Ameansofpurgingtheareaofgasafteradischargemustbeinplace
3.4.20 ManualfireextinguishersmustbeplacedatdoorwaysorotherrelevantpointscontainingCO2orotherapprovedfiresuppressant.
3.4.21 Allfirerelatedsignagemustbeinplace,e.g.gassuppressionsystemwarningsondoors,actionsintheeventoffirenoticesetc
3.4.22 EveryroomprotectedbyagassuppressionsystemmustbepressuretestedtoISO14520andacertificatetothateffecttobeavailableprovingtheroomhaspassedthe
pressuretestwithinthelast12months
3.4.23 Allfiredetectionandsuppressionsystemsmustbedesignedandinstalledbyqualifiedpersonnelanddesignedtonationalorinternationalstandards,e.g.NFPA75,
BS6266,VdS2095etc
3.4.24 Ifthecomputerroom,telecommunications roomorM&Eplantroomshavea
sprinklersystemthenitmustbeofthepreactiontype
3.4.25 Adjoiningroomsorbuildingstothemaindatacentrelocationshouldbeprotectedwithasprinklersystem.Iftheyarenotthenthefireriskoftheadjoiningbuilding
mustbeassessedandmethodstolimitfirespreaddescribed.
3.5 Provisionofpowersupplies
Minimumrequirements
3.5.1 Thesitemustbefedfroma transformersubstation dedicatedtothedatacentreanditsassociatedfacilities
3.5.2
Transformersmust
be
in
asecured
area
3.5.3 Power cables must enter the building and be terminated in a dedicated electricalswitchroomcontainingallnecessaryswitchingandmetering
3.5.4 Thepoweravailabletothesitefromthemainsutilitymustbeatleast20%morethan
thepeakprojectedload
3.5.5 Atleasttwostandbygenerators,inanN+1configuration, arerequiredtoprovidepowerintheeventofamainsfailure
3.5.6 Thestandbygeneratormustbeavailablewithatleast24hoursoffuel
3.5.7 Ifmorethanonegeneratorisavailablethenanautomaticsynchronizingdevicemustbefittedwithamanualoverrideoperationpossible
3.5.8 Operationofthegeneratorwillbebyanautomatictransferswitchthatwilldetectmainsfailure
3.5.9
Thegenerator
will
automatically
switch
off
when
mains
power
is
restored
3.5.10 Thegeneratorwillhavemanualcontrolsbutwillbeleftsettotheautomaticsettingundernormalcircumstances
3.5.11 Amaintenanceandtestregimewillbeinplaceandthesystemwillhavebeentestedwithaloadbankandthenwithaliveload
3.5.12 Aconnectionwillbemadeavailablesothatanexternalgeneratorcanbepluggedintothemainswitchboard
3.5.13 Thegeneratorandcablingwillbeinasecurelocationadjacentorwithinthedatacentre
3.5.14 Thepowercapacityofthegeneratorwillbe atleast20%morethanthepeakprojectedload
3.5.15
The
ICT
equipment
will
be
protected
by
an
Uninterruptible
Power
Supply,
UPS,
in
an
N+1manner
Amsterdam Internet Exchange Doc ref CPTL 0908-09 Copyright licensed to AMS-IX
AMS-09-001 Issue 005 19-10-09 BJE Page 8 of 18
-
8/9/2019 AMS IX Data Centre Standard
9/18
3.5.16 TheenergystoragemechanismoftheUPSwillbesufficientthattherewillbeadequatetimeforthestandbygeneratortostartandcomeonline
3.5.17 EachUPSwillhaveitsowndedicatedenergystoragemedium,e.g.batterystring,kineticenergysystemetc.
3.5.18 TheUPSwillbecentralised
3.5.19 ThecapacityoftheUPSwillbegreaterthanthepeakprojectedload.Theaveragerunningloadcapacitywillnotbemorethan80%oftheUPScapability
3.5.20 TheUPSwillhaveasoftwarebasedmonitoring,reportingandalarmsystem
3.5.21 TheUPSwillbecapableofanautomaticandmanualbypassontorawmainsfeedintheeventofmaintenancerequirementsorcompleteUPSfailure
3.5.22 UPSunitconnectedinparallelwillhavebeenfullytestedunderloadandwillbeguaranteedbythemanufacturerforthatconfiguration
3.5.23 TheUPSwilldistributepowertotheICTequipmentviaPowerDistributionUnit(PDU)switchgear
3.5.24 TwopowercableswillbeavailabletoeachracklocationfedfromtwoseparatePDUs
3.5.25 Arackdesignatedasacommunicationsrackwillbeabletobesuppliedwithatleasttwo32ampsinglephasefeeds
3.5.26
Racksrequiring
more
power
will
be
supplied
with
more
32
amp
feeds
but
preferably
withathreephasedistributionsystem
3.5.27 Threephasepowerdistributionsystemsthroughoutthedatacentrewillbeevenlyloadedtowithin5%ofeachotherandthismustbeeasilymeasurableatallsignificant
pointse.g.UPSoutput
3.5.28 TwopowerstripswillbeavailableineachrackeachfedfromaseparatePDU.Eachpowerstripmusthavealocalcurrentmonitoringfacility
3.5.29 Thebuildingwillbeprotectedwithalightningprotectionsystem
3.5.30 Externalplantsuchasgeneratorsandcondenserswillhaveallexternalmetalworkearthedsothatsurgecurrentscannotenterthebuilding
3.5.31 Incomingcoppercommunicationscableswillbeprotectedwithsurgesuppressorsbeforetheyenterthecomputerroom
3.5.32
Thecomputer
room
will
have
an
exposed
copper
main
earth
terminal
that
will
be
the
earthreferencepointfortheroom
3.5.33 Thefollowingitemswillconnectedtotheearthingsystem;allequipmentracks,atleastevery6
thlegofanyfloorpedestalarrangement,allmetalliccablecontainment,
allelectricalswitchgear,HVACunitsandmetallicducting,allmetallicpipes,the
exposedstructuralsteelofthebuilding
3.5.34 Ifpowerislosttoarackorracksthenthesystemmustbeabletorestartautomaticallywithoutcausingcircuitbreakerstotripoutduetohighinrushcurrents.
Thismaybeachievedbyusing'softstart'equipment,automaticsequentialstartup
proceduresorbyhavingsufficientovercapacityinthepowersupplytrain.
Amsterdam Internet Exchange Doc ref CPTL 0908-09 Copyright licensed to AMS-IX
AMS-09-001 Issue 005 19-10-09 BJE Page 9 of 18
-
8/9/2019 AMS IX Data Centre Standard
10/18
Notethattransferswitches
andsynchronisation
devicesmaybeseenasa
singlepointoffailurebut
theprobabilityoffailureis
regardedassufficientlylow
Figure1
Minimumacceptablepowersupplyarrangement.GenerallyinanN+1format
Amsterdam Internet Exchange Doc ref CPTL 0908-09 Copyright licensed to AMS-IX
AMS-09-001 Issue 005 19-10-09 BJE Page 10 of 18
-
8/9/2019 AMS IX Data Centre Standard
11/18
3.6 Provisionofcoolingandventilation
Minimumrequirements
3.6.1 ThecomputerroommustmaintaintemperatureandhumiditycontrolaccordingtotheASHRAE2008requirementslistedbelow.Batteryroomsmustbelimitedto25
0C.
The
system
must
maintain
this
capability
at
full
load
and
with
an
external
temperatureof360C
3.6.2 HVACequipmentshallbeconnectedtothemainsinputandbackedupwithastandby
generatorasdescribedinsection3.5
3.6.3 HVACequipmentshallsupplycoolingcapacityinanN+1format
3.6.4 HVACequipmentshallberatedtoatleast20%morecapacitythanthemaximumexpectedsteadystateloadofthecomputerroomevenafteroneCRACunithasfailed
orbeenturnedoff
3.6.5 Humiditycontrolmustbeprovided
3.6.6 Aventilationsystemmustbeinplacetochangetheairinthecomputer,telecomsroom,plantroomatapproximatelyoneairchangeperhour
3.6.7 AllincomingairmustbefilteredaccordingtoEN77960%standard.Smokedetectors
mustbe
fitted
to
the
incoming
air,
after
filtration,
that
will
shut
off
the
air
intakes
if
smokeisdetected
3.6.8 Ameansofpurginggasprotectedroomsmustbeinplaceforremovaloffiresuppressiongasafteradischargeevent
ASHRAE2008computerroomenvironmentalrequirements
Lowendtemperature 180C
Highendtemperature 270C
Lowendmoisture 5.50Cdewpoint(note,thismaybetakenasaminimumRH
of35%
for
simple
measuring)
Highendmoisture 60%RHand150Cdewpoint
Inaddition
Minimumcoldaisletemperature 180C
Maximumcoldaisletemperature 240C
Maximumhotaisletemperature 350C
Ifthereisnodefinedhotaislecoldaislelayoutinplacethenmeasurementswillbetakenattheair
inputandairexhaustsectionsofallappropriateracks.
3.7 ProvisionofCablingandcablemanagement
Minimumrequirements
3.7.1 Astandardsbasedstructuredcablingsystemistobeinplacetoprovideconnectivitytoeveryrack
3.7.2 Allinteriorcablingshallbeofalowflammabilitytype.Anynewcablingmustbespecifiedaslowflammabilityandzerohalogentype
3.7.3 Externalcables,i.e.flammableconstruction,shallnotbetakenmorethan5mintothebuildingbeforetheyareterminatedorenclosedinanonflammableconduit
system
Amsterdam Internet Exchange Doc ref CPTL 0908-09 Copyright licensed to AMS-IX
AMS-09-001 Issue 005 19-10-09 BJE Page 11 of 18
-
8/9/2019 AMS IX Data Centre Standard
12/18
3.7.4 Everyrackwillhaveaccesstoacablecontainmentsystem,aboveandorbelowit,thatwillallowcablestobeproperlymanagedbetweenracks
3.7.5 Dataandsinglephasepowercableswillbeseparatedbyatleast200mm
3.7.6 Dataandthreephasepowercableswillbeseparatedbyatleast600mm
3.7.7 Nocablewillbetrappedindoors,laidoutonthefloor,strungbetweenracksor
forced
into
right
angle
bends
3.7.8 Everycablewillhaveauniqueidentitylabelatbothendsdenotingorigin,destination
andifnecessary,owner
3.7.9 Everyequipmentrackwillhaveauniqueidentityandifnecessary,ownerslabel
3.7.10 Therewillbeaseparatetelecommunications roomordedicatedcommsareainthe
computerroomforconnectingseparateexternaltelecommunications cablesinputs.
3.7.11 Telecommunications roomsorareas,thatcontainactiveequipment,willprovide;airconditioningandfireprotectiontothesamestandardasthecomputerroom,change
fromexternalgradetointernalgradecable,provideovervoltageprotectiononall
coppercables,provideacleardemarcationbetweenownershipofcablesand
equipment
3.7.12 Allcablespassingthroughfirewallswillbesealedagainstfireandsmoketonational
orEU
regulations
3.7.13 Allmetalliccablecontainmentitemstobecorrectlyearthed
3.7.14 Eachequipmentrackwillprovideadequateverticalandhorizontalcablemanagementitemstopreventpatchcordsfromobscuringanyitemofequipment
3.8 BuildingManagementSystemsandmonitoring
Minimumrequirements
3.8.1 Thecomputerroomwillhaveonegeneraltemperaturesensorandonegeneral
humiditysensor
for
the
room
3.8.2 Telecommunications andplantroomswillhaveageneraltemperatureandhumiditysensor
3.8.3 Therewillbeawatersensorundereveryraisedfloor,everyCRACunitandeverywatercooledrackandalsoineveryplantroom
3.8.4 EverysensorwillbewiredbacktoadedicatedBMSpanelinoneofthetelecommunications rooms
3.8.5 AsoftwarebasedBMSwillmonitoreverytemperature,humidityandwatersensor
thestatusofthefirealarmpanel
thestatusofthesecurity/accesscontrolsystem
thestatusoftheincomingmainsandautomatictransferswitch
the
status
of
the
generators
thestatusofeachUPSandCRACunit
thestatusofanyfire/smokecontrolorHVACdampers
itsownstatus
3.8.6 ThisinformationwillbedisplayedonadedicatedBMSterminalwithgraphicalinterface
3.8.7 TheessentialitemsoftheBMSsystemwillhaveadedicatedUPSsupplywithatleast
onehourofbatterytimeorwithotherpowerbackupmethods.
3.8.8 Amanagementstrategywillbeinplacethatwilldescribethereactiontoeachalarm,whowillrespondandresponseoutsideofnormalworkinghours
3.8.9 Essentialalarmswillconnectviaanexternaltelecommunications circuittoanagreedlistofstakeholders
3.8.10
TheBMS
will
store
historical
trends
and
generate
incident
logs
and
reports
Amsterdam Internet Exchange Doc ref CPTL 0908-09 Copyright licensed to AMS-IX
AMS-09-001 Issue 005 19-10-09 BJE Page 12 of 18
-
8/9/2019 AMS IX Data Centre Standard
13/18
3.8.11 TheBMSwillbefailsafeinthatifitshouldfailitwillnotaffecttheoperationofanysystemthatitpurelymonitors
4
OperationalRequirements
Management techniques must be put in place that give operating procedures and protocols that
ensurethecontinuingefficientandreliableoperationofthedatacentreandtimelycommunication
toallstakeholders.
4.1 Goodworkpracticesinthebuilding
Minimumrequirements
4.1.1 Thedatacentrewillhaveonecentralmannedpedestrianentranceandonegeneralloadingbayarea
4.1.2 Allequipmentwillbeunpackedandassembledinadedicatedbuildareaandnotinalivecomputerroom
4.1.3 Therewillbeadedicatedcontrol roomorarea.Allcontrolandmonitoringfunctionswillbeconnectedintoanddisplayedinthecontrolroom
4.2 OperationalManagementDocumentationrequired
Minimumrequirements
4.2.1 Ageneraloperationsmanualisrequiredthatbringstogetheralltheoperatingrequirementsandsettingsofthedatacentre
4.2.2 Allmajoritemsofequipment,e.g.UPS,HVAC,generatoretcshallbeincludedinanassetregisterwhichwillincludeasettingsandoperationalproceduretoinclude
Location
Serialnumber
Dataofprocurement
Manufacturer contactdetails
Maintenance/call outcontactdetails
Servicehistory
Datesofcalibrationifrequired
Settingsandsetpointstobeobservede.g.RHandreturntemperatureonCRAC
units
4.2.3 Achecklistisrequiredofallitemsthatneedtobeleftinanautomaticstatusandwherethesecontrolsarelocated,e.g.firecontrolpanelandgassuppressionsystem,
activationofstandbygeneratoretc
4.2.4 Sitedocumentationinformationtoinclude
Buildingandfloorplans
Locationsofracksandothermajoritemsofequipment
Racklayout
Logicalandphysicalinterconnectivity ofequipment
4.2.5
Acall
list
is
to
be
available
which
will
list
all
principle
staff
of
the
data
centre,
their
functionandcontactdetailsplusanyappropriatesuppliers,maintenancecompanies
Amsterdam Internet Exchange Doc ref CPTL 0908-09 Copyright licensed to AMS-IX
AMS-09-001 Issue 005 19-10-09 BJE Page 13 of 18
-
8/9/2019 AMS IX Data Centre Standard
14/18
andemergencyservices
4.2.6 Thedatacentrewillhaveasafetyoperationsmanualthatwilldetail
Safeworkingatheight
Safeuseofelectricity
Useoflasertransmissionequipment
Liftingheavyloads
Monitoringofnoiseintheworkplace
Useofbarriersaroundworkareassuchasmissingfloortilesetc
4.2.7 Analgorithmchartisrequiredthatwilldetailthecauseandeffectofallrelated
Firedetection
Alarmstates
Activationofgassuppression
Controlofdampers
Poweringoffofpowersupplyequipment
PoweringoffofHVACunits
Restartprocedures
4.2.8 Amethodstatementisrequireddetailinghowvisitorswillbeidentifiedandescorted
aroundthe
site
4.2.9 Amethodstatementisrequireddetailinghowexternalcontractorsmayenterandworkonthesiteandhowtheirworkismonitored,controlledandrecorded
4.2.10 Anaudittrailisrequiredthatdemonstrateshowchangestothedesignandfabricofthedatacentrearemade.ThiscouldbebyaChangeControlDocumentandWork
Ordermethod
4.2.11 Awrittenplanmustbeinplacethatdetailshowallalarmsstatesandsystemfailureswillbehandledbythedatacentrestaff
4.3 Maintenanceprocedures
Minimumrequirements
4.3.1 Anyinternalstaffinvolvedinmaintenancemustbetrainedandqualifiedtodoso.Apersonalstatementmustdemonstratehowthiscompetencehasbeenachievede.g.,
professional/trade qualifications, attendanceatmanufacturers trainingcoursesetc
4.3.2 Anyexternalcontractorinvolvedinmaintenancemustalsobeabletodemonstratecompetence
4.3.3 Allequipmentrequiringmaintenanceshallhaveamaintenancelogdetailingtheequipment,maintenancedates,outcomes,contactdetailsetc.See4.2.2
4.3.4 Maintenanceoncriticalitemsmusttakeplaceatagreedtimes. Thesewillbeduring07h0012h00(GMT+1h).IncidentManagement,i.e.,tobringacomponentbackinto
production after a failure, should be done between 00h00 and 07h00Maintenance
willbe
pre
announced
to
stakeholders
at
least
one
week
in
advance.
There
will
be
no
routinemaintenanceworkoncriticalitemsoutsideofthesetimewindows.
5 Business Continuity requirements
Recoveryplansmustbe inplacethathasanestablishedandrehearsedprocedurefordealingwith
any incident that impairs the operation of the data centre and puts in to place a recovery
programme.
Amsterdam Internet Exchange Doc ref CPTL 0908-09 Copyright licensed to AMS-IX
AMS-09-001 Issue 005 19-10-09 BJE Page 14 of 18
-
8/9/2019 AMS IX Data Centre Standard
15/18
AnICTcontinuityprogrammemust
Understandthethreatsto,andvulnerabilitiesof,ICTservices
IdentifythepotentialimpactsofdisruptiontoICTservices
Providecollaborationbetweendatacentrestaff,internalandexternalserviceprovidersand
stakeholders
DemonstratecompetencebycredibleresponsesthroughexercisingICTcontinuityplansand
testICTcontinuityarrangements
Thedatacentremustbeableto
ProtecttheICTenvironmentthroughresilientdesignandbestpracticeengineering
Detectincidentsattheearliestopportunity
Reacttoanincidentinanappropriatemanner
Recoverthedataprocessingandcommunicationssystemsinaprioritisedmanner
Operateinadisasterrecoverymodeuntilnormaloperationsarepossible
Returnto
anormal
business
position
5.1 Incidenthandlinganddisasterrecovery
Minimumrequirements
5.1.1 Thedatacentremusthaveariskassessmentanalysisthatdetailsrisks,theimpactof
theseriskandthestrategytoobviatetheserisks,e.g.
Site:fire,
flooding
Operations:powersupplyfailure
Personnel:majorepidemicetc
Communications: maincabledamage
5.1.2 AllcriticalsystemssuchasUPSstatus,fireconditionsetc,mustbeautomaticallymonitored.Thesearedetailedinsection3.8
5.1.3 AnycriticalfailureorlossofservicemustbecommunicatedtoAMSIXbytelephonewithinfiveminutes
5.1.4 Anycriticalfailureorlossofservicemustbeautomaticallycommunicatedtoallrelevantpersonnel,managementandotherstakeholderswithinfiveminutes
5.1.5 Themethodofcommunicationtoexternalagenciesandstakeholdersmustbe
independentofthesamecriticalfacilitiesthathavefailede.g.essentialmonitoring
andcommunications
equipment
must
be
powered
by
an
independent
battery
backed
supply
5.1.6 Awrittenplanmustbeinplacethatdetailshowallalarmsstatesandsystemfailureswillbehandledbythedatacentrestaff
5.1.7 Allmajorincidentswillbesubjecttoamanagementreviewthatwilldetail
Whattheincidentwas
Whereithappened
Whenithappened
Whatwastheimpactonserviceprovision
Howwasitdealtwith
Whatchangescanbemadetopreventasimilarincidenthappeningagain
5.1.8 Astatementisrequiredthatwilldetailtheimpactofasuddenandcompletelossof
poweron
the
ICT
equipment
and
how
arestart
will
be
managed
Amsterdam Internet Exchange Doc ref CPTL 0908-09 Copyright licensed to AMS-IX
AMS-09-001 Issue 005 19-10-09 BJE Page 15 of 18
-
8/9/2019 AMS IX Data Centre Standard
16/18
5.1.9 Acalllististobeavailablewhichwilllistallprinciplestaffofthedatacentre,theirfunctionandcontactdetailsplusanyappropriatesuppliers,maintenancecompanies
andemergencyservices.Contactdetailsmustalsoincludeoutofhourscontact
detailsanddefineresponsibilities ofalltheparties.
5.1.10 TheeffectsofpowercutsmustbesimulatedtoprovetheoperationofUPSandgeneratorstartuproutines.Thesesimulationsmustbetreatedasmaintenance
episodesand
take
place
and
be
communicated
as
4.3.3
References
ANSI/TIA942:2005TelecommunicationsInfrastructureStandardsforDataCenters
ASHRAE2008computerroomenvironmentalrequirements
TierClassificationsdefinesiteinfrastructureperformance.TheUpTimeInstitute,2008
BS6266:2002
Code
of
practice
for
fire
protection
for
electronic
equipment
installations
EN 779:2002 Particulate air filters for general ventilation. Determination of the filtration
performance
EN501735:Informationtechnology:GenericCablingforDataCentres
ISO 145201:2006 Gaseous fireextinguishing systems. Physical properties and system design.
Generalrequirements
NFPA75:StandardfortheProtectionofInformationTechnologyEquipment,2009Edition
VdS2095:200502VdSguidelinesforautomaticfiredetectionandfirealarmsystemsPlanningand
installation
Bibl iography
Accessforthedisabled
Council Directive 2000/78/EC of 27 November 2000 establishing a general framework for equal
treatmentinemploymentandoccupation
BS8300:2008DesignofbuildingsandtheirapproachestomeettheneedsofdisabledpeopleCode
ofpractice
BusinessContinuity
BS77993:2006Informationsecuritymanagementsystems.Guidelinesfor informationsecurityrisk
management
BSISO/IEC200001:2005Informationtechnology.Servicemanagement.Specification
BS ISO/IEC 27001:2005 Information technology. Security techniques. Information security
managementsystems.Requirements
BS ISO/IEC 27002:2005, Information technology. Security techniques. Code of practice for
informationsecuritymanagement
BS259991:2006Businesscontinuitymanagement,Part1:Codeofpractice
BS25777:2008InformationandCommunicationsTechnologyContinuitymanagement,Codeof
Practice
Amsterdam Internet Exchange Doc ref CPTL 0908-09 Copyright licensed to AMS-IX
AMS-09-001 Issue 005 19-10-09 BJE Page 16 of 18
-
8/9/2019 AMS IX Data Centre Standard
17/18
BSISO/IEC17799:2005Codeofpracticeforinformationsecuritymanagement
ISO/PAS 22399:2007 Societal security Guideline for incident preparedness and operational
continuitymanagement
NFPA1600;2007StandardonDisaster/EmergencyManagementandBusinessContinuityPrograms
Designsto
minimize
fire
risk
BritishBuildingRegulations:2000PartB,Firestopping
TheConstructionProductsDirective(CouncilDirective89/106/EEC)
BS58396:2004Firedetectionandfirealarmsystemsforbuildings.Codeofpracticeforthedesign,
installationandmaintenanceoffiredetectionandfirealarmsystemsindwellings
BS6266:2002Codeofpracticeforfireprotectionforelectronicequipmentinstallations
ISO 145201:2006 Gaseous fireextinguishing systems. Physical properties and system design.
Generalrequirements
BS72731:2006Codeofpracticefortheoperationoffireprotectionmeasures.Electricalactuation
ofgaseoustotalfloodingextinguishingsystems
EN54
20:2006
Fire
detection
and
fire
alarm
systems.
Aspirating
smoke
detectors
EN 779:2002 Particulate air filters for general ventilation. Determination of the filtration
performance
BFPSACodeofPracticeforDesign,Installation,Commissioning&MaintenanceofAspiratingSmoke
Detector(ASD)Systems2005
BFPSAGuidanceonECRegulationNo842/2006onCertainFluorinated
GreenhouseGases2006
Regulation (EC) No 842/2006 of the European Parliament and of the Council of 17 May 2006 on
certainfluorinatedgreenhousegases
NFPA72:NATIONALFIREALARMCODE:2007
NFPA75:StandardfortheProtectionofInformationTechnologyEquipment,2009Edition
ElectricalSafety
BS7671(IEE17thEdition)RequirementsForElectricalInstallations
BS6701TelecommunicationsEquipmentandcabling
EN50310Bonding&EarthinginBuildingsWithITequipment
EN609501:2002,InformationtechnologyequipmentSafety~Generalrequirements
NEN1010:2007Dnormvoorlaagspanningsinstallaties
EmergencyLightingandsignage
BS5266
:Part
1:1999
Code
of
Practice
for
Emergency
Lighting
BS 54995:2002 Graphical symbols and signs ~ Safetysigns, including fire safety signs Signs with
specificsafetymeanings
StatutoryInstrument2005No.1541TheRegulatoryReform(FireSafety)Order2005
Energyconsumptionandoptimisation
EUEnergyperformanceofBuildingsDirective2002/91/EC
EUEnergyServicesDirective2006/32/EC
Energy savings at Data Hotels, The Environmental and building department of the Municipality of
Amsterdam,ECN,April2008
Amsterdam Internet Exchange Doc ref CPTL 0908-09 Copyright licensed to AMS-IX
AMS-09-001 Issue 005 19-10-09 BJE Page 17 of 18
-
8/9/2019 AMS IX Data Centre Standard
18/18
Amsterdam Internet Exchange Doc ref CPTL 0908-09 Copyright licensed to AMS-IX
AMS-09-001 Issue 005 19-10-09 BJE Page 18 of 18
EU Code of Conduct on Data Centres Energy Efficiency Version 1.0 EUROPEAN COMMISSION
DIRECTORATEGENERALJRCJOINTRESEARCHCENTREInstituteforEnergyRenewableEnergiesUnit,
October2008
Healthandsafety
TheConstruction(DesignandManagement)Regulations2007
Workplace(Health,SafetyandWelfare)Regulations1992
ANSIZ136.2SafeUseofLasers inOpticalFiberCommunicationSystemsUtilizingLaserDiodeand
LEDSources
IEC608252.SafetyofLaserProductsPart2:Safetyofopticalfibrecommunicationsystems(OFCS).
HVAC
ASHRAEThermalGuidelinesforDataProcessingEnvironments2004
CIBSEGuideB.Heating,ventilation,airconditioningandrefrigeration
TheBuilding
Regulations
Approved
Document
F
VentilationTIA942TelecommunicationsInfrastructureStandardforDataCenters
VDI2054Airconditioningforcomputerareas
RaisedAccessFloors
EN12825:2001Raisedaccessfloors
Property Services Agency (PSA) Method of Building Performance Specification 'Platform Floors
(RaisedAccessFloors)',MOBPF2PS
RIBANBSK41Raisedaccessfloors
System
Design
EN501732:ITGenericITCablingForCustomersPremises
EN501723:ITGenericCablingforIndustrialPremises
EN501734:ITGenericCablingforHomes
EN501735:ITGenericCablingforDataCentres
ISO11801:2001ITGenericCabling
TIA942TelecommunicationsInfrastructureStandardforDataCenters
SystemInstallationandqualityassurance
EN
50174
1
(2000)
Information
technology
cabling
installation
Part
1:
Specification
and
quality
assurance
EN501742(2000)InformationtechnologyCabling installationPart2:Installationandplanning
practicesinsidebuildings,
ISO/IECTR147632InformationtechnologyImplementationandoperationofcustomerpremises
part2:Planningandinstallation
SystemTest
EN50346:2002InformationtechnologyCablinginstallationTestingofinstalledcabling
IEC619351 Generic cabling systemsSpecificationfor the testingofbalancedcommunication
cablinginaccordancewithISO/IEC11801Part1:Installedcabling