SNS Integrated Control System

EPICS Collaboration Meeting

SNS Machine Protection SystemSNS Timing System

Coles Sibley

2000-0xxxx/vlb

SNS Integrated Control System

MPS Design Assumptions

Machine Protection System is not a “Safety Class” or “Safety Significant” System.

SNS will be built and commissioned in Phases, MPS must accommodate this schedule.

Reliability – The Machine Protection System must inhibit the beam when required. It must fail in a SAFE state.

Availability – The machine availability should be as high as possible. The MPS must be easy to configure and have a “friendly” operator interface. False trips must be minimized.

SNS Integrated Control System

MPS - Layered Protection

PersonelProtection

System

Fast ProtectLatched

Fast ProtectAuto Reset

Run Permit

Incr

easi

ng

QA

Hard Wired and PLCapplication

3 MHz carrier linkKEY BypassingPLC Bypassing

8 MHz carrier linkSoftware bypassSoftware Trips

EPICS ApplicationEPICS Channel Access

Inputs

Loss MonitorsRF Status

Machine Mode

Valve StatusPower Supply StatusMachine Mode Inputs

Chipmunks,Doors, etc.

AC Breakers in frontend electronics &power supplies

65 KV supplyRFQ Power Supply

RFQ Drive

Fast Protect SystemBeam Permit System

ProtectionSystem

Shutdownmechanism

SystemDescription

System Inputs

TargetProtection

SystemHard Wired

Target Sensors

TemperatureFlow

AC Breakers

No

n S

afet

y C

lass

Sys

tem

sS

afe

tyS

ign

ific

an

tS

afet

yC

lass

Hard WiredPermit

KEY BypassingPower Supply Shunts

PPS InputsBergoz MPCT

Front End PSHardwire interlocks

SNS Integrated Control System

Machine Protection System

Run Permit System (1 second)» Coordinates machine mode changes.» Scans IOC configurations for Software Configuration errors.» EPS interface for masking equipment inputs.

Hard Wired Protect (~ 33 msec)» Latched in Hardware» Redundancy through FPLS inputs

Fast Protect Latched System (< 20 microseconds)» Latches fault conditions until fault clears and Operator resets

condition. FPS_PERMIT_LINK_A carrier interrupted and inhibits beam through front end devices.

Fast Protect Auto Reset (20 microseconds)» Inhibits beam for duration of macro pulse by disabling

FPS_PERMIT_LINK_B carrier to the front end. Restores Fast Protect link for next pulse if fault restored to normal.

SNS Integrated Control System

Machine Protection System Layout

RING

RFQDrive

HEBT

Ldump

SRF

CCL

DTL

65 kV

RFQHVPPS

MPS Inputs

MPS Inputs

MPS InputsMPS Inputs

MPS Inputs

MPS Inputs

MPS Inputs

Beam OffLogic

Machinemode

RING

RTBT

Xdump

MPS Inputs

MPS Inputs

MPS Inputs

Idump

RTBT

MPS Inputs

MPS Inputs

Target

Fa

st

Pro

tec

tIn

pu

ts

FrontEnd

LINAC RING RTBT

Fa

st

Pro

tec

tIn

pu

ts

Fa

st

Pro

tec

tIn

pu

ts

Fa

st

Pro

tec

tIn

pu

ts

Target

LEBTChopper

RFQDrive

Fa

st

Pro

tec

tIn

pu

ts

Fa

ult

Be

am

Pe

rmit

Inp

uts

FrontEnd

LINAC RING RTBT Target

Ion Source65 Kv PS

RFQPower Supply

Fa

ult

Be

am

Pe

rmit

Inp

uts

Be

am

Pe

rmit

Inp

uts

Be

am

Pe

rmit

Inp

uts

Be

am

Pe

rmit

Inp

uts

ExtractionKickersFault

EventSystem

"ABORT"

5.6 us 5.8 us 8.2 us 8.2 us

27.3 us

MEBTMPS Inputs

RFQ

LEBT

Src

MPS Inputs

MPS Inputs

MPS Inputs

0.8 us

SNS Integrated Control System

Fast Protect – Auto Reset

ALARA – Pulse Width Modulation

Concentrates Permit Inputs

Inhibits carrier link to disable Beam

Inputs:» Loss Monitors

– Software trip points, bypass

» Beam position monitors– Software trip points, bypass

» RF Low level Controls

SNS Integrated Control System

Fast Protect - Latched System

Concentrates Permit Inputs

Inhibits carrier link to disable beam

Devices bypassed by Key or PLC

Inputs disabled by machine mode (event link)

Equipment maintained in locked racks

Documentation control of changes

System verification after changes

SNS Integrated Control System

Fast Protect Inputs

RF PS I Wire Harp Loss Kick Dumps Vac Total BPM Loss LLRF Tor. TotalMon. Scan. Targets

LEBT 1 1 1 3MEBT 2 17 1 20 2 2RFQ 1 0 1 1 1 1 5 1 1 2DTL 6 0 1 6 2 1 16 12 6 2 20CCL 4 73 8 1 86 24 4 2 30SRF 92 58 1 29 1 1 182 2 58 92 152HEBT 2 54 1 14 2 2 2 77 39 2 41RING 4 66 1 2 8 1 2 84 2 96 4 2 104RTBT 55 2 4 2 4 14 2 2 85 4 48 4 56Total 112 324 7 62 7 8 22 4 12 558 8 277 109 13 407

Fast Protect Latched Inputs Fast Protect Auto reset

SNS Integrated Control System

MPS Input Bypass Mechanisms

Mode Mask» Global database contains operating mode dependant devices.

Devices not required for present mode are masked through hardware. Masks changed with database reconfiguration and IOC reboot.

Jumper / Key / PLC Bypass» Software bypass requires set of closed contacts from a jumper,

key, or PLC contacts.

Software Bypass» If hardware configuration allows, input bypassed through software

with appropriate EPICS Access Security permissions.

SNS Integrated Control System

MPS Input channels

Signal IO type

R,W or RW

Comments

PMC ID 16 bits R SNS –PMC ##### -Serial numberSoftware version 16 bits R Software revision #Date Code 16 bits R Date codeFPS Input Carrier Status 1 bit R 1 = OKBPS Input Carrier Status 1 bit R 1 = OKFPS Output Carrier Status 1 bit R 1 = OKBPS Output Carrier Status 1 bit R 1 = OKIOC Heartbeat Status 1 bit R 1 = OKIOC Heartbeat Enable 1 bit R IOC heartbeat jumperFPS Software Mask jumper 8 bits R 1 = OK (jumper setting)BPS Software Mask Jumper 8 bits R 1 = OK (jumper setting)Fast Protect Input Status 8 bits R 1 = OK (1 bit per input)Beam Permit Input Status 8 bits R 1 = OK (1 bit per input)Mask readback 16 bits R Mode mask readback of mask in useEVL Mode Readback 8 bits R Mode in use from EVENT_LINKRTDL Mode Readback 8 bits R Mode in use from RTDLInput connection status 16 bits R Input cable connection detectedChannel fault Timer 32 bits R 1 per input

SNS Integrated Control System

MPS Configuration Data

Signal IO type

R,W or RW

Comments

PMC ID 16 bits R SNS –PMC ##### -Serial numberSoftware version 16 bits R Software revision #Date Code 16 bits R Date codeHeartbeat time 16 bits RW 16 MHz ticks for the IOC heartbeat

frequency, i.e. at 2 msec, 32000 or 0x7d00 hex

FPS Mode Mask Write Enable 16 bit RW Enable bit for downloading mode BPS Mode Mask Write Enable 16 bit RW Enable bit for downloading mode Interrupt Enable 1 bit RW Interrupt Enable bit

16 bits per channel0xA5A5 = Channel Enabled1 word per channel0x5AA5 = masked1 word per channel0xA5A5 = maskedLow byte MMHi Byte /MMLow byte MMHi Byte /MM

Channel Enable 16 bits RW

FPS Software Mask 16 bits RW

Beam Permit Mode Mask 16 bits RW

BPS Software Mask 16 bits RW

Fast Protect Mode Mask 16 bits RW

SNS Integrated Control System

MPS PMC Module (Also nice generic digital IO module)

PCI to LocalSlave

Bus Bridge

ProgramablePLL ClockGenerator

AlteraFLEX 10K

FPGA

2 - 100 nsec5 tap Delay

lines

128K x 16SRAM

SpecialReceiver

74FCT16245Buffers

Serial EPROM

68 Pin Front PanelConnector

64 Pin (P2)Rear IO connector

32 bit PCI Bus

16 Data

96

2

322

xx MHz

1 5

18 Addr12

64

33MHz

+5

1 5

Technobox Reconfigurable Digital IO PMC

SNS Integrated Control System

MPS System Hardware

1

32

MV2100 PPC Board

PC-MIP

PC-MIP

PMC Board

Technobox 96 channelreconfigurable IO module

P14

VME 64XBackplane

VME Chassis

FPS inputs

Latched inputs

RTDL

Event Link

FPS Carrier

FPS Carrier

LatchedCarrier

B

A C

D

A C

Z

Z

MPS Transition ChassisD

MPS InterfaceChassis

#1

LEDDiagnostic

Display

160 pin J2/P2Connector

Commercial HardwareSoftware design in progress

Design in progress(LANL)

Waiting for PrototypeQuote (Oak Ridge)

SNS Integrated Control System

MPS Software

Database (Oracle)» Access Security Files

» EPICS database

» RPS configuration database

» Alarms, IOC startup scripts, Archives

Run Permit System» SNL programs

» Machine mode changes

» System Verification

Beam current (Loss) accounting system

Operator Interface - EDM

Device / Driver support routines.

SNS Integrated Control System

EPICS CA Security

Hackers

ORNL Personnel

SNS Staff EE's

Operations

ChannelAccessServer Local OPI'sEPICS

File Server

Controls Network

IOC

C.A.S.

Run PermitSystem

SNS Network

World

MPSHardware

FPS InputsMPS Inputs

UAG - User AccessGroup

HAG - Host AccessGroup

ASG - Access securityGroup

ASL - Access SecurityLevel

ORNL Network

Telnetsession

Router

Firewall

WorkstationFirewall

EE @ home

DialupModem

SNS Integrated Control System

SNS Timing System

Modified Brookhaven Design

Timing Master (60 Hz PLL) - LANL

RTDL Master – BNL

Event Link Master – BNL

Utility Module – LANL

Timing Slaves (V124-S) - BNL

Machine Protection – SNS

Diagnostics EL-RTDL receivers - LBNL

SNS Integrated Control System

Timing System Components

GPS

Ring RF

MasterTimingmodule

NeutronChoppers

ACLine

SNS EventLink

Master

*16 PLL(16 MHz)

SNS RealTime Data

LinkMaster

10 MHzCrystal

Osc.

TimingSlave

(V124S)

MachineProtection

System

ICS IOC'sSNS Utility

Module

LEBTChopper

*4 PLL(64 MHz)

ExperimentalHalls

Diagnostics

RF GatesExtraction Kickers

TxHV gates

High resolutiontimestamps

Machine Modes

SNS TimestampsRemote Reset

Synchronous ISR's

Beam delayBeam Phase

Micro pulse widthMacro pulse width

SNS Time stampsDelaysGates

TriggersReboots

SNS Time stampsBeam data

RTDLEventLink

MasterTiming IOC

Phase Adjust

SNS Integrated Control System

Neutron Selection, Timing

Fast Neutrons suppressed by ToChopper

Neutrons suppressed by To Chopper

Slow neutrons allowedto pass

At Moderator face

10's ofusec.

Neutrons suppressed by Fermi Chopper

Neutrons at Sample

(Accelerator, T0 Chopper, and Fermi Chopper slaves to Timing master)

SNS Integrated Control System

Timing Master

Power grid

Zero crossing

Reference

Chopper

Accelerator tracking

Chopper tracking

Provides 60 / 120 Hz system pulses Follows line to within +/- 500 usec Extraction time fixed ~5 msec in advance Neutron Choppers follow Timing Master (60 Hz system pulses) Accelerator timing follows Timing Master

SNS Integrated Control System

SNS Timing Links (Drivers in progress at BNL)

Event Link (16 x Ring RF frequency)» Phase locked to Ring RF

» 256 Events or triggers, 64 hardware – 192 software

» Events Prioritized (High priority, no jitter)

RTDL – Real Time Data Link (10 MHz Carrier)» Design based on RHIC RTDL System

» Up to 256 Frames (1 start bit, 8 address bits, 24 data bits, 8 CRC bits per frame)

» Provides Synchronous data facility wide.

» One broadcast per machine cycle

SNS Integrated Control System

SNS Timing Encoder

1x 8 fan out

F/oTx

F/oTx

To FrontEnd

For local use

Multimode fiber

F/oTx

To HEBT

ToMCR

DELAYMODULE

ToRing

SNS Timing Distribution

SNS Integrated Control System

Event Link

Event link – PLL 16 * Ring RF» LEBT Chopper – 4 * EL carrier to create mini and macro pulses» Event link distributes timing for accelerator, diagnostics, extraction

and high resolution time stamps» Diagnostics – PLL 4 * EL carrier

Timing Slave (V124S module - BNL)» Gate Width – 16 bits, Carrier * 2 (~33.9 MHz)» Gate Delays

– Revolution delay - 16 bit, Ring RF frequency– Sub revolution delay – 8 bit, 16 * RF– Line delay – delays from 12 to 139 nsec

» Jitter < 5 nsec

SNS Integrated Control System

Data Transmitted on RTDL

Time of day (IOC time stamps)

Event Link Period (psecs) to converts counts to real time

Operating Mode (beam area, beam power, pulse length limits)

60 Hertz phase difference

Beam Parameters for LEBT Chopper

Previous pulse beam data

Data acquisition mode

Beam profile ID

IOC Reset Address

(Beam aborted if CRC error detected)

SNS Integrated Control System

Macro Pulse Shape

1 msec

16.67 msec

645 nsec945 nsec50 usec

Macro Pulse

Mini Pulse

402.5 MHz

Ring RF PLL SignalPhasedelay

Mini Pulseduty factor

75 %

65 %

divide by "n"Every "nth" pulse blanked

Beam Characterization Parameters(All in terms of 64 * RF ticks)Ÿ Phase DelayŸ Start WidthŸ Stop WidthŸ Macro DelayŸ Macro Full LengthŸ Macro WidthŸ End Width

SNS Integrated Control System

SNS Accelerator Timing Sequence

Real-TimeData Link

(RTDL)

RTDL parametertransmission

0-1 ms-2 ms 1 ms 3 ms2 ms 4 ms

RTDLtransmit

RTDL valid

System xxxTrigger

5 ms 6 ms

mode

snapshot,1Hz, 10Hz,

etc... linac beamend extract

beamaccumulation

Rf, High voltageGates

-3 ms

MPS Fault

Anytime

MPS Inhibit

Anytime

cycle start

Anytime

event link

machine

Informational Events, non critical timing Time Critical Events, (Hardware is counting)

Master Trigger Generator

SNS Integrated Control System

RPS – Beam Mode Parameters

Safe Operating Reqion

0.1

1

10

100

0 200 400 600 800 1000

# of turns injected

Bea

m in

ject

ion

Rat

e

7.5 kW envelope

200 kW envelope

2 MW envelope

60 Hertz

Safe Operation

Wire Scanners

SNS Integrated Control System

System Sequencer – (pulse scheduling)

120 Hz

60 Hz

Beam

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18

123456789

101112131415161718

Off

RTDL Frames

Daq mode

OffLdump-7.5 kW

Mode

Off

RF OnlyOff

Off

Off

OffRF Process

Ldump-7.5 kWOff

Off

RF

Ldump-7.5 kWRF Process

Off

Off

Ldump-7.5 kW

Timetimetimetimetime

timetime

time

timetimetimetimetimetimetimetime

time

timetime

Ring rev T59062 psec

59062 psec

Beam data Last Pulse

A=123,B=22, etc

A=10,B=13, etc

A=123,B=22, etc

19Off

A=123,B=22, etctime

Line Error237400 nsec

237420 nsec

237420 nsec

237430 nsec

237560 nsec

237590 nsec

237520 nsec

237440 nsec

237500 nsec

237490 nsec

237510 nsec

237480 nsec

237460 nsec

237490 nsec

237500 nsec

237540 nsec

237610 nsec

237600 nsec

237610 nsec

59063 psec

59063 psec

59064 psec

59064 psec

59064 psec

59065 psec

59066 psec

59066 psec

59062 psec

59062 psec

59062 psec

59062 psec

59062 psec

59062 psec

59062 psec

59062 psec

59066 psec

P=249, Q=1230

P=248, Q=1226

P=43, Q=245

cal

normal

normal

calsnapshot,1Hz

cal

cal

cal

cal

normal

User ID

Table 1

Table 3

Table 1

Table 1

19

300 time Off59066 psec BEAM INHIBIT cal237490 nsecScheduledScheduledP - P P - P Scheduled P - PP - P Scheduled

IOC reset

IOC_13

on request

Table 0

Table 0

Table 0

SNS Integrated Control System

Application Interface

CP

UE

PS

VME

Tim

ing

EP

S

LEBTChopper

PhysicsApplication

Event linkEncoder

SystemSequencer

Control Room

RTDLMaster

DataServer

DiagnosticsIOC's

UserProfile,

Raterequest

User ID

ControlsIOC's

Control SystemNetwork

User IDSynchronous

Data

TimingDistribution

System

DiagnosticsIOC's

CP

UE

PS

VME

Tim

ing

EP

S

ControlsIOC's

1 Hz EventProcessing

WireScannerRequest

SNS Integrated Control System

SNS Job Openings www.sns.gov/jobs/jobs_AMT.htm

Accelerator Physicist (9292)

Accelerator Systems Hardware Engineer (1050)

Beam Diagnostics Engineer (1846)

Chief Accelerator Operators (1552)

Control Systems Software Engineer (3343)

Engineering Assistant—LLRF (1630)

Engineering Assistants—Power Supply (6334)

Engineering Assistant—Pulsed Power Systems (7630)

Engineering Assistants—Survey and Alignment (3891)

Mechanical Engineer—Cryogenics (5061)

Mechanical Engineering Team Leaders (9983)

Pulsed-Power Engineer ((1379)

RF Engineer—High Power (1052)

RF Engineers—Low Level (1229)

Senior Mechanical Designers (3172)

Senior Power Supply Engineers (6310)

Vacuum Engineers (4257)