Post Mortem

1
Post Mortem

• March 4th Maintenance Day

2
Objectives

• Go over specifics of the last Wednesdays
  Maintenance
• List issues that affected the schedule
• Show actions for improvement

3
The Good

• 127 requested jobs
• 97 completed
• 21 rescheduled
• 6 continuing
• 3 cancelled
• All critical jobs completed on schedule
• PP source (maintenance)
• Siemens MG (maintenance)
• Lead flow adjustment (setup)
• RHIC power supply work (setup/repair/maintenance)
• Booster D6 septum flush
• Other major high priority work completed
• Spin rotator installation continued
• Roman Pot work
• Jet and CNI polarimeter work

4
The Bad

• Failure in execution and inadequate planning for
  possible interruption to other work for PASS code
  upload
• Unexpected extended ODH alarms
• Inadequate back out plan
• Ultimate delay in critical power supply work
• Confusing indications from PASS panelview display
  lead to prolonged downtime
• Better indications more than likely would have
  allowed faster resolution
• Unscheduled RHIC main magnet repair work caused
  some confusion and conflict

5
The Ugly

• AGS delayed by emergency response to fire alarm
• Cause of smoke from scheduled installation work
  in the AGS
• Delay in sweep and recovery of AGS because of
  corrective action and cleanup

6
Lessons Learned

• Jobs will not be approved without back out plan
  included
• More exact impact statements are now required,
  vague jobs will not be approved (even innocent
  looking ones)
• ALL work to be performed on Maintenance Days MUST
  be Submitted and Approved
• Any other work will be delayed until impact
  potential is assessed and job is approved
• Installation and other non-repair or maintenance
  related items will be deferred to specific days

7
Next Access for Maintenance Only

• 40 Requested Jobs presently being reviewed
• All known work requests must be submitted no
  later than Monday March 18th 1200hrs
• Emergent work
• Must be submitted ASAP
• Must contact MC for assessment and approval