Monitoring Critical Systems

1
Monitoring Critical Systems Integration Data
Center ApplicationsAFCOM South Florida
ChapterJuly 1st, 2009 Steve Van DuserEaton
Powerware
2
What is Critical Systems Monitoring?

• More than just power monitoring
• More than building management
• More than network management
• Its a total monitoring strategy!

Networks
Power
Environmental
3
Examples of critical equipment

• UPS - Powerware, MGE, Mitsubishi, IPM, Liebert,
  APC
• PDU Eaton, Liebert, PDI, United Power
• Switchgear / ATS Eaton, Caterpillar, ASCO, GE,
  Russelectric
• Static Switches - Cyberex, Liebert, United Power
• Diesel generators - Caterpillar, Onan/Cummins,
  Detroit Diesel
• Air Conditioners / Chillers - Liebert, DataAire,
  Air Flow, York
• Power Quality Meters Eaton, GE, Sq-D, Rochester
• Communications SNMP, Modbus TCP, Web Browser

4
What do I need to know? - Power

• Is there a power failure?
• If there is a power failure, how wide spread is
  it?
• Did the generator start?
• Does the generator have enough fuel to run?
• Did the transfer switch work?
• Am I getting bad power from the utility?
• Am I causing my own problems?
• How much power am I consuming?

5
What do I need to know? - Environmental

• Is there enough cooling?
• Is the cooling correct?
• Is one unit working harder than the rest?
• Is the fire system armed and ready?
• Is the leak detection armed and ready?

6
What do I need to know? - Networks

• Is the network up?
• Are my devices communicating?
• Am I getting erroneous alarms?
• Am I getting notified when alarms occur?
• Am I getting meaningful data?

7
Sanity check

• Are you currently monitoring?
• Are you only looking at major alarms?
• Did you have to use the bundled free monitoring
  that came with your equipment?
• Did you have a major event in the last year and
  didnt know how to respond to it?
• Is one system or vendor claiming responsibility?

8
Vendor Communications and Software

• Dry Contacts Major Alarms
• Voltage-free relays
• Serial (RS-485)
• MODBUS RTU
• Ethernet Communications
• SNMP
• MODBUS TCP/IP
• Web Browser (HTTP)
• SMTP (Email)
• System Software
• Backward compatibility
• Migration to web-based

9
Integration into other systems - BMS

• Building Management Systems
• Johnson Controls - Metasys
• Siemens - Apogee
• Honeywell Excel
• Automated Logic WebCTRL
• Suggested Protocols
• BACnet
• Lonworks
• Profibus

10
Integration into other systems - NMS

• Network Management Systems
• HP HP OpenView
• IBM Tivoli
• CA Unicenter
• Nagios Open source
• Suggested Protocols
• SNMP Polling
• SNMP Traps

11
Things get complicated fast

• In traditional U.S. Army slang dating back to the
  Second World War, a blivet was defined as "ten
  pounds of manure in a five pound bag,"
• It was applied to an unmanageable situation, a
  crucial but substandard or damaged tool, or a
  self-important person.

12
Things to look out for

• Are all your eggs in one basket?
• Is the BMS or NMS really sending alerts from your
  critical equipment?
• Are you getting the information you need?
• Are you able to see things on your own computer?
• Are you blocked into a corner?
• No vendor is perfecthe said she said

13
Where do I start?

• Check for device communication capabilities
• Is anything connected to the device
  communications port?
• Is it Ethernet or serial or alarm contacts?
• What was provided with the equipment from the
  vendor?
• Are you able to do this yourself?

14
The foundational protocols

• IP- Internet Protocol (built for addressing
  routing)
• Those switches we talked about address route
• TCP/IP- Transmission Control Protocol/Internet
  Protocol
• Guaranteed packet delivery
• Web surfing, file transfers, email
• Session oriented (think like a telephone call)
• UDP/IP- Universal Datagram Protocol/Internet
  Protocol
• Instant messaging, speech, streaming
• Session-less (think like a baseball)

15
S is for simple, P is for protocol
Remember the bookends Simple and Protocol

• SNMP- Simple Network Management Protocol
• SMTP- Simple Mail Transfer Protocol
• SFTP- Simple File Transfer Protocol
• SNTP- Simple Network Time Protocol

• NTP- Network Time Protocol
• FTP- File Transfer Protocol
• DHCP- Dynamic Host Configuration Protocol
• POP3- Post Office Protocol mate to SNMP
• HTTP- HyperText Transfer Protocol

16
Todays world - I get my news online!
Sounds Complicated Where do I start!
If its not easy to use, you wont use it!
Start by surfing the Web, everyone can do that
17
Todays world My weather is online!
18
Todays world - I shop online!
19
Todays World - Your Critical Equipment
Monitoring is Online!
20
Why would we want web browser monitoring?
Because its easy to monitor with Web-Enabled!
Lots of benefits
No software to install on your system.No
software to add to your computers.No computers
to add to your system.No keys or licenses to
maintain.No Graphics to create.No Data files to
create. Easy access from any computer.Easy
access from any location.Easy Data file
access.Email notification.
21
A Web-based Architecture

• A Web-based architecture allows a web browser to
  access information. Anywhere

Web-enabled
1
22
Why Power Management?
Power Quality
Safety

• Energy Consumption

• Power Continuity

23
Why Measure?

• If you cant measure it, you cant manage it!

24
3 Fundamental Yardsticks

• System Reliability
• Am I OK?
• Will I be OK tomorrow, and the next day?
• Energy Management- you and your Utility
• Energy consumption, instantaneous demand, and
  Power factor penalties are a billable item
• Power Quality
• Interruptions
• Transients
• Surges
• Sags
• Swells
• Frequency variations

25
Monitoring and Verification
26
Identify points to install metering
Monitor incoming mains and feeder breaker trip
units for energy and power information
27
Investment in Systems

• Ye Olde Clipboard
• For simple Energy usage (kWh) clipboards work
  fine.
• Not very practical
• Sore feet walking around!

28
Which cure do I need?
29
Need a flexible system

• Complete Web-based System
• High end Power Quality Meters connect directly to
  the Ethernet LAN (built-in web pages)
• Ethernet Gateways (Data Loggers) bridge serial
  communicating meters to the Ethernet LAN
  (built-in web pages)
• Software provides holistic view of the entire
  power system
• Built-in web graphics (reduces startup and
  commissioning costs)
• Based upon SQL Server for advanced data analysis
  and trending of energy and demand values
• Optional advanced reporting system for standard
  and customized energy and power quality reports

Easy as 1,2,3 All you need is a web browser!
30
Various ways to measure

• Broad range of metering devices
• Metered circuit breaker trip units
• Panel mount meters
• UPS monitoring
• Branch circuit monitoring
• PDU monitoring

31
Power Management Solutions Level 1
Device

• Good (RS-458 Modbus RTU)
• Device parameters are passed as Modbus registers
  over RS-485 daisy chain network
• Compatible with leading BMS or SCADA systems
  hardware interfaces.
• Modbus RTU is easy to translate into other
  protocols
• DeviceNet
• Profibus
• BACnet
• Lonworks

RS-485 SerialCommunications Path
Software System(BMS or Other)
32
Power Management Solutions Level 2
Device

• Better ( Ethernet Ready)
• Built-in Web Server for direct access via web
  browser
• Device parameters are passed as Modbus registers
  over Modbus TCP/IP over Ethernet
• Compatible with leading BMS or SCADA systems
  hardware interfaces.
• Modbus TCP/IP is able to be translated into other
  systems
• OPC
• DeviceNet
• Profibus
• BACnet
• Lonworks

Ethernet Communicationsw/ Built-in Web Server
Standard Web Browser(Client)
33
Power Management Solutions Level 3
Devices

• Best (System Software)
• Built-in web graphics (reduces startup and
  commissioning costs)
• Based upon SQL Server for advanced data analysis
  and trending of energy and demand values
• Optional advanced reporting system for standard
  and customized energy and power quality reports

Ethernet communicationsstandard or optional card
Computer ServerWeb Based System
SQL
34
Power XpertWeb-based Solutions
35
Power Xpert Web-based Solutions

• 3 User Levels
• Power Xpert Gateways
• Eaton Equipment
• Non-Eaton Equipment
• Data integration using SNMP or Modbus TCP/IP
• Power Xpert Software
• Single view
• Extended device support
• Enhanced Graphics
• 3. Power Xpert Reporting Software
• Standard Reports
• SQL Professional
• PDF, XML, or .CSV

36
Level 1 System Diagram
Building Management or Network Management System
Licensed Client
Modbus TCP/IPSNMP
Modbus Gateway
Modbus RTU RS-485 Network
37
Level 2 System Diagram
Building Management or Network Management System
Wireless Web Devices
Web Browser
HTTP (Web)
Modbus TCP/IP
Web-based Gateway
Modbus RTU RS-485 Network
38
Level 3 System Diagram
Web-enabled Meter
Web-basedSoftware
Web-enabledGateway
Network Time Server
Network Switch
Device Comms
Ethernet
Device Comms
Device Comms
Generator
UPS or PDU
Switchgear
Motor Control Center
39
What is a Web-enabled Gateway?

• A Web-enabled Gateway is a critical component in
  a web-based communications architecture
• The gateway converts field bus protocols, that
  are local to the devices, up to the Ethernet
  network that is accessible via the Local Area
  Network (LAN) to a standard web browser.
• It generally supports up to 64 devices using 2
  ports

Upstream Internet Protocol
Web browser, Power Xpert Software or 3rd Party
Software
Web/SNMP TCP/IP
ModBus TCP/IP
Downstream Field Bus Protocols
Eaton or 3rd Party Devices
ModBus RTU
INCOM
40
Integrate Diverse Systems
Integration of many systems to a single Ethernet
Gateway via Modbus RS-485

• Diesel Gen UPS
• Switch Gear ATS
• Static Switch PDU
• CRAC Fuel Management
• Seq of Events Power Quality Meters
• Battery Monitor Chillers
• Leak Detect Temp/Humidity
• Network Mgr Building Mgr
• Branch Circuit Monitor

• Single web browser console to
• Simplified Training
• Consolidated Alarms
• Time Synced Event History
• Interface to BMS, NMS, Inventory Trouble
  Ticket

41
Provides support for many vendors

• UPS - Powerware, MGE, Mitsubishi, IPM, Liebert,
  APC
• PDU Eaton, Liebert, PDI, United Power
• Switchgear / ATS Eaton, Caterpillar, ASCO, GE,
  Russelectric
• Static Switches - Cyberex, Liebert, United Power
• Diesel generators - Caterpillar, Onan/Cummins,
  Detroit Diesel
• Air Conditioners / Chillers - Liebert, DataAire,
  Air Flow, York
• Power Quality Meters Eaton, GE, Sq-D, Rochester
• Leverages all new protocols-SNMP, OPC, BacnetWeb
  etc.

42
Web-enabled Gateway - Features

• Real-time data trending
• Data and event logging, export .csv files for
  analysis
• User-settable events
• Waveform capture and file downloads
• Email notification of events

43
Web-enabled Gateway Monitoring
44
Home page gives a high level system summary with
device status, communication status and events.
45
Expand the Event Summary to view all Events for a
given Main/Bus grouping. Events are shown in
chronological order, newest being at the top of
the list.
46
(No Transcript)
47
Web-enabled Gateway Data Trending
Data trends can be viewed for each meter or trip
unit per phase
48
Bus page, or second level summary, shown here.
You can still view the Main summary info on the
left side of the screen. This page provides a
device status and comm status for the group of
devices below the Bus.
49
Waveform icon shown for devices that have
waveform support. Click to view list of waveform
events and download COMTRADE waveform files.
View files with a standard COMTRADE file viewer.
50