An IPMC for the PANDA Compute Node Development of an Intelligent Platform Management Controller Thomas Geßler JLU Gießen 15. April 2010 Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node 15. April 2010 1 / 14
Motivation The Compute Nodes IPMC are hosted in an ATCA Connector Shelf. The components of an ATCA Shelf are managed via IPMI (Intelliget Platform Management Interface). Each “Intelligent Field Replaceable Unit” (FRU) inside the Shelf needs an IPM Controller to manage sensors, power etc. Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node 15. April 2010 2 / 14
Outline The IPMI Interface 1 The ATCA Architecture 2 The ATCA Shelf and the Compute Node 3 Development of the IPM Controller 4 Functions Components Prototype Firmware Development Outlook 5 Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node 15. April 2010 3 / 14
The Intelligent Platform Management Interface LAN Modem LAN Serial Connector Connector Non-volatile Storage System Event Log ( SEL ) side-band Sensor Data Record ( SDR ) Baseboard interface Repository to NIC, Management Baseboard Field-Replacable e.g. Network Controller Unit ( FRU ) Info SMBus (LAN) (BMC) Sensors & Control Circuitry Controller Voltages, T emperatures, Fans, Serial Power & Reset control etc. Serial Port Controller Sharing Motherboard System Interface Serial Controller IPMI Messages System Bus Motherboard A System is monitored by a Baseboard Management Controller (BMC). Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node 15. April 2010 4 / 14
The Intelligent Platform Management Interface LAN Modem LAN Serial Connector Connector Non-volatile Storage System Event Log ( SEL ) side-band Sensor Data Record ( SDR ) Baseboard interface Repository to NIC, Management Baseboard Field-Replacable e.g. Network Controller Unit ( FRU ) Info SMBus (LAN) (BMC) Sensors & Control Circuitry Controller Voltages, T emperatures, Fans, Serial Power & Reset control etc. Serial Port Controller Sharing Private Management Buses Motherboard System Interface Serial FRU FRU Controller IPMI SEEPROM SEEPROM Messages System Bus T emperature Sensor Motherboard Memory Processor Board Board Extentible with Field Replacable Units (FRUs). Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node 15. April 2010 5 / 14
The Intelligent Platform Management Interface LAN Modem LAN Serial Connector Connector IPMB Non-volatile Storage Chassis System Event Log ( SEL ) side-band Management Sensor Data Record ( SDR ) Baseboard interface Repository ( Satellite to NIC, Management Baseboard Field-Replacable Controller ) e.g. Network Controller Unit ( FRU ) Info SMBus (LAN) (BMC) Sensors & Control Circuitry Controller FRU Voltages, T emperatures, Fans, Serial SEEPROM Power & Reset control etc. Serial Port Chassis Controller Sharing Private Management Buses Sensors e.g. Fans, T emperatures, Motherboard System Interface Power Supplies Serial FRU FRU Controller Chassis Board IPMI SEEPROM SEEPROM Messages System Bus T emperature FRU Sensor SEEPROM Motherboard Memory Processor Redundant Board Board Power Board Subsystems are managed by a Satellite Controller ( → IPMC). Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node 15. April 2010 6 / 14
The Advanced Telecommunications Computing Architecture IPM Controller (IPMC) Shelf-External System Manager Shelf Management Controller (ShMC) AdvancedTCA Board Shelf Manager w/ Dedicated ShMC Other Field Replaceable Unit (FRU) Power Power Key Shelf Shelf Fan Entry Entry Manager Manager Tray Module Module (Active) (Backup) Implementation Dependent Connection ShMC ShMC IPMC 2x Redundant, Bussed or Radial, IPMB-0 IPMC IPMC IPMC IPMC IPMC IPMC IPMC IPMC ATCA ATCA ATCA ATCA ATCA ATCA ATCA ATCA Board Board Board Board Board Board Board Board 2x Redundant Radial Internet-Protocol-Capable Transport Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node 15. April 2010 7 / 14
The ATCA Shelf Shelf Alarm Panel 3000 W Power Supply Shelf Manager 3 Fan Trays 2 Power Entry Modules Schroff 14-Slot AdvancedTCA Shelf with Full-Mesh Backplane Connectors. 3000 W power supply for up to 14 200 W Compute Nodes. Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node 15. April 2010 8 / 14
The Compute Node in the ATCA Shelf IPMC Connector Voltage Sensor FPGAs T emperature Sensors Power Supply Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node 15. April 2010 9 / 14
Functions of the IPM Controller Represent the Compute Node on the IPMB-0 (IPMB-address determined from Backplane hardware address). Receive and transmit mandatory IPMI commands. Perform Power Negotiations with the Shelf Manager and control the Compute Node’s power supply. Manage Hot-Swap events. Provide an interface for sensors on the Compute Node (read-out and setting of thresholds). Relay sensor alerts to the Shelf Manager (create IPMI events). Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node 15. April 2010 10 / 14
Components of the IPM Controller Compute Node PC Serial Interface A IPMC Voltage T UART Sensor C Driver (12 channel External ADC) A Hardware Address I²C- Controller Microcontroller +3.3 V B Atmel T emperature FPGA #1 -48 V DC/DC ATmega1280 a T emperature Sensor Converter Sensor 1 #2 c Compute Node FPGA #1 Voltage External External Internal Power Enable T emperature Sensor k I²C-Controller I²C- I²C- I²C Sensor 2 #2 Controller Controller Sensor p Compute Node Bus l Interface a T emperature FPGA #2 T emperature Sensor n Sensor 1 #2 FPGA #2 Voltage e T emperature Sensor Sensor 2 #2 Compute Node IPMB-0: dual-redundant Supply Voltages I²C bus for IPMI Atmel ATmega1280 microcontroller. TI MAX3221 RS-232 Line Driver/Receiver. NXP PCA9665 Parallel bus to I 2 C-bus controller. Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node 15. April 2010 11 / 14
Assembled IPM Controller Prototype UART Driver Parallel-to-I²C Controller Microcontroller and 8MHz quartz 2 60-pin connectors Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node 15. April 2010 12 / 14
Status of the Firmware Development Firmware is being developed in C++ for the avr-gcc compiler. The microcontroller is programmed via a JTAG interface. A “command shell” was written for the PC serial interface. The I 2 C interface controllers can be used. Temperature sensors on the Compute Node’s I 2 C bus can be read out and programmed. Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node 15. April 2010 13 / 14
Outlook Firmware development will be continued. IPMI commands will be implemented to allow communication with the Shelf Manager via IPMB-0. Function of the managed components of the Compute Node and communication with the Shelf Manager will be tested. A new version of the IPMC will be designed and built, eliminating minor hardware bugs. Thomas Geßler (JLU Gießen) An IPMC for the PANDA Compute Node 15. April 2010 14 / 14
Recommend
More recommend
