2010 Production Node Work

(Up to Production Cluster Status)

Aug 6

• Swapped Memory out of IPP12
• Upgraded IPP006 and IPP007 with 2TB drives

Jun 22

• Swapped Memory out of IPP14

April 27

• ipp018
  • swapped memory -> continuous beeps
  • Brad noticed one row of the hard drive array did not light up with red lights
  • Reseated SATA cables to backplane and RAID card
  • Swapped in set of new memory

April 26

• Swapped in larger RAID card memory module in ipp037
• ipp018
  • reseated memory -> still 2G memory
  • swapped CPUs -> still 2G memory showing
  • swapped in new set of memory (all 8 sticks) -> no boot rapid beeps

April 16

• Swapped two new CPUs into ipp037 and booted it into .31 kernel

April 8

• Swapped positions of ipp005 and ipp037 in rack
• Attached ipp037 SATA cables to the RAID card so they're mapped properly
• Noted fan warnings on nodes ipp014, 016, 008, 007, 004, 025, 024, and 045 (appear to be due to fan power board failures)

April 1

• ipp008
  • Put back into rack
  • Still missing single HD array fan

• ipp018
  • New motherboard; 2 new CPU fans (Sunon)
  • Put back in rack

• ipp037
  • New motherboard; 2 new CPU fans (Sunon)
  • Put back in rack
  • Array cables not mapped to RAID card correctly

• ipp014
  • Unsuccessfully attempted to get one of the HD array duo fans working
  • Appears to be an issue with the connector

March 22

• ipp018
  • Boots but goes to A:\>
  • Pulled CMOS battery; reset MB w/ jumper; no help

• ipp008
  • No boot
  • Rapid beeps
  • One pwr supply dead
  • Swapped in new MB
  • Replaced CPU fans with those taken from ipp037
  • Single HD array fan not working (appears to be module connector)

February 22

• Confirmed light on ippc17 drive
• Installed additional fan in ippc18 (small fan on right side)

February 16

• ipp008
  • No boot
  • rapid beeps -> then 1 sec beep

• ipp018
  • No boot
  • Both CPU fans not working - one has broken wire
  • No codes on MB
  • No lights on power supplies

• ipp037
  • No RAID card
  • CPUs installed w/o paste

February 11

• Installed an additional fan in ippc19 (small fan on right side)
• Swapped CPUs
  • ipp018 -> ipp005
• ipp037 -> ipp008

• Notes: ipp018 had excessive paste, bent pins on CPU2 (on MB), and an apparently scorched heatsink

NODE SWAPPING MAP

*Wave1 IPP17 died. Its disks were swapped into Wave2 IPP37

• So IPP17 is a Wave2 Machine.

*The broken Wave1 Machine (previously IPP17) was sent back. When it came back

• It has a different motherboard
• A newly broken IPP14 disks were swapped in.

*So IPP14 became IPP37.

• IPP14 ( Now IPP37 ) was out of warranty so we decided to swap the mother board and cpu's

• Summary:
  • IPP14 is a Wave 1 ASA Machine with a different motherboard.
  • IPP17 Is a Wave 2 YMI Machine
  • IPP37 is a Wave 1 Machine