IPP Software Navigation Tools IPP Links Communication Pan-STARRS Links

Changes between Version 6 and Version 7 of PS1_IPP_Czarlog_20190218


Ignore:
Timestamp:
Feb 20, 2019, 3:34:32 PM (7 years ago)
Author:
tdeboer
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • PS1_IPP_Czarlog_20190218

    v6 v7  
    2424  * ps_ud% chips and warps label changed to update.hold20190219 so not to be cleaned by accident
    2525
     26 * TdB: John, Roger and myself went through the logfiles to figure out what went wrong yesterday with ipp113. We looked through the reports for ipp113 on Ganglia, noticing the spiking load after 18:00 until 20:00. We went into the serial console using:
     27{{{
     28console --user xxxx -v ipp113
     29}}}
     30
     31 and check the rolling log information. We check the status (option 8) under power management (CTRL + P) and noticed it was back to normal now.
     32 Mark showed us how to powercycle the machine and check the boot messages in /var/log/messages (as sudo user)
     33
     34 When a machine has been power cycled, MYSQL is probably down. Check that by doing:
     35{{{
     36ps -ef | grep mysql
     37}}}
     38 Check the config file under /etc/mysql/my.cnf for the location of the error log and see if MYSQL is what caused the issue. In this case, it did not.
     39
     40 To restart MYSQL do:
     41{{{
     42/etc/init.d/mysql start
     43}}}
     44
    2645=== Wednesday : YYYY.MM.DD ===
    2746