PS1 IPP Czar Logs for the week 2014.05.12 - 2014.05.19

(Up to PS1 IPP Czar Logs)

Monday : 2014.05.12

mark is czar

• 07:30 MEH: 3x c2 in staticsky too much again, -1x c2
• 08:00 MEH: looks like LAP is stalled from too many faults now again

  --- missing smf 
   neb://any/gpc1/ThreePi.nt/2010/03/13/o5268g0101o.147355/o5268g0101o.147355.cm.60313.smf
  2014/05/12 08:12:52 | ippc18 | FATAL | Nebulous::Client::find_instances - unhandled fault - database error: no instances available for key: neb:///gpc1/ThreePi.nt/2010/03/13/o5268g0101o.147355/o5268g0101o.147355.cm.60313.smf at /usr/lib64/perl5/site_perl/5.8.8/Nebulous/Server.pm line 1838, <DATA> line 12.
  unhandled fault - database error: no instances available for key: neb:///gpc1/ThreePi.nt/2010/03/13/o5268g0101o.147355/o5268g0101o.147355.cm.60313.smf at /usr/lib64/perl5/site_perl/5.8.8/Nebulous/Server.pm line 1838, <DATA> line 12.
  [ippc18:~] mhuber% whichnode neb://any/gpc1/ThreePi.nt/2010/03/13/o5268g0101o.147355/o5268g0101o.147355.cm.60313.smf
  duplicate variable name: LOGFORMAT, removed
   at /data/ippc18.0/home/mhuber/IPP//ipp-20140506.lin64/lib/PS/IPP/Config.pm line 96
  ipp020.0X not available
  
  --- missing cm masks is a common one from Saturday
  neb://any/gpc1/ThreePi.nt/2010/05/22/o5338g0138o.170714/o5338g0138o.170714.cm.80535.XY74.mk.fits
  nebulous key: neb://any/gpc1/ThreePi.nt/2010/05/22/o5338g0138o.170714/o5338g0138o.170714.cm.80535.XY74.mk.fits not found at /data/ippc18.0/home/mhuber/IPP//ipp-20140506.lin64/bin/neb-stat line 47.
    
  neb://any/gpc1/ThreePi.nt/2010/05/22/o5338g0156o.170732/o5338g0156o.170732.cm.80553.XY40.mk.fits 
  neb://any/gpc1/ThreePi.nt/2010/06/13/o5360g0134o.180687/o5360g0134o.180687.cm.86770.XY64.mk.fits 
  neb://any/gpc1/ThreePi.nt/2010/07/23/o5400g0123o.195530/o5400g0123o.195530.cm.98586.XY74.mk.fits
  neb://any/gpc1/ThreePi.nt/2011/03/15//o5635g0486o.310739/o5635g0486o.310739.cm.184246.XY25.mk.fits 
  neb://any/gpc1/ThreePi.nt/2011/03/18//o5638g0304o.312937/o5638g0304o.312937.cm.185878.XY65.mk.fits 
  
  -- memory err --  	o6638g0084o 	686017 	987119 	956504 	933140 	936092 	skycell.2600.049 
  Memory Block ID: 8916146 @ 0x7fb0c1ca0010
  	Previous Block: (nil) Next Block: 0xe782010
  	Free function: (nil)
  	Size: 82559792 Reference count: 1 Persistent: No
  	Posts: deadbeef deadbeef 0
  	Allocated in psFitsScaleForDisk at (psFitsScale.c:971)
  		by Thread ID 140397226923760
  	Memory block is corrupted; buffer overflow detected.
  	Caught in p_psMemCheckCorruption at (psMemory.c:1319).
  	Caught in imageFree at (psImage.c:75).
  p_psMemDecrRefCounter (psMemory.c:1150) Unsafe to Continue
  Aborting.  Error stack:
  

Tuesday : YYYY.MM.DD

Wednesday : YYYY.MM.DD

Thursday : YYYY.MM.DD

Friday : YYYY.MM.DD

Saturday : YYYY.MM.DD

Sunday : YYYY.MM.DD