2016-04-21 12:25:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 12:25:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 12:25:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:25:51 [DEBUG   ] Finished updating board flags in 1.011 seconds
2016-04-21 12:26:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 12:26:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 12:26:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 12:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:26:51 [DEBUG   ] Finished updating board flags in 1.017 seconds
2016-04-21 12:27:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 12:27:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 12:27:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 12:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:27:51 [DEBUG   ] Finished updating board flags in 0.974 seconds
2016-04-21 12:28:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 12:28:10 [DEBUG   ] Got command RPT from MCS: ref #670775
2016-04-21 12:28:10 [DEBUG   ] summary = NORMAL
2016-04-21 12:28:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670775  14 57499 44890694 A NORMALNORMAL'
2016-04-21 12:28:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 12:28:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 12:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:28:52 [DEBUG   ] Finished updating board flags in 1.425 seconds
2016-04-21 12:29:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 12:29:29 [DEBUG   ] Got command RPT from MCS: ref #670784
2016-04-21 12:29:29 [DEBUG   ] summary = NORMAL
2016-04-21 12:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670784  14 57499 44969554 A NORMALNORMAL'
2016-04-21 12:29:29 [DEBUG   ] Got command RPT from MCS: ref #670785
2016-04-21 12:29:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 12:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670785  48 57499 44969554 A NORMALSystem calibrated and operating normally'
2016-04-21 12:29:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 12:29:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:29:52 [DEBUG   ] Finished updating board flags in 1.341 seconds
2016-04-21 12:30:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 12:30:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 12:30:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:30:52 [DEBUG   ] Finished updating board flags in 1.215 seconds
2016-04-21 12:31:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-21 12:31:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-21 12:31:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 12:31:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:31:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:31:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:31:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:31:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:31:52 [DEBUG   ] Finished updating board flags in 1.177 seconds
2016-04-21 12:32:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-21 12:32:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 12:32:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-21 12:32:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:32:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:32:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:32:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:32:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:32:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 12:32:52 [DEBUG   ] Finished updating board flags in 1.012 seconds
2016-04-21 12:33:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 12:33:10 [DEBUG   ] Got command RPT from MCS: ref #670804
2016-04-21 12:33:10 [DEBUG   ] summary = NORMAL
2016-04-21 12:33:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670804  14 57499 45190770 A NORMALNORMAL'
2016-04-21 12:33:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-21 12:33:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-21 12:33:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:33:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:33:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:33:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:33:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:33:52 [DEBUG   ] Finished updating board flags in 1.009 seconds
2016-04-21 12:34:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 12:34:29 [DEBUG   ] Got command RPT from MCS: ref #670808
2016-04-21 12:34:29 [DEBUG   ] summary = NORMAL
2016-04-21 12:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670808  14 57499 45269562 A NORMALNORMAL'
2016-04-21 12:34:29 [DEBUG   ] Got command RPT from MCS: ref #670809
2016-04-21 12:34:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 12:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670809  48 57499 45269562 A NORMALSystem calibrated and operating normally'
2016-04-21 12:34:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 12:34:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 12:34:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:34:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:34:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:34:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:34:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:34:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 12:34:52 [DEBUG   ] Finished updating board flags in 1.011 seconds
2016-04-21 12:35:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 12:35:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 12:35:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 12:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:35:53 [DEBUG   ] Finished updating board flags in 2.063 seconds
2016-04-21 12:36:00 [DEBUG   ] Got command TBN from MCS: ref #670825
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] tbn = exited with status True, code 0x00
2016-04-21 12:36:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   670825   8 57499 45360790 A NORMAL'
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1461242162']
2016-04-21 12:36:00 [DEBUG   ] spawn_process: at 2016-04-21 12:36:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1461242162']
2016-04-21 12:36:00 [INFO    ] Finished spawning TBN in 0.049 s
2016-04-21 12:36:10 [DEBUG   ] Finished updating ant stats in 0.470 seconds
2016-04-21 12:36:31 [DEBUG   ] Finished updating ant stats in 1.381 seconds
2016-04-21 12:36:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 12:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:36:53 [DEBUG   ] Finished updating board flags in 2.244 seconds
2016-04-21 12:37:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 12:37:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 12:37:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 12:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:37:53 [DEBUG   ] Finished updating board flags in 2.216 seconds
2016-04-21 12:38:10 [DEBUG   ] Got command RPT from MCS: ref #670830
2016-04-21 12:38:10 [DEBUG   ] summary = NORMAL
2016-04-21 12:38:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670830  14 57499 45490862 A NORMALNORMAL'
2016-04-21 12:38:11 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 12:38:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 12:38:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 12:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:38:53 [DEBUG   ] Finished updating board flags in 2.079 seconds
2016-04-21 12:39:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 12:39:29 [DEBUG   ] Got command RPT from MCS: ref #670836
2016-04-21 12:39:29 [DEBUG   ] summary = NORMAL
2016-04-21 12:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670836  14 57499 45569554 A NORMALNORMAL'
2016-04-21 12:39:29 [DEBUG   ] Got command RPT from MCS: ref #670837
2016-04-21 12:39:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 12:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670837  48 57499 45569554 A NORMALSystem calibrated and operating normally'
2016-04-21 12:39:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 12:39:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 12:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:39:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2016-04-21 12:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:39:53 [DEBUG   ] Finished updating board flags in 2.018 seconds
2016-04-21 12:40:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 12:40:11 [DEBUG   ] Got command TBW from MCS: ref #670854
2016-04-21 12:40:11 [DEBUG   ] tbw = exited with status True, code 0x00
2016-04-21 12:40:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   670854   8 57499 45611826 A NORMAL'
2016-04-21 12:40:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2016-04-21 12:40:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2016-04-21 12:40:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2016-04-21 12:40:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2016-04-21 12:40:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2016-04-21 12:40:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2016-04-21 12:40:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2016-04-21 12:40:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2016-04-21 12:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2016-04-21 12:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2016-04-21 12:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2016-04-21 12:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2016-04-21 12:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2016-04-21 12:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2016-04-21 12:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2016-04-21 12:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2016-04-21 12:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2016-04-21 12:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2016-04-21 12:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2016-04-21 12:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2016-04-21 12:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2016-04-21 12:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2016-04-21 12:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2016-04-21 12:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2016-04-21 12:40:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2016-04-21 12:40:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2016-04-21 12:40:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2016-04-21 12:40:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2016-04-21 12:40:15 [DEBUG   ] spawn_process: at 2016-04-21 12:40:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2016-04-21 12:40:15 [INFO    ] Finished spawning TBW
2016-04-21 12:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:40:52 [DEBUG   ] Finished updating board flags in 1.276 seconds
2016-04-21 12:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:41:53 [DEBUG   ] Finished updating board flags in 1.849 seconds
2016-04-21 12:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:42:52 [DEBUG   ] Finished updating board flags in 1.126 seconds
2016-04-21 12:43:10 [DEBUG   ] Got command RPT from MCS: ref #670864
2016-04-21 12:43:10 [DEBUG   ] summary = NORMAL
2016-04-21 12:43:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670864  14 57499 45790946 A NORMALNORMAL'
2016-04-21 12:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:43:53 [DEBUG   ] Finished updating board flags in 1.620 seconds
2016-04-21 12:43:54 [INFO    ] __waitForTBW - TBW finished in 218.911 s
2016-04-21 12:43:55 [INFO    ] Started antennas statistics background thread
2016-04-21 12:43:55 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] spawn_process: at 2016-04-21 12:43:55 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1461242636']
2016-04-21 12:43:55 [DEBUG   ] Finished updating ant stats in 1.060 seconds
2016-04-21 12:43:55 [INFO    ] Finished spawning TBN in 0.057 s
2016-04-21 12:44:15 [DEBUG   ] Finished updating ant stats in 1.034 seconds
2016-04-21 12:44:29 [DEBUG   ] Got command RPT from MCS: ref #670871
2016-04-21 12:44:29 [DEBUG   ] summary = NORMAL
2016-04-21 12:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670871  14 57499 45869558 A NORMALNORMAL'
2016-04-21 12:44:29 [DEBUG   ] Got command RPT from MCS: ref #670872
2016-04-21 12:44:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 12:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670872  48 57499 45869558 A NORMALSystem calibrated and operating normally'
2016-04-21 12:44:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 12:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:44:53 [DEBUG   ] Finished updating board flags in 1.859 seconds
2016-04-21 12:44:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 12:45:15 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-21 12:45:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 12:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:45:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2016-04-21 12:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:45:53 [DEBUG   ] Finished updating board flags in 1.662 seconds
2016-04-21 12:45:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 12:46:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 12:46:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 12:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:46:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 12:46:53 [DEBUG   ] Finished updating board flags in 1.615 seconds
2016-04-21 12:46:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 12:47:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 12:47:35 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 12:47:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:47:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:47:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:47:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:47:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:47:53 [DEBUG   ] Finished updating board flags in 1.609 seconds
2016-04-21 12:47:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 12:48:11 [DEBUG   ] Got command RPT from MCS: ref #670895
2016-04-21 12:48:11 [DEBUG   ] summary = NORMAL
2016-04-21 12:48:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670895  14 57499 46091034 A NORMALNORMAL'
2016-04-21 12:48:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 12:48:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 12:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:48:53 [DEBUG   ] Finished updating board flags in 1.586 seconds
2016-04-21 12:48:55 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 12:49:16 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2016-04-21 12:49:29 [DEBUG   ] Got command RPT from MCS: ref #670904
2016-04-21 12:49:29 [DEBUG   ] summary = NORMAL
2016-04-21 12:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670904  14 57499 46169558 A NORMALNORMAL'
2016-04-21 12:49:29 [DEBUG   ] Got command RPT from MCS: ref #670905
2016-04-21 12:49:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 12:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670905  48 57499 46169558 A NORMALSystem calibrated and operating normally'
2016-04-21 12:49:36 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2016-04-21 12:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:49:53 [DEBUG   ] Finished updating board flags in 1.492 seconds
2016-04-21 12:49:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 12:50:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 12:50:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 12:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:50:53 [DEBUG   ] Finished updating board flags in 1.496 seconds
2016-04-21 12:50:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 12:51:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 12:51:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 12:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:51:53 [DEBUG   ] Finished updating board flags in 1.496 seconds
2016-04-21 12:51:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 12:52:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 12:52:36 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2016-04-21 12:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:52:54 [DEBUG   ] Finished updating board flags in 2.224 seconds
2016-04-21 12:52:56 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-21 12:53:11 [DEBUG   ] Got command RPT from MCS: ref #670924
2016-04-21 12:53:11 [DEBUG   ] summary = NORMAL
2016-04-21 12:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670924  14 57499 46391118 A NORMALNORMAL'
2016-04-21 12:53:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 12:53:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 12:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:53:54 [DEBUG   ] Finished updating board flags in 2.090 seconds
2016-04-21 12:53:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 12:54:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 12:54:29 [DEBUG   ] Got command RPT from MCS: ref #670925
2016-04-21 12:54:29 [DEBUG   ] summary = NORMAL
2016-04-21 12:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670925  14 57499 46469566 A NORMALNORMAL'
2016-04-21 12:54:29 [DEBUG   ] Got command RPT from MCS: ref #670926
2016-04-21 12:54:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 12:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670926  48 57499 46469566 A NORMALSystem calibrated and operating normally'
2016-04-21 12:54:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 12:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:54:54 [DEBUG   ] Finished updating board flags in 2.038 seconds
2016-04-21 12:54:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 12:55:16 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-21 12:55:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 12:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:55:54 [DEBUG   ] Finished updating board flags in 1.971 seconds
2016-04-21 12:55:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 12:56:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 12:56:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 12:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:56:54 [DEBUG   ] Finished updating board flags in 1.817 seconds
2016-04-21 12:56:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 12:57:17 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2016-04-21 12:57:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 12:57:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:57:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:57:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:57:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:57:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:57:54 [DEBUG   ] Finished updating board flags in 1.787 seconds
2016-04-21 12:57:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 12:58:11 [DEBUG   ] Got command RPT from MCS: ref #670946
2016-04-21 12:58:11 [DEBUG   ] summary = NORMAL
2016-04-21 12:58:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670946  14 57499 46691202 A NORMALNORMAL'
2016-04-21 12:58:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 12:58:37 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2016-04-21 12:58:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:58:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:58:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:58:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:58:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:58:54 [DEBUG   ] Finished updating board flags in 1.623 seconds
2016-04-21 12:58:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 12:59:17 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2016-04-21 12:59:29 [DEBUG   ] Got command RPT from MCS: ref #670955
2016-04-21 12:59:29 [DEBUG   ] summary = NORMAL
2016-04-21 12:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670955  14 57499 46769558 A NORMALNORMAL'
2016-04-21 12:59:29 [DEBUG   ] Got command RPT from MCS: ref #670956
2016-04-21 12:59:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 12:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670956  48 57499 46769558 A NORMALSystem calibrated and operating normally'
2016-04-21 12:59:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 12:59:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 12:59:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 12:59:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 12:59:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 12:59:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 12:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 12:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 12:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 12:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 12:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 12:59:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2016-04-21 12:59:54 [DEBUG   ] Finished updating board flags in 1.674 seconds
2016-04-21 12:59:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 13:00:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 13:00:37 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2016-04-21 13:00:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:00:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:00:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:00:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:00:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:00:54 [DEBUG   ] Finished updating board flags in 1.476 seconds
2016-04-21 13:00:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 13:01:17 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2016-04-21 13:01:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 13:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:01:54 [DEBUG   ] Finished updating board flags in 1.506 seconds
2016-04-21 13:01:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 13:02:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 13:02:37 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2016-04-21 13:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:02:54 [DEBUG   ] Finished updating board flags in 1.510 seconds
2016-04-21 13:02:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 13:03:11 [DEBUG   ] Got command RPT from MCS: ref #670975
2016-04-21 13:03:11 [DEBUG   ] summary = NORMAL
2016-04-21 13:03:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670975  14 57499 46991294 A NORMALNORMAL'
2016-04-21 13:03:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 13:03:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 13:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:03:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2016-04-21 13:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:03:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 13:03:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2016-04-21 13:03:55 [DEBUG   ] Finished updating board flags in 2.218 seconds
2016-04-21 13:03:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 13:04:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 13:04:29 [DEBUG   ] Got command RPT from MCS: ref #670979
2016-04-21 13:04:29 [DEBUG   ] summary = NORMAL
2016-04-21 13:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670979  14 57499 47069562 A NORMALNORMAL'
2016-04-21 13:04:29 [DEBUG   ] Got command RPT from MCS: ref #670980
2016-04-21 13:04:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 13:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   670980  48 57499 47069563 A NORMALSystem calibrated and operating normally'
2016-04-21 13:04:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 13:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:04:55 [DEBUG   ] Finished updating board flags in 2.322 seconds
2016-04-21 13:04:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 13:05:17 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2016-04-21 13:05:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 13:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:05:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 13:05:55 [DEBUG   ] Finished updating board flags in 2.091 seconds
2016-04-21 13:05:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 13:06:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 13:06:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 13:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:06:55 [DEBUG   ] Finished updating board flags in 1.977 seconds
2016-04-21 13:06:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 13:07:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 13:07:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 13:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:07:55 [DEBUG   ] Finished updating board flags in 1.786 seconds
2016-04-21 13:07:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 13:08:11 [DEBUG   ] Got command RPT from MCS: ref #671000
2016-04-21 13:08:11 [DEBUG   ] summary = NORMAL
2016-04-21 13:08:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671000  14 57499 47291374 A NORMALNORMAL'
2016-04-21 13:08:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 13:08:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 13:08:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:08:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:08:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:08:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:08:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:08:55 [DEBUG   ] Finished updating board flags in 1.622 seconds
2016-04-21 13:08:56 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-21 13:09:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-21 13:09:29 [DEBUG   ] Got command RPT from MCS: ref #671006
2016-04-21 13:09:29 [DEBUG   ] summary = NORMAL
2016-04-21 13:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671006  14 57499 47369562 A NORMALNORMAL'
2016-04-21 13:09:29 [DEBUG   ] Got command RPT from MCS: ref #671007
2016-04-21 13:09:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 13:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671007  48 57499 47369562 A NORMALSystem calibrated and operating normally'
2016-04-21 13:09:37 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2016-04-21 13:09:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:09:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:09:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:09:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:09:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:09:55 [DEBUG   ] Finished updating board flags in 1.584 seconds
2016-04-21 13:09:57 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-21 13:10:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 13:10:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 13:10:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:10:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:10:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:10:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:10:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:10:55 [DEBUG   ] Finished updating board flags in 1.455 seconds
2016-04-21 13:10:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 13:11:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 13:11:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 13:11:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:11:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:11:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:11:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:11:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:11:55 [DEBUG   ] Finished updating board flags in 1.542 seconds
2016-04-21 13:11:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 13:12:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 13:12:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 13:12:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:12:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:12:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:12:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:12:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:12:56 [DEBUG   ] Finished updating board flags in 1.577 seconds
2016-04-21 13:12:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 13:13:11 [DEBUG   ] Got command RPT from MCS: ref #671026
2016-04-21 13:13:11 [DEBUG   ] summary = NORMAL
2016-04-21 13:13:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671026  14 57499 47591446 A NORMALNORMAL'
2016-04-21 13:13:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 13:13:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 13:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:13:56 [DEBUG   ] Finished updating board flags in 2.121 seconds
2016-04-21 13:13:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 13:14:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 13:14:29 [DEBUG   ] Got command RPT from MCS: ref #671030
2016-04-21 13:14:29 [DEBUG   ] summary = NORMAL
2016-04-21 13:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671030  14 57499 47669570 A NORMALNORMAL'
2016-04-21 13:14:29 [DEBUG   ] Got command RPT from MCS: ref #671031
2016-04-21 13:14:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 13:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671031  48 57499 47669570 A NORMALSystem calibrated and operating normally'
2016-04-21 13:14:37 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-21 13:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:14:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2016-04-21 13:14:56 [DEBUG   ] Finished updating board flags in 2.009 seconds
2016-04-21 13:14:57 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-21 13:15:17 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-21 13:15:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-21 13:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:15:56 [DEBUG   ] Finished updating board flags in 1.901 seconds
2016-04-21 13:15:58 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-21 13:16:18 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-21 13:16:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 13:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:16:56 [DEBUG   ] Finished updating board flags in 1.827 seconds
2016-04-21 13:16:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 13:17:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 13:17:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 13:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:17:56 [DEBUG   ] Finished updating board flags in 1.820 seconds
2016-04-21 13:17:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 13:18:11 [DEBUG   ] Got command RPT from MCS: ref #671051
2016-04-21 13:18:11 [DEBUG   ] summary = NORMAL
2016-04-21 13:18:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671051  14 57499 47891526 A NORMALNORMAL'
2016-04-21 13:18:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 13:18:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 13:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:18:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2016-04-21 13:18:56 [DEBUG   ] Finished updating board flags in 1.775 seconds
2016-04-21 13:18:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 13:19:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 13:19:29 [DEBUG   ] Got command RPT from MCS: ref #671060
2016-04-21 13:19:29 [DEBUG   ] summary = NORMAL
2016-04-21 13:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671060  14 57499 47969570 A NORMALNORMAL'
2016-04-21 13:19:29 [DEBUG   ] Got command RPT from MCS: ref #671061
2016-04-21 13:19:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 13:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671061  48 57499 47969570 A NORMALSystem calibrated and operating normally'
2016-04-21 13:19:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 13:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:19:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2016-04-21 13:19:56 [DEBUG   ] Finished updating board flags in 1.615 seconds
2016-04-21 13:19:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 13:20:18 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 13:20:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 13:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:20:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:20:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:20:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:20:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:20:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:20:56 [DEBUG   ] Finished updating board flags in 1.574 seconds
2016-04-21 13:20:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 13:21:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 13:21:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 13:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:21:56 [DEBUG   ] Finished updating board flags in 1.547 seconds
2016-04-21 13:21:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 13:22:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 13:22:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 13:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:22:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 13:22:56 [DEBUG   ] Finished updating board flags in 1.565 seconds
2016-04-21 13:22:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 13:23:11 [DEBUG   ] Got command RPT from MCS: ref #671080
2016-04-21 13:23:11 [DEBUG   ] summary = NORMAL
2016-04-21 13:23:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671080  14 57499 48191618 A NORMALNORMAL'
2016-04-21 13:23:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 13:23:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 13:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:23:57 [DEBUG   ] Finished updating board flags in 2.166 seconds
2016-04-21 13:23:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 13:24:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 13:24:29 [DEBUG   ] Got command RPT from MCS: ref #671081
2016-04-21 13:24:29 [DEBUG   ] summary = NORMAL
2016-04-21 13:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671081  14 57499 48269566 A NORMALNORMAL'
2016-04-21 13:24:29 [DEBUG   ] Got command RPT from MCS: ref #671082
2016-04-21 13:24:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 13:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671082  48 57499 48269566 A NORMALSystem calibrated and operating normally'
2016-04-21 13:24:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 13:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:24:57 [DEBUG   ] Finished updating board flags in 2.077 seconds
2016-04-21 13:24:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 13:25:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 13:25:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 13:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:25:57 [DEBUG   ] Finished updating board flags in 1.877 seconds
2016-04-21 13:25:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 13:26:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 13:26:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 13:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:26:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 13:26:57 [DEBUG   ] Finished updating board flags in 1.819 seconds
2016-04-21 13:26:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 13:27:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 13:27:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 13:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:27:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 13:27:58 [DEBUG   ] Finished updating board flags in 2.711 seconds
2016-04-21 13:28:11 [DEBUG   ] Got command RPT from MCS: ref #671102
2016-04-21 13:28:11 [DEBUG   ] summary = NORMAL
2016-04-21 13:28:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671102  14 57499 48491690 A NORMALNORMAL'
2016-04-21 13:28:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 13:28:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 13:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:28:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:28:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:28:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:28:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:28:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:28:57 [DEBUG   ] Finished updating board flags in 1.677 seconds
2016-04-21 13:28:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 13:29:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 13:29:29 [DEBUG   ] Got command RPT from MCS: ref #671111
2016-04-21 13:29:29 [DEBUG   ] summary = NORMAL
2016-04-21 13:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671111  14 57499 48569570 A NORMALNORMAL'
2016-04-21 13:29:29 [DEBUG   ] Got command RPT from MCS: ref #671112
2016-04-21 13:29:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 13:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671112  48 57499 48569570 A NORMALSystem calibrated and operating normally'
2016-04-21 13:29:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 13:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:29:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 13:29:57 [DEBUG   ] Finished updating board flags in 1.642 seconds
2016-04-21 13:29:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 13:30:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 13:30:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 13:30:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:30:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:30:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:30:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:30:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:30:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:30:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:30:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:30:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:30:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:30:57 [DEBUG   ] Finished updating board flags in 1.685 seconds
2016-04-21 13:30:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 13:31:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 13:31:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 13:31:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:31:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:31:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:31:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:31:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:31:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:31:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:31:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:31:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:31:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:31:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 13:31:57 [DEBUG   ] Finished updating board flags in 1.639 seconds
2016-04-21 13:31:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 13:32:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 13:32:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 13:32:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:32:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:32:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:32:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:32:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:32:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2016-04-21 13:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:32:57 [DEBUG   ] Finished updating board flags in 1.643 seconds
2016-04-21 13:32:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 13:33:11 [DEBUG   ] Got command RPT from MCS: ref #671131
2016-04-21 13:33:11 [DEBUG   ] summary = NORMAL
2016-04-21 13:33:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671131  14 57499 48791770 A NORMALNORMAL'
2016-04-21 13:33:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 13:33:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 13:33:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:33:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:33:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:33:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:33:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:33:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 13:33:57 [DEBUG   ] Finished updating board flags in 1.648 seconds
2016-04-21 13:33:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 13:34:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 13:34:29 [DEBUG   ] Got command RPT from MCS: ref #671135
2016-04-21 13:34:29 [DEBUG   ] summary = NORMAL
2016-04-21 13:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671135  14 57499 48869566 A NORMALNORMAL'
2016-04-21 13:34:29 [DEBUG   ] Got command RPT from MCS: ref #671136
2016-04-21 13:34:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 13:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671136  48 57499 48869566 A NORMALSystem calibrated and operating normally'
2016-04-21 13:34:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 13:34:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-21 13:34:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-21 13:34:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-21 13:34:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-21 13:34:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-21 13:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-21 13:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-21 13:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-21 13:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-21 13:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-21 13:34:57 [DEBUG   ] Finished updating board flags in 1.661 seconds
2016-04-21 13:34:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-21 13:35:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 13:35:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2016-04-21 13:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2016-04-21 13:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2016-04-21 13:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2016-04-21 13:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2016-04-21 13:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2016-04-21 13:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2016-04-21 13:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2016-04-21 13:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2016-04-21 13:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2016-04-21 13:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2016-04-21 13:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2016-04-21 13:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2016-04-21 13:35:58 [DEBUG   ] Finished updating board flags in 1.687 seconds
2016-04-21 13:35:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 13:36:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 13:36:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2016-04-21 13:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2016-04-21 13:36:58 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2016-04-21 13:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2016-04-21 13:36:58 [DEBUG   ] Finished updating board flags in 2.336 seconds
2016-04-21 13:37:18 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2016-04-21 13:37:38 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-21 13:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:37:58 [DEBUG   ] Finished updating ant stats in 0.444 seconds
2016-04-21 13:37:58 [DEBUG   ] Finished updating board flags in 2.100 seconds
2016-04-21 13:38:11 [DEBUG   ] Got command RPT from MCS: ref #671156
2016-04-21 13:38:11 [DEBUG   ] summary = NORMAL
2016-04-21 13:38:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671156  14 57499 49091862 A NORMALNORMAL'
2016-04-21 13:38:19 [DEBUG   ] Finished updating ant stats in 1.357 seconds
2016-04-21 13:38:39 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2016-04-21 13:38:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:38:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:38:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:38:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:38:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:38:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 13:38:58 [DEBUG   ] Finished updating board flags in 2.042 seconds
2016-04-21 13:38:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 13:39:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 13:39:29 [DEBUG   ] Got command RPT from MCS: ref #671162
2016-04-21 13:39:29 [DEBUG   ] summary = NORMAL
2016-04-21 13:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671162  14 57499 49169574 A NORMALNORMAL'
2016-04-21 13:39:29 [DEBUG   ] Got command RPT from MCS: ref #671163
2016-04-21 13:39:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 13:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671163  48 57499 49169574 A NORMALSystem calibrated and operating normally'
2016-04-21 13:39:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 13:39:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:39:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:39:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:39:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:39:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:39:58 [DEBUG   ] Finished updating board flags in 2.002 seconds
2016-04-21 13:39:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 13:40:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 13:40:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 13:40:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:40:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:40:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:40:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:40:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:40:58 [DEBUG   ] Finished updating board flags in 1.933 seconds
2016-04-21 13:40:59 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2016-04-21 13:41:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 13:41:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 13:41:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:41:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:41:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:41:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:41:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:41:58 [DEBUG   ] Finished updating board flags in 1.788 seconds
2016-04-21 13:41:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 13:42:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 13:42:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 13:42:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:42:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:42:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:42:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:42:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:42:58 [DEBUG   ] Finished updating board flags in 1.655 seconds
2016-04-21 13:42:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 13:43:11 [DEBUG   ] Got command RPT from MCS: ref #671182
2016-04-21 13:43:11 [DEBUG   ] summary = NORMAL
2016-04-21 13:43:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671182  14 57499 49391942 A NORMALNORMAL'
2016-04-21 13:43:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 13:43:39 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-21 13:43:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:43:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:43:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:43:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:43:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:43:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:43:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:43:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:43:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:43:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:43:58 [DEBUG   ] Finished updating board flags in 1.539 seconds
2016-04-21 13:44:00 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2016-04-21 13:44:20 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-21 13:44:29 [DEBUG   ] Got command RPT from MCS: ref #671186
2016-04-21 13:44:29 [DEBUG   ] summary = NORMAL
2016-04-21 13:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671186  14 57499 49469566 A NORMALNORMAL'
2016-04-21 13:44:29 [DEBUG   ] Got command RPT from MCS: ref #671187
2016-04-21 13:44:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 13:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671187  48 57499 49469566 A NORMALSystem calibrated and operating normally'
2016-04-21 13:44:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 13:44:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:44:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:44:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:44:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:44:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:44:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:44:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:44:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:44:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:44:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:44:58 [DEBUG   ] Finished updating board flags in 1.398 seconds
2016-04-21 13:45:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 13:45:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 13:45:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 13:45:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:45:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:45:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:45:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:45:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:45:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:45:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:45:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:45:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:45:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:45:58 [DEBUG   ] Finished updating board flags in 1.385 seconds
2016-04-21 13:46:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 13:46:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 13:46:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 13:46:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:46:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:46:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:46:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:46:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:47:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 13:47:00 [DEBUG   ] Finished updating board flags in 3.198 seconds
2016-04-21 13:47:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 13:47:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 13:47:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:47:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:47:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:47:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:47:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:47:59 [DEBUG   ] Finished updating board flags in 1.868 seconds
2016-04-21 13:48:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 13:48:12 [DEBUG   ] Got command RPT from MCS: ref #671207
2016-04-21 13:48:12 [DEBUG   ] summary = NORMAL
2016-04-21 13:48:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671207  14 57499 49692030 A NORMALNORMAL'
2016-04-21 13:48:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 13:48:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 13:48:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:48:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:48:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:48:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:48:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:48:59 [DEBUG   ] Finished updating board flags in 1.821 seconds
2016-04-21 13:49:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 13:49:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 13:49:29 [DEBUG   ] Got command RPT from MCS: ref #671216
2016-04-21 13:49:29 [DEBUG   ] summary = NORMAL
2016-04-21 13:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671216  14 57499 49769574 A NORMALNORMAL'
2016-04-21 13:49:29 [DEBUG   ] Got command RPT from MCS: ref #671217
2016-04-21 13:49:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 13:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671217  48 57499 49769574 A NORMALSystem calibrated and operating normally'
2016-04-21 13:49:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 13:49:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:49:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:49:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:49:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:49:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:49:59 [DEBUG   ] Finished updating board flags in 1.869 seconds
2016-04-21 13:50:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 13:50:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 13:50:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 13:50:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:50:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:50:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:50:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:50:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:50:59 [DEBUG   ] Finished updating board flags in 1.701 seconds
2016-04-21 13:51:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 13:51:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 13:51:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 13:51:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:51:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:51:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:51:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:51:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:51:59 [DEBUG   ] Finished updating board flags in 1.642 seconds
2016-04-21 13:52:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 13:52:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 13:52:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 13:52:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:52:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:52:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:52:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:52:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:52:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:52:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:52:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:52:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:52:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:52:59 [DEBUG   ] Finished updating board flags in 1.558 seconds
2016-04-21 13:53:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 13:53:12 [DEBUG   ] Got command RPT from MCS: ref #671236
2016-04-21 13:53:12 [DEBUG   ] summary = NORMAL
2016-04-21 13:53:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671236  14 57499 49992106 A NORMALNORMAL'
2016-04-21 13:53:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 13:53:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 13:53:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:53:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:53:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:53:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:53:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:53:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2016-04-21 13:53:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:53:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:53:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:53:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:53:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:53:59 [DEBUG   ] Finished updating board flags in 1.526 seconds
2016-04-21 13:54:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 13:54:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 13:54:29 [DEBUG   ] Got command RPT from MCS: ref #671237
2016-04-21 13:54:29 [DEBUG   ] summary = NORMAL
2016-04-21 13:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671237  14 57499 50069578 A NORMALNORMAL'
2016-04-21 13:54:29 [DEBUG   ] Got command RPT from MCS: ref #671238
2016-04-21 13:54:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 13:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671238  48 57499 50069578 A NORMALSystem calibrated and operating normally'
2016-04-21 13:54:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 13:54:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:54:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:54:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:54:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:54:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:54:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:54:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:54:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:54:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:54:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:55:00 [DEBUG   ] Finished updating board flags in 1.623 seconds
2016-04-21 13:55:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 13:55:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 13:55:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 13:55:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:55:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:55:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:55:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:55:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:56:00 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-21 13:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:56:01 [DEBUG   ] Finished updating board flags in 2.727 seconds
2016-04-21 13:56:20 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2016-04-21 13:56:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 13:56:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:56:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:56:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:56:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:56:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:57:00 [DEBUG   ] Finished updating ant stats in 1.045 seconds
2016-04-21 13:57:00 [DEBUG   ] Finished updating board flags in 2.149 seconds
2016-04-21 13:57:20 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2016-04-21 13:57:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 13:57:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:57:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:57:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:57:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:57:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:58:00 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2016-04-21 13:58:00 [DEBUG   ] Finished updating board flags in 2.013 seconds
2016-04-21 13:58:12 [DEBUG   ] Got command RPT from MCS: ref #671258
2016-04-21 13:58:12 [DEBUG   ] summary = NORMAL
2016-04-21 13:58:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671258  14 57499 50292178 A NORMALNORMAL'
2016-04-21 13:58:20 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2016-04-21 13:58:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 13:58:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:58:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:58:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:58:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:58:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 13:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 13:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 13:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 13:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 13:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 13:59:00 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2016-04-21 13:59:00 [DEBUG   ] Finished updating board flags in 2.015 seconds
2016-04-21 13:59:20 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2016-04-21 13:59:29 [DEBUG   ] Got command RPT from MCS: ref #671267
2016-04-21 13:59:29 [DEBUG   ] summary = NORMAL
2016-04-21 13:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671267  14 57499 50369570 A NORMALNORMAL'
2016-04-21 13:59:29 [DEBUG   ] Got command RPT from MCS: ref #671268
2016-04-21 13:59:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 13:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671268  48 57499 50369570 A NORMALSystem calibrated and operating normally'
2016-04-21 13:59:41 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2016-04-21 13:59:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 13:59:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 13:59:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 13:59:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 13:59:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:00:00 [DEBUG   ] Finished updating board flags in 1.970 seconds
2016-04-21 14:00:01 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-21 14:00:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 14:00:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 14:00:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:00:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:00:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:00:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:00:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:01:00 [DEBUG   ] Finished updating board flags in 1.824 seconds
2016-04-21 14:01:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 14:01:21 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2016-04-21 14:01:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 14:01:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:01:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:01:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:01:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:01:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:02:00 [DEBUG   ] Finished updating board flags in 1.773 seconds
2016-04-21 14:02:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 14:02:21 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2016-04-21 14:02:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 14:02:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:02:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:02:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:02:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:02:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:03:00 [DEBUG   ] Finished updating board flags in 1.613 seconds
2016-04-21 14:03:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 14:03:12 [DEBUG   ] Got command RPT from MCS: ref #671287
2016-04-21 14:03:12 [DEBUG   ] summary = NORMAL
2016-04-21 14:03:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671287  14 57499 50592266 A NORMALNORMAL'
2016-04-21 14:03:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 14:03:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 14:03:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:03:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:03:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:03:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:03:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:04:00 [DEBUG   ] Finished updating board flags in 1.664 seconds
2016-04-21 14:04:01 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-21 14:04:22 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2016-04-21 14:04:29 [DEBUG   ] Got command RPT from MCS: ref #671291
2016-04-21 14:04:29 [DEBUG   ] summary = NORMAL
2016-04-21 14:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671291  14 57499 50669574 A NORMALNORMAL'
2016-04-21 14:04:29 [DEBUG   ] Got command RPT from MCS: ref #671292
2016-04-21 14:04:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 14:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671292  48 57499 50669574 A NORMALSystem calibrated and operating normally'
2016-04-21 14:04:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 14:04:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:04:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:04:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:04:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:04:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:05:00 [DEBUG   ] Finished updating board flags in 1.504 seconds
2016-04-21 14:05:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 14:05:21 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-21 14:05:42 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2016-04-21 14:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:06:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:06:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:06:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:06:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:06:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:06:00 [DEBUG   ] Finished updating board flags in 1.393 seconds
2016-04-21 14:06:02 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-21 14:06:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 14:06:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 14:07:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:07:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:07:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:07:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:07:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:07:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 14:07:02 [DEBUG   ] Finished updating board flags in 3.375 seconds
2016-04-21 14:07:22 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2016-04-21 14:07:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 14:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:08:01 [DEBUG   ] Finished updating board flags in 2.074 seconds
2016-04-21 14:08:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 14:08:12 [DEBUG   ] Got command RPT from MCS: ref #671312
2016-04-21 14:08:12 [DEBUG   ] summary = NORMAL
2016-04-21 14:08:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671312  14 57499 50892346 A NORMALNORMAL'
2016-04-21 14:08:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 14:08:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 14:09:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:09:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:09:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:09:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:09:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:09:01 [DEBUG   ] Finished updating board flags in 2.059 seconds
2016-04-21 14:09:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 14:09:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 14:09:29 [DEBUG   ] Got command RPT from MCS: ref #671318
2016-04-21 14:09:29 [DEBUG   ] summary = NORMAL
2016-04-21 14:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671318  14 57499 50969578 A NORMALNORMAL'
2016-04-21 14:09:29 [DEBUG   ] Got command RPT from MCS: ref #671319
2016-04-21 14:09:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 14:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671319  48 57499 50969578 A NORMALSystem calibrated and operating normally'
2016-04-21 14:09:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 14:10:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:10:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:10:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:10:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:10:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:10:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 14:10:02 [DEBUG   ] Finished updating board flags in 2.895 seconds
2016-04-21 14:10:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 14:10:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 14:11:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:11:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:11:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:11:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:11:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:11:01 [DEBUG   ] Finished updating board flags in 1.869 seconds
2016-04-21 14:11:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 14:11:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 14:11:42 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2016-04-21 14:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:12:01 [DEBUG   ] Finished updating board flags in 1.818 seconds
2016-04-21 14:12:02 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2016-04-21 14:12:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 14:12:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 14:13:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:13:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:13:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:13:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:13:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:13:01 [DEBUG   ] Finished updating board flags in 1.721 seconds
2016-04-21 14:13:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 14:13:12 [DEBUG   ] Got command RPT from MCS: ref #671338
2016-04-21 14:13:12 [DEBUG   ] summary = NORMAL
2016-04-21 14:13:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671338  14 57499 51192426 A NORMALNORMAL'
2016-04-21 14:13:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:13:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 14:14:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:14:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:14:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:14:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:14:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:14:01 [DEBUG   ] Finished updating board flags in 1.633 seconds
2016-04-21 14:14:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 14:14:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 14:14:29 [DEBUG   ] Got command RPT from MCS: ref #671342
2016-04-21 14:14:29 [DEBUG   ] summary = NORMAL
2016-04-21 14:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671342  14 57499 51269578 A NORMALNORMAL'
2016-04-21 14:14:29 [DEBUG   ] Got command RPT from MCS: ref #671343
2016-04-21 14:14:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 14:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671343  48 57499 51269578 A NORMALSystem calibrated and operating normally'
2016-04-21 14:14:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:15:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:15:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:15:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:15:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:15:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:15:01 [DEBUG   ] Finished updating board flags in 1.638 seconds
2016-04-21 14:15:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 14:15:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 14:15:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:16:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:16:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:16:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:16:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:16:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:16:01 [DEBUG   ] Finished updating board flags in 1.557 seconds
2016-04-21 14:16:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 14:16:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-21 14:16:43 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-21 14:17:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:17:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:17:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:17:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:17:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:17:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:17:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:17:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:17:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:17:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:17:01 [DEBUG   ] Finished updating board flags in 1.509 seconds
2016-04-21 14:17:03 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-21 14:17:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 14:17:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 14:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:18:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:18:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:18:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:18:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:18:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:18:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 14:18:01 [DEBUG   ] Finished updating board flags in 1.499 seconds
2016-04-21 14:18:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 14:18:12 [DEBUG   ] Got command RPT from MCS: ref #671368
2016-04-21 14:18:12 [DEBUG   ] summary = NORMAL
2016-04-21 14:18:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671368  14 57499 51492518 A NORMALNORMAL'
2016-04-21 14:18:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 14:18:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 14:19:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:19:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:19:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:19:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:19:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:19:02 [DEBUG   ] Finished updating board flags in 2.234 seconds
2016-04-21 14:19:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 14:19:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 14:19:29 [DEBUG   ] Got command RPT from MCS: ref #671377
2016-04-21 14:19:29 [DEBUG   ] summary = NORMAL
2016-04-21 14:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671377  14 57499 51569578 A NORMALNORMAL'
2016-04-21 14:19:29 [DEBUG   ] Got command RPT from MCS: ref #671378
2016-04-21 14:19:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 14:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671378  48 57499 51569578 A NORMALSystem calibrated and operating normally'
2016-04-21 14:19:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 14:20:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:20:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:20:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:20:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:20:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:20:02 [DEBUG   ] Finished updating board flags in 2.244 seconds
2016-04-21 14:20:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 14:20:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 14:20:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 14:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:21:02 [DEBUG   ] Finished updating board flags in 2.140 seconds
2016-04-21 14:21:03 [DEBUG   ] Finished updating ant stats in 1.113 seconds
2016-04-21 14:21:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 14:21:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 14:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:22:02 [DEBUG   ] Finished updating board flags in 2.015 seconds
2016-04-21 14:22:03 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 14:22:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 14:22:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 14:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:23:02 [DEBUG   ] Finished updating board flags in 2.000 seconds
2016-04-21 14:23:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 14:23:12 [DEBUG   ] Got command RPT from MCS: ref #671397
2016-04-21 14:23:12 [DEBUG   ] summary = NORMAL
2016-04-21 14:23:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671397  14 57499 51792602 A NORMALNORMAL'
2016-04-21 14:23:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 14:23:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 14:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:24:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 14:24:02 [DEBUG   ] Finished updating board flags in 2.042 seconds
2016-04-21 14:24:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 14:24:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 14:24:29 [DEBUG   ] Got command RPT from MCS: ref #671398
2016-04-21 14:24:29 [DEBUG   ] summary = NORMAL
2016-04-21 14:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671398  14 57499 51869582 A NORMALNORMAL'
2016-04-21 14:24:29 [DEBUG   ] Got command RPT from MCS: ref #671399
2016-04-21 14:24:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 14:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671399  48 57499 51869582 A NORMALSystem calibrated and operating normally'
2016-04-21 14:24:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 14:25:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:25:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:25:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:25:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:25:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:25:02 [DEBUG   ] Finished updating board flags in 1.929 seconds
2016-04-21 14:25:03 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2016-04-21 14:25:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 14:25:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 14:26:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:26:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:26:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:26:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:26:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:26:02 [DEBUG   ] Finished updating board flags in 1.851 seconds
2016-04-21 14:26:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 14:26:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 14:26:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 14:27:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:27:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:27:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:27:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:27:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:27:02 [DEBUG   ] Finished updating board flags in 1.761 seconds
2016-04-21 14:27:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 14:27:23 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:27:43 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-21 14:28:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:28:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:28:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:28:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:28:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:28:02 [DEBUG   ] Finished updating board flags in 1.575 seconds
2016-04-21 14:28:04 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-21 14:28:12 [DEBUG   ] Got command RPT from MCS: ref #671419
2016-04-21 14:28:12 [DEBUG   ] summary = NORMAL
2016-04-21 14:28:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671419  14 57499 52092698 A NORMALNORMAL'
2016-04-21 14:28:24 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-21 14:28:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 14:29:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:29:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:29:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:29:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:29:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:29:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 14:29:02 [DEBUG   ] Finished updating board flags in 1.398 seconds
2016-04-21 14:29:04 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2016-04-21 14:29:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 14:29:29 [DEBUG   ] Got command RPT from MCS: ref #671428
2016-04-21 14:29:29 [DEBUG   ] summary = NORMAL
2016-04-21 14:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671428  14 57499 52169582 A NORMALNORMAL'
2016-04-21 14:29:29 [DEBUG   ] Got command RPT from MCS: ref #671429
2016-04-21 14:29:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 14:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671429  48 57499 52169582 A NORMALSystem calibrated and operating normally'
2016-04-21 14:29:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 14:30:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:30:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:30:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:30:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:30:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:30:02 [DEBUG   ] Finished updating board flags in 1.376 seconds
2016-04-21 14:30:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 14:30:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 14:30:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 14:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:31:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2016-04-21 14:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 14:31:03 [DEBUG   ] Finished updating board flags in 2.092 seconds
2016-04-21 14:31:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 14:31:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 14:31:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 14:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:32:03 [DEBUG   ] Finished updating board flags in 1.984 seconds
2016-04-21 14:32:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 14:32:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 14:32:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 14:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:33:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2016-04-21 14:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:33:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 14:33:03 [DEBUG   ] Finished updating board flags in 1.815 seconds
2016-04-21 14:33:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 14:33:12 [DEBUG   ] Got command RPT from MCS: ref #671448
2016-04-21 14:33:12 [DEBUG   ] summary = NORMAL
2016-04-21 14:33:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671448  14 57499 52392778 A NORMALNORMAL'
2016-04-21 14:33:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 14:33:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 14:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:34:03 [DEBUG   ] Finished updating board flags in 1.793 seconds
2016-04-21 14:34:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 14:34:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 14:34:29 [DEBUG   ] Got command RPT from MCS: ref #671452
2016-04-21 14:34:29 [DEBUG   ] summary = NORMAL
2016-04-21 14:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671452  14 57499 52469586 A NORMALNORMAL'
2016-04-21 14:34:29 [DEBUG   ] Got command RPT from MCS: ref #671453
2016-04-21 14:34:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 14:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671453  48 57499 52469586 A NORMALSystem calibrated and operating normally'
2016-04-21 14:34:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 14:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:35:03 [DEBUG   ] Finished updating board flags in 1.665 seconds
2016-04-21 14:35:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 14:35:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 14:35:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 14:36:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:36:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:36:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:36:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:36:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:36:03 [DEBUG   ] Finished updating board flags in 1.541 seconds
2016-04-21 14:36:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 14:36:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 14:36:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 14:37:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:37:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:37:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:37:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:37:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:37:03 [DEBUG   ] Finished updating board flags in 1.515 seconds
2016-04-21 14:37:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 14:37:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 14:37:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 14:38:00 [DEBUG   ] Got command INI from MCS: ref #671472
2016-04-21 14:38:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2016-04-21 14:38:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   671472   8 57499 52680102 ABOOTING'
2016-04-21 14:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2016-04-21 14:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2016-04-21 14:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2016-04-21 14:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2016-04-21 14:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2016-04-21 14:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2016-04-21 14:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-21 14:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-21 14:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-21 14:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-21 14:38:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 14:38:03 [DEBUG   ] Finished updating board flags in 1.569 seconds
2016-04-21 14:38:04 [DEBUG   ] Finished updating ant stats in 0.841 seconds
2016-04-21 14:38:12 [DEBUG   ] Got command RPT from MCS: ref #671479
2016-04-21 14:38:12 [DEBUG   ] summary = BOOTING
2016-04-21 14:38:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671479  15 57499 52692858 ABOOTINGBOOTING'
2016-04-21 14:38:24 [INFO    ] -------------------
2016-04-21 14:38:24 [INFO    ]  LWA board status
2016-04-21 14:38:24 [INFO    ] -------------------
2016-04-21 14:38:24 [INFO    ] DP 1: 2 lwa27
2016-04-21 14:38:24 [INFO    ] DP 1: 3 lwa24
2016-04-21 14:38:24 [INFO    ] DP 1: 4 lwa23
2016-04-21 14:38:24 [INFO    ] DP 1: 5 lwa18
2016-04-21 14:38:24 [INFO    ] DP 1: 6 lwa10
2016-04-21 14:38:24 [INFO    ] DP 1: 7 lwa32
2016-04-21 14:38:24 [INFO    ] DP 1: 8 lwa11
2016-04-21 14:38:24 [INFO    ] DP 1: 9 lwa30
2016-04-21 14:38:24 [INFO    ] DP 1: 10 lwa12
2016-04-21 14:38:24 [INFO    ] DP 1: 11 lwa8
2016-04-21 14:38:24 [INFO    ] DP 1: 12 lwa13
2016-04-21 14:38:24 [INFO    ] DP 1: 13 lwa26
2016-04-21 14:38:24 [INFO    ] DP 1: 14 lwa14
2016-04-21 14:38:24 [INFO    ] DP 1: 16 lwa22
2016-04-21 14:38:24 [INFO    ] DP 1: 17 lwa20
2016-04-21 14:38:24 [INFO    ] DP 1: 18 lwa1
2016-04-21 14:38:24 [INFO    ] DP 1: 19 lwa5
2016-04-21 14:38:24 [INFO    ] DP 1: 20 lwa25
2016-04-21 14:38:24 [INFO    ] DP 1: 21 lwa35
2016-04-21 14:38:24 [INFO    ] DP 1: 22 lwa19
2016-04-21 14:38:24 [INFO    ] DP 1: 23 lwa21
2016-04-21 14:38:24 [INFO    ] DP 1: 24 lwa6
2016-04-21 14:38:24 [INFO    ] DP 1: 25 lwa7
2016-04-21 14:38:24 [INFO    ] DP 1: 26 lwa33
2016-04-21 14:38:24 [INFO    ] DP 1: 27 lwa15
2016-04-21 14:38:24 [INFO    ] DP 1: 28 lwa28
2016-04-21 14:38:24 [INFO    ] DP 2: 1 lwa16
2016-04-21 14:38:24 [INFO    ] DP 2: 15 lwa34
2016-04-21 14:38:24 [INFO    ] Total of 28 boards
2016-04-21 14:38:24 [INFO    ] Total of 260 stands
2016-04-21 14:38:24 [INFO    ] -------------------
2016-04-21 14:38:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12581
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12582
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12583
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12584
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12585
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12586
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12587
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12588
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12589
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12590
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12591
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12592
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12593
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12594
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12595
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12596
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12597
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12598
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12599
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12600
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12601
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12602
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12603
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12604
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12605
2016-04-21 14:38:31 [DEBUG   ] 2016-04-21 14:38:31 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12606
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12581 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12582 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12583 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12584 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12585 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12586 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12587 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12588 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12589 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12590 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12591 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12592 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12593 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12594 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12595 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12596 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12597 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12598 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12599 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12600 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12601 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12602 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12603 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12604 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12605 exited with status 0
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12606 exited with status 0
2016-04-21 14:38:44 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] spawn_process: at 2016-04-21 14:38:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 12633
2016-04-21 14:38:44 [DEBUG   ] 2016-04-21 14:38:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 12634
2016-04-21 14:38:49 [DEBUG   ] 2016-04-21 14:38:49 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 12633 exited with status 0
2016-04-21 14:38:49 [DEBUG   ] 2016-04-21 14:38:49 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 12634 exited with status 0
2016-04-21 14:38:49 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2016-04-21 14:38:49 [DEBUG   ] spawn_process: at 2016-04-21 14:38:49 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2016-04-21 14:38:49 [DEBUG   ] spawn_process: at 2016-04-21 14:38:49 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2016-04-21 14:38:49 [INFO    ] Setting Beam 1 xbars
2016-04-21 14:38:49 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2016-04-21 14:38:49 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2016-04-21 14:38:50 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2016-04-21 14:38:50 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2016-04-21 14:38:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2016-04-21 14:38:50 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2016-04-21 14:38:50 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2016-04-21 14:38:50 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2016-04-21 14:38:50 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2016-04-21 14:38:50 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2016-04-21 14:38:50 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2016-04-21 14:38:50 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2016-04-21 14:38:51 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2016-04-21 14:38:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2016-04-21 14:38:51 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2016-04-21 14:38:51 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2016-04-21 14:38:51 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2016-04-21 14:38:51 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2016-04-21 14:38:51 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2016-04-21 14:38:51 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2016-04-21 14:38:51 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2016-04-21 14:38:52 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2016-04-21 14:38:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2016-04-21 14:38:52 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2016-04-21 14:38:52 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2016-04-21 14:38:52 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2016-04-21 14:38:52 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2016-04-21 14:38:52 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2016-04-21 14:38:52 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2016-04-21 14:38:52 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2016-04-21 14:38:53 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2016-04-21 14:38:53 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2016-04-21 14:38:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2016-04-21 14:38:53 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2016-04-21 14:38:53 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2016-04-21 14:38:53 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2016-04-21 14:38:53 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2016-04-21 14:38:53 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2016-04-21 14:38:53 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2016-04-21 14:38:54 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2016-04-21 14:38:54 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2016-04-21 14:38:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2016-04-21 14:38:54 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2016-04-21 14:38:54 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2016-04-21 14:38:54 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2016-04-21 14:38:54 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2016-04-21 14:38:54 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2016-04-21 14:38:54 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2016-04-21 14:38:54 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2016-04-21 14:38:55 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2016-04-21 14:38:55 [INFO    ] Setting Beam 2 xbars
2016-04-21 14:38:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2016-04-21 14:38:55 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2016-04-21 14:38:55 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2016-04-21 14:38:55 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2016-04-21 14:38:55 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2016-04-21 14:38:55 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2016-04-21 14:38:55 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2016-04-21 14:38:55 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2016-04-21 14:38:56 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2016-04-21 14:38:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2016-04-21 14:38:56 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2016-04-21 14:38:56 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2016-04-21 14:38:56 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2016-04-21 14:38:56 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2016-04-21 14:38:56 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2016-04-21 14:38:56 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2016-04-21 14:38:56 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2016-04-21 14:38:57 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2016-04-21 14:38:57 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2016-04-21 14:38:57 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2016-04-21 14:38:57 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2016-04-21 14:38:57 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2016-04-21 14:38:57 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2016-04-21 14:38:57 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2016-04-21 14:38:57 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2016-04-21 14:38:57 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2016-04-21 14:38:57 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2016-04-21 14:38:58 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2016-04-21 14:38:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2016-04-21 14:38:58 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2016-04-21 14:38:58 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2016-04-21 14:38:58 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2016-04-21 14:38:58 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2016-04-21 14:38:58 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2016-04-21 14:38:58 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2016-04-21 14:38:58 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2016-04-21 14:38:59 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2016-04-21 14:38:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2016-04-21 14:38:59 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2016-04-21 14:38:59 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2016-04-21 14:38:59 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2016-04-21 14:38:59 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2016-04-21 14:38:59 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2016-04-21 14:38:59 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2016-04-21 14:38:59 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2016-04-21 14:39:00 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2016-04-21 14:39:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2016-04-21 14:39:00 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2016-04-21 14:39:00 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2016-04-21 14:39:00 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2016-04-21 14:39:00 [INFO    ] Setting Beam 3 xbars
2016-04-21 14:39:00 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2016-04-21 14:39:00 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2016-04-21 14:39:00 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2016-04-21 14:39:00 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2016-04-21 14:39:01 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2016-04-21 14:39:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2016-04-21 14:39:01 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2016-04-21 14:39:01 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2016-04-21 14:39:01 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2016-04-21 14:39:01 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2016-04-21 14:39:01 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2016-04-21 14:39:01 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2016-04-21 14:39:01 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2016-04-21 14:39:02 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2016-04-21 14:39:02 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2016-04-21 14:39:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2016-04-21 14:39:02 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2016-04-21 14:39:02 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2016-04-21 14:39:02 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2016-04-21 14:39:02 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2016-04-21 14:39:02 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2016-04-21 14:39:02 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2016-04-21 14:39:03 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2016-04-21 14:39:03 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2016-04-21 14:39:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2016-04-21 14:39:03 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2016-04-21 14:39:03 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2016-04-21 14:39:03 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2016-04-21 14:39:03 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2016-04-21 14:39:03 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2016-04-21 14:39:03 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2016-04-21 14:39:04 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2016-04-21 14:39:04 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2016-04-21 14:39:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2016-04-21 14:39:04 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2016-04-21 14:39:04 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2016-04-21 14:39:04 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2016-04-21 14:39:04 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2016-04-21 14:39:04 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2016-04-21 14:39:04 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2016-04-21 14:39:05 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2016-04-21 14:39:05 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2016-04-21 14:39:05 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2016-04-21 14:39:05 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2016-04-21 14:39:05 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2016-04-21 14:39:05 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2016-04-21 14:39:05 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2016-04-21 14:39:05 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2016-04-21 14:39:05 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2016-04-21 14:39:06 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2016-04-21 14:39:06 [INFO    ] Setting Beam 4 xbars
2016-04-21 14:39:06 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2016-04-21 14:39:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2016-04-21 14:39:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2016-04-21 14:39:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2016-04-21 14:39:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2016-04-21 14:39:06 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2016-04-21 14:39:06 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2016-04-21 14:39:06 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2016-04-21 14:39:07 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2016-04-21 14:39:07 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2016-04-21 14:39:07 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2016-04-21 14:39:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2016-04-21 14:39:07 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2016-04-21 14:39:07 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2016-04-21 14:39:07 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2016-04-21 14:39:07 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2016-04-21 14:39:07 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2016-04-21 14:39:07 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2016-04-21 14:39:08 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2016-04-21 14:39:08 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2016-04-21 14:39:08 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2016-04-21 14:39:08 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2016-04-21 14:39:08 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2016-04-21 14:39:08 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2016-04-21 14:39:08 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2016-04-21 14:39:08 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2016-04-21 14:39:08 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2016-04-21 14:39:09 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2016-04-21 14:39:09 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2016-04-21 14:39:09 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2016-04-21 14:39:09 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2016-04-21 14:39:09 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2016-04-21 14:39:09 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2016-04-21 14:39:09 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2016-04-21 14:39:09 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2016-04-21 14:39:09 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2016-04-21 14:39:10 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2016-04-21 14:39:10 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2016-04-21 14:39:10 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2016-04-21 14:39:10 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2016-04-21 14:39:10 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2016-04-21 14:39:10 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2016-04-21 14:39:10 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2016-04-21 14:39:10 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2016-04-21 14:39:10 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2016-04-21 14:39:11 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2016-04-21 14:39:11 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2016-04-21 14:39:11 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2016-04-21 14:39:11 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2016-04-21 14:39:11 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2016-04-21 14:39:11 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2016-04-21 14:39:11 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2016-04-21 14:39:11 [INFO    ] All xbars set
2016-04-21 14:39:11 [INFO    ] Setting adder chain routing for all beams
2016-04-21 14:39:16 [INFO    ] Setting beam ids
2016-04-21 14:39:26 [INFO    ] Starting beam delay calibration
2016-04-21 14:39:29 [DEBUG   ] Got command RPT from MCS: ref #671485
2016-04-21 14:39:29 [DEBUG   ] summary = BOOTING
2016-04-21 14:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671485  15 57499 52769579 ABOOTINGBOOTING'
2016-04-21 14:39:29 [DEBUG   ] Got command RPT from MCS: ref #671486
2016-04-21 14:39:29 [DEBUG   ] info = Starting calibration
2016-04-21 14:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671486  28 57499 52769579 ABOOTINGStarting calibration'
2016-04-21 14:39:38 [INFO    ] Beam 1 latency is 5725
2016-04-21 14:39:38 [INFO    ] Beam 2 latency is 5754
2016-04-21 14:39:38 [INFO    ] Beam 3 latency is 5750
2016-04-21 14:39:38 [INFO    ] Beam 4 latency is 5728
2016-04-21 14:39:38 [INFO    ] Stop calibration
2016-04-21 14:39:46 [INFO    ] Beam delay calibration successful
2016-04-21 14:39:46 [INFO    ] Calibration passed
2016-04-21 14:39:46 [DEBUG   ] spawn_process: at 2016-04-21 14:39:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2016-04-21 14:39:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2016-04-21 14:39:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2016-04-21 14:39:46 [DEBUG   ] spawn_process: at 2016-04-21 14:39:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2016-04-21 14:39:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2016-04-21 14:39:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2016-04-21 14:39:46 [DEBUG   ] spawn_process: at 2016-04-21 14:39:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2016-04-21 14:39:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2016-04-21 14:39:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2016-04-21 14:39:46 [DEBUG   ] spawn_process: at 2016-04-21 14:39:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2016-04-21 14:39:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2016-04-21 14:39:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2016-04-21 14:39:46 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2016-04-21 14:39:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 291 ms (1461249587.292 s) with PID 14217 and time 1461249588
2016-04-21 14:39:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2016-04-21 14:39:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 378 ms (1461249587.380 s) with PID 14220 and time 1461249588
2016-04-21 14:39:48 [DEBUG   ] Finished updating ant stats in 0.866 seconds
2016-04-21 14:39:48 [INFO    ] Started antennas statistics background thread
2016-04-21 14:39:48 [INFO    ] Started board flags background thread
2016-04-21 14:39:48 [INFO    ] Started BAM background thread
2016-04-21 14:39:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2016-04-21 14:39:48 [INFO    ] Finished the INI process (ref. #671472) in 108.401 s
2016-04-21 14:39:49 [DEBUG   ] Finished updating board flags in 1.062 seconds
2016-04-21 14:40:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 14:40:28 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2016-04-21 14:40:30 [DEBUG   ] Got command RPT from MCS: ref #671505
2016-04-21 14:40:30 [DEBUG   ] summary = NORMAL
2016-04-21 14:40:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671505  14 57499 52830098 A NORMALNORMAL'
2016-04-21 14:40:30 [DEBUG   ] Got command RPT from MCS: ref #671506
2016-04-21 14:40:30 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 14:40:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671506  48 57499 52830098 A NORMALSystem calibrated and operating normally'
2016-04-21 14:40:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:40:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 14:40:49 [DEBUG   ] Finished updating board flags in 0.996 seconds
2016-04-21 14:41:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:41:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:41:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:41:49 [DEBUG   ] Finished updating board flags in 1.289 seconds
2016-04-21 14:42:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 14:42:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 14:42:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 14:42:49 [DEBUG   ] Finished updating board flags in 1.144 seconds
2016-04-21 14:43:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:43:12 [DEBUG   ] Got command RPT from MCS: ref #671507
2016-04-21 14:43:12 [DEBUG   ] summary = NORMAL
2016-04-21 14:43:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671507  14 57499 52992942 A NORMALNORMAL'
2016-04-21 14:43:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:43:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:43:49 [DEBUG   ] Finished updating board flags in 1.057 seconds
2016-04-21 14:44:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:44:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:44:29 [DEBUG   ] Got command RPT from MCS: ref #671511
2016-04-21 14:44:29 [DEBUG   ] summary = NORMAL
2016-04-21 14:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671511  14 57499 53069582 A NORMALNORMAL'
2016-04-21 14:44:29 [DEBUG   ] Got command RPT from MCS: ref #671512
2016-04-21 14:44:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 14:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671512  48 57499 53069582 A NORMALSystem calibrated and operating normally'
2016-04-21 14:44:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:44:50 [DEBUG   ] Finished updating board flags in 1.557 seconds
2016-04-21 14:45:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:45:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:45:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:45:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 14:45:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 14:45:50 [DEBUG   ] Finished updating board flags in 1.343 seconds
2016-04-21 14:46:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:46:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:46:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:46:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 14:46:50 [DEBUG   ] Finished updating board flags in 1.259 seconds
2016-04-21 14:47:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 14:47:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:47:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:47:50 [DEBUG   ] Finished updating board flags in 1.144 seconds
2016-04-21 14:48:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:48:13 [DEBUG   ] Got command RPT from MCS: ref #671532
2016-04-21 14:48:13 [DEBUG   ] summary = NORMAL
2016-04-21 14:48:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671532  14 57499 53293022 A NORMALNORMAL'
2016-04-21 14:48:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:48:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 14:48:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 14:48:50 [DEBUG   ] Finished updating board flags in 1.014 seconds
2016-04-21 14:49:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:49:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 14:49:29 [DEBUG   ] Got command RPT from MCS: ref #671541
2016-04-21 14:49:29 [DEBUG   ] summary = NORMAL
2016-04-21 14:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671541  14 57499 53369582 A NORMALNORMAL'
2016-04-21 14:49:29 [DEBUG   ] Got command RPT from MCS: ref #671542
2016-04-21 14:49:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 14:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671542  48 57499 53369582 A NORMALSystem calibrated and operating normally'
2016-04-21 14:49:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 14:49:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 14:49:50 [DEBUG   ] Finished updating board flags in 1.037 seconds
2016-04-21 14:50:08 [DEBUG   ] Finished updating ant stats in 0.592 seconds
2016-04-21 14:50:28 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 14:50:48 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 14:50:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 14:50:51 [DEBUG   ] Finished updating board flags in 2.003 seconds
2016-04-21 14:51:08 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2016-04-21 14:51:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 14:51:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 14:51:50 [DEBUG   ] Got command DRX from MCS: ref #671567
2016-04-21 14:51:50 [INFO    ] sending drx command to lwa34
2016-04-21 14:51:50 [DEBUG   ] run_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa34', '/lwa/software/drx 5 1 58000000.0 7 13 96']
2016-04-21 14:51:50 [DEBUG   ] drx = exited with status True, code 0x00
2016-04-21 14:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   671567   8 57499 53510006 A NORMAL'
2016-04-21 14:51:50 [DEBUG   ] Got command DRX from MCS: ref #671568
2016-04-21 14:51:50 [INFO    ] sending drx command to lwa16
2016-04-21 14:51:50 [DEBUG   ] run_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 58000000.0 7 13 96']
2016-04-21 14:51:50 [DEBUG   ] drx = exited with status True, code 0x00
2016-04-21 14:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   671568   8 57499 53510010 A NORMAL'
2016-04-21 14:51:50 [DEBUG   ] Got command DRX from MCS: ref #671569
2016-04-21 14:51:50 [INFO    ] sending drx command to lwa16
2016-04-21 14:51:50 [DEBUG   ] run_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 58000000.0 7 13 96']
2016-04-21 14:51:50 [DEBUG   ] drx = exited with status True, code 0x00
2016-04-21 14:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   671569   8 57499 53510014 A NORMAL'
2016-04-21 14:51:50 [DEBUG   ] Got command DRX from MCS: ref #671566
2016-04-21 14:51:50 [INFO    ] sending drx command to lwa34
2016-04-21 14:51:50 [DEBUG   ] run_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 58000000.0 7 13 96']
2016-04-21 14:51:50 [DEBUG   ] drx = exited with status True, code 0x00
2016-04-21 14:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   671566   8 57499 53510018 A NORMAL'
2016-04-21 14:51:50 [INFO    ] Finished starting DRX
2016-04-21 14:51:50 [INFO    ] Finished starting DRX
2016-04-21 14:51:50 [INFO    ] Finished starting DRX
2016-04-21 14:51:50 [INFO    ] Finished starting DRX
2016-04-21 14:51:50 [DEBUG   ] Got command DRX from MCS: ref #671571
2016-04-21 14:51:50 [INFO    ] sending drx command to lwa34
2016-04-21 14:51:50 [DEBUG   ] run_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa34', '/lwa/software/drx 5 2 74000000.0 7 13 96']
2016-04-21 14:51:50 [DEBUG   ] drx = exited with status True, code 0x00
2016-04-21 14:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   671571   8 57499 53510178 A NORMAL'
2016-04-21 14:51:50 [INFO    ] Finished starting DRX
2016-04-21 14:51:50 [DEBUG   ] Got command DRX from MCS: ref #671572
2016-04-21 14:51:50 [INFO    ] sending drx command to lwa16
2016-04-21 14:51:50 [DEBUG   ] run_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 74000000.0 7 13 96']
2016-04-21 14:51:50 [DEBUG   ] drx = exited with status True, code 0x00
2016-04-21 14:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   671572   8 57499 53510278 A NORMAL'
2016-04-21 14:51:50 [INFO    ] Finished starting DRX
2016-04-21 14:51:50 [DEBUG   ] Got command DRX from MCS: ref #671573
2016-04-21 14:51:50 [INFO    ] sending drx command to lwa16
2016-04-21 14:51:50 [DEBUG   ] run_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 74000000.0 7 13 96']
2016-04-21 14:51:50 [DEBUG   ] drx = exited with status True, code 0x00
2016-04-21 14:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   671573   8 57499 53510426 A NORMAL'
2016-04-21 14:51:50 [INFO    ] Finished starting DRX
2016-04-21 14:51:50 [DEBUG   ] Got command DRX from MCS: ref #671570
2016-04-21 14:51:50 [INFO    ] sending drx command to lwa34
2016-04-21 14:51:50 [DEBUG   ] run_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 74000000.0 7 13 96']
2016-04-21 14:51:50 [DEBUG   ] drx = exited with status True, code 0x00
2016-04-21 14:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   671570   8 57499 53510550 A NORMAL'
2016-04-21 14:51:50 [INFO    ] Finished starting DRX
2016-04-21 14:51:50 [DEBUG   ] Got command BAM from MCS: ref #671575
2016-04-21 14:51:50 [INFO    ] Finished processing BAM request
2016-04-21 14:51:50 [DEBUG   ] bam = exited with status True, code 0x00
2016-04-21 14:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671575   8 57499 53510686 A NORMAL'
2016-04-21 14:51:50 [DEBUG   ] Got command BAM from MCS: ref #671576
2016-04-21 14:51:50 [INFO    ] Finished processing BAM request
2016-04-21 14:51:50 [DEBUG   ] bam = exited with status True, code 0x00
2016-04-21 14:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671576   8 57499 53510802 A NORMAL'
2016-04-21 14:51:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 14:51:50 [DEBUG   ] Finished updating board flags in 1.402 seconds
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2016-04-21 14:51:50 [DEBUG   ] Got command BAM from MCS: ref #671577
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2016-04-21 14:51:50 [INFO    ] Finished processing BAM request
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2016-04-21 14:51:50 [DEBUG   ] bam = exited with status True, code 0x00
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2016-04-21 14:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671577   8 57499 53510922 A NORMAL'
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2016-04-21 14:51:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2016-04-21 14:51:50 [DEBUG   ] spawn_process: at 2016-04-21 14:51:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2016-04-21 14:51:51 [DEBUG   ] Got command BAM from MCS: ref #671574
2016-04-21 14:51:51 [INFO    ] Finished processing BAM request
2016-04-21 14:51:51 [DEBUG   ] bam = exited with status True, code 0x00
2016-04-21 14:51:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   671574   8 57499 53511026 A NORMAL'
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2016-04-21 14:51:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2016-04-21 14:51:51 [DEBUG   ] spawn_process: at 2016-04-21 14:51:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2016-04-21 14:52:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 14:52:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 14:52:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 14:52:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-21 14:52:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 14:52:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 14:52:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 14:52:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2016-04-21 14:52:50 [DEBUG   ] Finished updating board flags in 1.415 seconds
2016-04-21 14:53:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 14:53:13 [DEBUG   ] Got command RPT from MCS: ref #671585
2016-04-21 14:53:13 [DEBUG   ] summary = NORMAL
2016-04-21 14:53:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671585  14 57499 53593129 A NORMALNORMAL'
2016-04-21 14:53:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 14:53:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 14:53:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2016-04-21 14:53:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 3
2016-04-21 14:53:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2016-04-21 14:53:50 [DEBUG   ] Finished updating board flags in 1.440 seconds
2016-04-21 14:54:09 [DEBUG   ] Finished updating ant stats in 1.192 seconds
2016-04-21 14:54:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 14:54:29 [DEBUG   ] Got command RPT from MCS: ref #671586
2016-04-21 14:54:29 [DEBUG   ] summary = NORMAL
2016-04-21 14:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671586  14 57499 53669590 A NORMALNORMAL'
2016-04-21 14:54:29 [DEBUG   ] Got command RPT from MCS: ref #671587
2016-04-21 14:54:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 14:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671587  48 57499 53669590 A NORMALSystem calibrated and operating normally'
2016-04-21 14:54:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 14:54:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2016-04-21 14:54:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-21 14:54:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2016-04-21 14:54:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 14:54:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 14:54:50 [DEBUG   ] Finished updating board flags in 1.355 seconds
2016-04-21 14:55:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 14:55:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 14:55:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 14:55:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2016-04-21 14:55:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 14:55:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 14:55:50 [DEBUG   ] Finished updating board flags in 1.240 seconds
2016-04-21 14:56:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 14:56:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 14:56:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 14:56:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-21 14:56:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2016-04-21 14:56:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 14:56:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 14:56:50 [DEBUG   ] Finished updating board flags in 1.172 seconds
2016-04-21 14:57:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 14:57:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 14:57:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 14:57:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 3
2016-04-21 14:57:50 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 14:57:50 [DEBUG   ] Finished updating board flags in 1.032 seconds
2016-04-21 14:58:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 14:58:13 [DEBUG   ] Got command RPT from MCS: ref #671607
2016-04-21 14:58:13 [DEBUG   ] summary = NORMAL
2016-04-21 14:58:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671607  14 57499 53893206 A NORMALNORMAL'
2016-04-21 14:58:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 14:58:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 14:58:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2016-04-21 14:58:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-21 14:58:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 14:58:51 [DEBUG   ] Finished updating board flags in 1.579 seconds
2016-04-21 14:59:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 14:59:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 14:59:29 [DEBUG   ] Got command RPT from MCS: ref #671616
2016-04-21 14:59:29 [DEBUG   ] summary = NORMAL
2016-04-21 14:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671616  14 57499 53969586 A NORMALNORMAL'
2016-04-21 14:59:29 [DEBUG   ] Got command RPT from MCS: ref #671617
2016-04-21 14:59:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 14:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671617  48 57499 53969586 A NORMALSystem calibrated and operating normally'
2016-04-21 14:59:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 14:59:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2016-04-21 14:59:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2016-04-21 14:59:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-21 14:59:51 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 14:59:51 [DEBUG   ] Finished updating board flags in 1.485 seconds
2016-04-21 15:00:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:00:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 15:00:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 15:00:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 2
2016-04-21 15:00:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-21 15:00:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2016-04-21 15:00:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2016-04-21 15:00:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:00:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2016-04-21 15:00:51 [DEBUG   ] Finished updating board flags in 1.266 seconds
2016-04-21 15:01:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:01:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:01:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:01:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2016-04-21 15:01:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2016-04-21 15:01:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-21 15:01:51 [DEBUG   ] Finished updating board flags in 1.242 seconds
2016-04-21 15:02:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:02:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:02:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:02:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2016-04-21 15:02:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-21 15:02:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2016-04-21 15:02:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2016-04-21 15:02:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2016-04-21 15:02:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2016-04-21 15:02:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-21 15:02:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:02:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:02:51 [DEBUG   ] Finished updating board flags in 1.167 seconds
2016-04-21 15:03:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:03:13 [DEBUG   ] Got command RPT from MCS: ref #671636
2016-04-21 15:03:13 [DEBUG   ] summary = NORMAL
2016-04-21 15:03:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671636  14 57499 54193294 A NORMALNORMAL'
2016-04-21 15:03:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:03:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:03:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-21 15:03:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2016-04-21 15:03:51 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 15:03:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-21 15:03:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:03:51 [DEBUG   ] Finished updating board flags in 1.015 seconds
2016-04-21 15:04:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:04:29 [DEBUG   ] Finished updating ant stats in 0.789 seconds
2016-04-21 15:04:29 [DEBUG   ] Got command RPT from MCS: ref #671640
2016-04-21 15:04:29 [DEBUG   ] summary = NORMAL
2016-04-21 15:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671640  14 57499 54269586 A NORMALNORMAL'
2016-04-21 15:04:29 [DEBUG   ] Got command RPT from MCS: ref #671641
2016-04-21 15:04:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 15:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671641  48 57499 54269586 A NORMALSystem calibrated and operating normally'
2016-04-21 15:04:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:04:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-21 15:04:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:04:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2016-04-21 15:04:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:04:51 [DEBUG   ] Finished updating board flags in 1.017 seconds
2016-04-21 15:05:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:05:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:05:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:05:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-21 15:05:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2016-04-21 15:05:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2016-04-21 15:05:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-21 15:05:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:05:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2016-04-21 15:05:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2016-04-21 15:05:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:05:52 [DEBUG   ] Finished updating board flags in 2.032 seconds
2016-04-21 15:06:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:06:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:06:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:06:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2016-04-21 15:06:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 15:06:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-21 15:06:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:06:51 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2016-04-21 15:06:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:06:51 [DEBUG   ] Finished updating board flags in 1.383 seconds
2016-04-21 15:07:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:07:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:07:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:07:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-21 15:07:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2016-04-21 15:07:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 15:07:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-21 15:07:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:07:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2016-04-21 15:07:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2016-04-21 15:07:52 [DEBUG   ] Finished updating board flags in 1.784 seconds
2016-04-21 15:08:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:08:13 [DEBUG   ] Got command RPT from MCS: ref #671661
2016-04-21 15:08:13 [DEBUG   ] summary = NORMAL
2016-04-21 15:08:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671661  14 57499 54493378 A NORMALNORMAL'
2016-04-21 15:08:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:08:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:08:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-21 15:08:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2016-04-21 15:08:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2016-04-21 15:08:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:08:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:08:51 [DEBUG   ] Finished updating board flags in 1.022 seconds
2016-04-21 15:09:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:09:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:09:29 [DEBUG   ] Got command RPT from MCS: ref #671667
2016-04-21 15:09:29 [DEBUG   ] summary = NORMAL
2016-04-21 15:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671667  14 57499 54569590 A NORMALNORMAL'
2016-04-21 15:09:29 [DEBUG   ] Got command RPT from MCS: ref #671668
2016-04-21 15:09:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 15:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671668  48 57499 54569590 A NORMALSystem calibrated and operating normally'
2016-04-21 15:09:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:09:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:09:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:09:52 [DEBUG   ] Finished updating board flags in 1.565 seconds
2016-04-21 15:10:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:10:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:10:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 15:10:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2016-04-21 15:10:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 15:10:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2016-04-21 15:10:52 [DEBUG   ] Finished updating board flags in 1.449 seconds
2016-04-21 15:11:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:11:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:11:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:11:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2016-04-21 15:11:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa34, chip 1
2016-04-21 15:11:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 5
2016-04-21 15:11:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2016-04-21 15:11:52 [DEBUG   ] Finished updating board flags in 1.353 seconds
2016-04-21 15:12:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:12:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:12:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:12:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2016-04-21 15:12:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-21 15:12:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:12:52 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:12:52 [DEBUG   ] Finished updating board flags in 1.238 seconds
2016-04-21 15:13:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:13:13 [DEBUG   ] Got command RPT from MCS: ref #671687
2016-04-21 15:13:13 [DEBUG   ] summary = NORMAL
2016-04-21 15:13:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671687  14 57499 54793458 A NORMALNORMAL'
2016-04-21 15:13:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:13:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:13:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2016-04-21 15:13:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2016-04-21 15:13:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:13:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:13:52 [DEBUG   ] Finished updating board flags in 1.152 seconds
2016-04-21 15:14:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 15:14:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:14:29 [DEBUG   ] Got command RPT from MCS: ref #671691
2016-04-21 15:14:29 [DEBUG   ] summary = NORMAL
2016-04-21 15:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671691  14 57499 54869594 A NORMALNORMAL'
2016-04-21 15:14:29 [DEBUG   ] Got command RPT from MCS: ref #671692
2016-04-21 15:14:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 15:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671692  48 57499 54869594 A NORMALSystem calibrated and operating normally'
2016-04-21 15:14:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:14:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-21 15:14:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2016-04-21 15:14:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:14:52 [DEBUG   ] Finished updating board flags in 1.021 seconds
2016-04-21 15:15:09 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 15:15:29 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 15:15:49 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 15:15:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-21 15:15:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2016-04-21 15:15:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2016-04-21 15:15:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 15:15:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2016-04-21 15:15:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2016-04-21 15:15:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:15:52 [DEBUG   ] Finished updating board flags in 1.010 seconds
2016-04-21 15:16:10 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 15:16:30 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2016-04-21 15:16:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:16:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2016-04-21 15:16:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 15:16:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 15:16:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:16:53 [DEBUG   ] Finished updating board flags in 1.989 seconds
2016-04-21 15:17:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:17:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:17:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:17:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-21 15:17:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-21 15:17:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2016-04-21 15:17:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2016-04-21 15:17:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2016-04-21 15:17:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-21 15:17:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:17:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:17:52 [DEBUG   ] Finished updating board flags in 1.230 seconds
2016-04-21 15:18:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:18:13 [DEBUG   ] Got command RPT from MCS: ref #671712
2016-04-21 15:18:13 [DEBUG   ] summary = NORMAL
2016-04-21 15:18:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671712  14 57499 55093550 A NORMALNORMAL'
2016-04-21 15:18:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:18:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:18:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-21 15:18:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2016-04-21 15:18:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-21 15:18:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 5
2016-04-21 15:18:52 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:18:52 [DEBUG   ] Finished updating board flags in 1.258 seconds
2016-04-21 15:19:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 15:19:29 [DEBUG   ] Got command RPT from MCS: ref #671721
2016-04-21 15:19:29 [DEBUG   ] summary = NORMAL
2016-04-21 15:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671721  14 57499 55169594 A NORMALNORMAL'
2016-04-21 15:19:29 [DEBUG   ] Got command RPT from MCS: ref #671722
2016-04-21 15:19:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 15:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671722  48 57499 55169594 A NORMALSystem calibrated and operating normally'
2016-04-21 15:19:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:19:50 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 15:19:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-21 15:19:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2016-04-21 15:19:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:19:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2016-04-21 15:19:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:19:52 [DEBUG   ] Finished updating board flags in 1.138 seconds
2016-04-21 15:20:10 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-21 15:20:30 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 15:20:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 15:20:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2016-04-21 15:20:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-21 15:20:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-21 15:20:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:20:52 [DEBUG   ] Finished updating board flags in 1.034 seconds
2016-04-21 15:21:11 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 15:21:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 15:21:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 15:21:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-21 15:21:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-21 15:21:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2016-04-21 15:21:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 15:21:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:21:52 [DEBUG   ] Finished updating board flags in 0.998 seconds
2016-04-21 15:22:11 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 15:22:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 15:22:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 15:22:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-21 15:22:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-21 15:22:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2016-04-21 15:22:53 [DEBUG   ] Finished updating board flags in 1.372 seconds
2016-04-21 15:23:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:23:13 [DEBUG   ] Got command RPT from MCS: ref #671741
2016-04-21 15:23:13 [DEBUG   ] summary = NORMAL
2016-04-21 15:23:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671741  14 57499 55393634 A NORMALNORMAL'
2016-04-21 15:23:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:23:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:23:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2016-04-21 15:23:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 15:23:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 15:23:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-21 15:23:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:23:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-21 15:23:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:23:53 [DEBUG   ] Finished updating board flags in 1.174 seconds
2016-04-21 15:24:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:24:29 [DEBUG   ] Got command RPT from MCS: ref #671742
2016-04-21 15:24:29 [DEBUG   ] summary = NORMAL
2016-04-21 15:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671742  14 57499 55469594 A NORMALNORMAL'
2016-04-21 15:24:29 [DEBUG   ] Got command RPT from MCS: ref #671743
2016-04-21 15:24:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 15:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671743  48 57499 55469594 A NORMALSystem calibrated and operating normally'
2016-04-21 15:24:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 15:24:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:24:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-21 15:24:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 5
2016-04-21 15:24:53 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:24:53 [DEBUG   ] Finished updating board flags in 1.021 seconds
2016-04-21 15:25:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:25:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:25:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:25:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2016-04-21 15:25:54 [DEBUG   ] Finished updating board flags in 2.003 seconds
2016-04-21 15:26:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 15:26:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:26:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:26:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2016-04-21 15:26:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2016-04-21 15:26:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2016-04-21 15:26:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:26:53 [DEBUG   ] Finished updating board flags in 0.994 seconds
2016-04-21 15:27:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:27:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 15:27:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:27:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2016-04-21 15:27:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-21 15:27:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2016-04-21 15:27:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-21 15:27:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2016-04-21 15:27:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:27:53 [DEBUG   ] Finished updating board flags in 1.295 seconds
2016-04-21 15:28:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 15:28:13 [DEBUG   ] Got command RPT from MCS: ref #671763
2016-04-21 15:28:13 [DEBUG   ] summary = NORMAL
2016-04-21 15:28:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671763  14 57499 55693722 A NORMALNORMAL'
2016-04-21 15:28:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:28:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:28:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2016-04-21 15:28:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:28:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2016-04-21 15:28:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:28:53 [DEBUG   ] Finished updating board flags in 1.148 seconds
2016-04-21 15:29:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:29:29 [DEBUG   ] Got command RPT from MCS: ref #671772
2016-04-21 15:29:29 [DEBUG   ] summary = NORMAL
2016-04-21 15:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671772  14 57499 55769594 A NORMALNORMAL'
2016-04-21 15:29:29 [DEBUG   ] Got command RPT from MCS: ref #671773
2016-04-21 15:29:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 15:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671773  48 57499 55769594 A NORMALSystem calibrated and operating normally'
2016-04-21 15:29:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:29:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:29:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 1
2016-04-21 15:29:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2016-04-21 15:29:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2016-04-21 15:29:53 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:29:53 [DEBUG   ] Finished updating board flags in 1.036 seconds
2016-04-21 15:30:11 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2016-04-21 15:30:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:30:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 15:30:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-21 15:30:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 1
2016-04-21 15:30:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2016-04-21 15:30:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2016-04-21 15:30:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2016-04-21 15:30:53 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2016-04-21 15:30:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2016-04-21 15:30:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:30:53 [DEBUG   ] Finished updating board flags in 1.012 seconds
2016-04-21 15:31:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:31:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:31:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 15:31:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2016-04-21 15:31:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-21 15:31:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2016-04-21 15:31:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 15:31:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 15:31:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2016-04-21 15:31:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 4
2016-04-21 15:31:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:31:54 [DEBUG   ] Finished updating board flags in 1.538 seconds
2016-04-21 15:32:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:32:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:32:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:32:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-21 15:32:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2016-04-21 15:32:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:32:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2016-04-21 15:32:54 [DEBUG   ] Finished updating board flags in 1.436 seconds
2016-04-21 15:33:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:33:13 [DEBUG   ] Got command RPT from MCS: ref #671792
2016-04-21 15:33:13 [DEBUG   ] summary = NORMAL
2016-04-21 15:33:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671792  14 57499 55993810 A NORMALNORMAL'
2016-04-21 15:33:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:33:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:33:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-21 15:33:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-21 15:33:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2016-04-21 15:33:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:33:54 [DEBUG   ] Finished updating board flags in 1.338 seconds
2016-04-21 15:34:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:34:29 [DEBUG   ] Got command RPT from MCS: ref #671796
2016-04-21 15:34:29 [DEBUG   ] summary = NORMAL
2016-04-21 15:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671796  14 57499 56069598 A NORMALNORMAL'
2016-04-21 15:34:29 [DEBUG   ] Got command RPT from MCS: ref #671797
2016-04-21 15:34:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 15:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671797  48 57499 56069598 A NORMALSystem calibrated and operating normally'
2016-04-21 15:34:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 15:34:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:34:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-21 15:34:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2016-04-21 15:34:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:34:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2016-04-21 15:34:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:34:54 [DEBUG   ] Finished updating board flags in 1.225 seconds
2016-04-21 15:35:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:35:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 15:35:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:35:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-21 15:35:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:35:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:35:54 [DEBUG   ] Finished updating board flags in 1.210 seconds
2016-04-21 15:36:11 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2016-04-21 15:36:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:36:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:36:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2016-04-21 15:36:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:36:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2016-04-21 15:36:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2016-04-21 15:36:54 [DEBUG   ] Finished updating board flags in 1.160 seconds
2016-04-21 15:37:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:37:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:37:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:37:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-21 15:37:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2016-04-21 15:37:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2016-04-21 15:37:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 15:37:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:37:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2016-04-21 15:37:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:37:54 [DEBUG   ] Finished updating board flags in 1.018 seconds
2016-04-21 15:38:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:38:13 [DEBUG   ] Got command RPT from MCS: ref #671817
2016-04-21 15:38:13 [DEBUG   ] summary = NORMAL
2016-04-21 15:38:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671817  14 57499 56293886 A NORMALNORMAL'
2016-04-21 15:38:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:38:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:38:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-21 15:38:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2016-04-21 15:38:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2016-04-21 15:38:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:38:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2016-04-21 15:38:54 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:38:54 [DEBUG   ] Finished updating board flags in 1.055 seconds
2016-04-21 15:39:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 15:39:29 [DEBUG   ] Got command RPT from MCS: ref #671823
2016-04-21 15:39:29 [DEBUG   ] summary = NORMAL
2016-04-21 15:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671823  14 57499 56369602 A NORMALNORMAL'
2016-04-21 15:39:29 [DEBUG   ] Got command RPT from MCS: ref #671824
2016-04-21 15:39:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 15:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671824  48 57499 56369602 A NORMALSystem calibrated and operating normally'
2016-04-21 15:39:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:39:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:39:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-21 15:39:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2016-04-21 15:39:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 15:39:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-21 15:39:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:39:55 [DEBUG   ] Finished updating board flags in 2.002 seconds
2016-04-21 15:40:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 15:40:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:40:52 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2016-04-21 15:40:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-21 15:40:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 15:40:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2016-04-21 15:40:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2016-04-21 15:40:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:40:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2016-04-21 15:40:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2016-04-21 15:40:54 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:40:54 [DEBUG   ] Finished updating board flags in 1.380 seconds
2016-04-21 15:41:11 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 15:41:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 15:41:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:41:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-21 15:41:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 15:41:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-21 15:41:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2016-04-21 15:41:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:41:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:41:54 [DEBUG   ] Finished updating board flags in 1.258 seconds
2016-04-21 15:42:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 15:42:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:42:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 15:42:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 2
2016-04-21 15:42:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-21 15:42:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2016-04-21 15:42:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2016-04-21 15:42:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 15:42:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2016-04-21 15:42:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 15:42:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:42:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2016-04-21 15:42:54 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:42:54 [DEBUG   ] Finished updating board flags in 1.211 seconds
2016-04-21 15:43:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:43:13 [DEBUG   ] Got command RPT from MCS: ref #671843
2016-04-21 15:43:13 [DEBUG   ] summary = NORMAL
2016-04-21 15:43:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671843  14 57499 56593986 A NORMALNORMAL'
2016-04-21 15:43:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 15:43:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 15:43:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-21 15:43:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2016-04-21 15:43:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-21 15:43:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2016-04-21 15:43:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-21 15:43:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:43:54 [DEBUG   ] Finished updating board flags in 1.143 seconds
2016-04-21 15:44:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:44:29 [DEBUG   ] Got command RPT from MCS: ref #671847
2016-04-21 15:44:29 [DEBUG   ] summary = NORMAL
2016-04-21 15:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671847  14 57499 56669598 A NORMALNORMAL'
2016-04-21 15:44:29 [DEBUG   ] Got command RPT from MCS: ref #671848
2016-04-21 15:44:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 15:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671848  48 57499 56669598 A NORMALSystem calibrated and operating normally'
2016-04-21 15:44:32 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2016-04-21 15:44:52 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 15:44:54 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 15:44:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2016-04-21 15:44:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:44:54 [DEBUG   ] Finished updating board flags in 1.026 seconds
2016-04-21 15:45:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 15:45:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 15:45:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 15:45:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-21 15:45:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-21 15:45:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:45:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 5
2016-04-21 15:45:54 [DEBUG   ] Finished updating board flags in 0.972 seconds
2016-04-21 15:46:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:46:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:46:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:46:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 2
2016-04-21 15:46:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:46:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:46:55 [DEBUG   ] Finished updating board flags in 1.369 seconds
2016-04-21 15:47:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:47:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:47:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:47:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-21 15:47:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 15:47:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-21 15:47:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2016-04-21 15:47:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:47:55 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2016-04-21 15:47:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:47:55 [DEBUG   ] Finished updating board flags in 1.191 seconds
2016-04-21 15:48:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:48:14 [DEBUG   ] Got command RPT from MCS: ref #671868
2016-04-21 15:48:14 [DEBUG   ] summary = NORMAL
2016-04-21 15:48:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671868  14 57499 56894086 A NORMALNORMAL'
2016-04-21 15:48:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 15:48:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 15:48:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 15:48:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2016-04-21 15:48:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2016-04-21 15:48:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:48:55 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2016-04-21 15:48:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2016-04-21 15:48:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:48:55 [DEBUG   ] Finished updating board flags in 1.014 seconds
2016-04-21 15:49:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:49:29 [DEBUG   ] Got command RPT from MCS: ref #671877
2016-04-21 15:49:29 [DEBUG   ] summary = NORMAL
2016-04-21 15:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671877  14 57499 56969594 A NORMALNORMAL'
2016-04-21 15:49:29 [DEBUG   ] Got command RPT from MCS: ref #671878
2016-04-21 15:49:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 15:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671878  48 57499 56969594 A NORMALSystem calibrated and operating normally'
2016-04-21 15:49:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:49:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:49:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 15:49:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:49:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2016-04-21 15:49:55 [DEBUG   ] Finished updating board flags in 1.081 seconds
2016-04-21 15:50:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 15:50:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:50:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:50:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2016-04-21 15:50:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2016-04-21 15:50:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2016-04-21 15:50:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2016-04-21 15:50:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-21 15:50:56 [DEBUG   ] Finished updating board flags in 1.999 seconds
2016-04-21 15:51:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:51:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:51:52 [DEBUG   ] Got command STP from MCS: ref #671897
2016-04-21 15:51:52 [INFO    ] Finished processing BAM request
2016-04-21 15:51:52 [INFO    ] Shutdown the adder chain on beam #3
2016-04-21 15:51:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   671897   8 57499 57112998 A NORMAL'
2016-04-21 15:51:52 [DEBUG   ] Got command STP from MCS: ref #671894
2016-04-21 15:51:52 [INFO    ] Finished processing BAM request
2016-04-21 15:51:52 [INFO    ] Shutdown the adder chain on beam #2
2016-04-21 15:51:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   671894   8 57499 57113002 A NORMAL'
2016-04-21 15:51:53 [DEBUG   ] Got command STP from MCS: ref #671895
2016-04-21 15:51:53 [INFO    ] Finished processing BAM request
2016-04-21 15:51:53 [INFO    ] Shutdown the adder chain on beam #1
2016-04-21 15:51:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   671895   8 57499 57113006 A NORMAL'
2016-04-21 15:51:53 [DEBUG   ] Got command STP from MCS: ref #671896
2016-04-21 15:51:53 [INFO    ] Finished processing BAM request
2016-04-21 15:51:53 [INFO    ] Shutdown the adder chain on beam #4
2016-04-21 15:51:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   671896   8 57499 57113010 A NORMAL'
2016-04-21 15:51:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2016-04-21 15:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2016-04-21 15:51:53 [DEBUG   ] spawn_process: at 2016-04-21 15:51:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2016-04-21 15:51:55 [DEBUG   ] Finished updating board flags in 1.149 seconds
2016-04-21 15:52:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 15:52:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:52:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 15:52:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 15:52:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 15:52:55 [DEBUG   ] Finished updating board flags in 1.045 seconds
2016-04-21 15:53:00 [DEBUG   ] Got command INI from MCS: ref #671902
2016-04-21 15:53:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2016-04-21 15:53:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   671902   8 57499 57180114 ABOOTING'
2016-04-21 15:53:14 [DEBUG   ] Got command RPT from MCS: ref #671918
2016-04-21 15:53:14 [DEBUG   ] summary = BOOTING
2016-04-21 15:53:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671918  15 57499 57194178 ABOOTINGBOOTING'
2016-04-21 15:53:20 [INFO    ] -------------------
2016-04-21 15:53:20 [INFO    ]  LWA board status
2016-04-21 15:53:20 [INFO    ] -------------------
2016-04-21 15:53:20 [INFO    ] DP 1: 2 lwa27
2016-04-21 15:53:20 [INFO    ] DP 1: 3 lwa24
2016-04-21 15:53:20 [INFO    ] DP 1: 4 lwa23
2016-04-21 15:53:20 [INFO    ] DP 1: 5 lwa18
2016-04-21 15:53:20 [INFO    ] DP 1: 6 lwa10
2016-04-21 15:53:20 [INFO    ] DP 1: 7 lwa32
2016-04-21 15:53:20 [INFO    ] DP 1: 8 lwa11
2016-04-21 15:53:20 [INFO    ] DP 1: 9 lwa30
2016-04-21 15:53:20 [INFO    ] DP 1: 10 lwa12
2016-04-21 15:53:20 [INFO    ] DP 1: 11 lwa8
2016-04-21 15:53:20 [INFO    ] DP 1: 12 lwa13
2016-04-21 15:53:20 [INFO    ] DP 1: 13 lwa26
2016-04-21 15:53:20 [INFO    ] DP 1: 14 lwa14
2016-04-21 15:53:20 [INFO    ] DP 1: 16 lwa22
2016-04-21 15:53:20 [INFO    ] DP 1: 17 lwa20
2016-04-21 15:53:20 [INFO    ] DP 1: 18 lwa1
2016-04-21 15:53:20 [INFO    ] DP 1: 19 lwa5
2016-04-21 15:53:20 [INFO    ] DP 1: 20 lwa25
2016-04-21 15:53:20 [INFO    ] DP 1: 21 lwa35
2016-04-21 15:53:20 [INFO    ] DP 1: 22 lwa19
2016-04-21 15:53:20 [INFO    ] DP 1: 23 lwa21
2016-04-21 15:53:20 [INFO    ] DP 1: 24 lwa6
2016-04-21 15:53:20 [INFO    ] DP 1: 25 lwa7
2016-04-21 15:53:20 [INFO    ] DP 1: 26 lwa33
2016-04-21 15:53:20 [INFO    ] DP 1: 27 lwa15
2016-04-21 15:53:20 [INFO    ] DP 1: 28 lwa28
2016-04-21 15:53:20 [INFO    ] DP 2: 1 lwa16
2016-04-21 15:53:20 [INFO    ] DP 2: 15 lwa34
2016-04-21 15:53:20 [INFO    ] Total of 28 boards
2016-04-21 15:53:20 [INFO    ] Total of 260 stands
2016-04-21 15:53:20 [INFO    ] -------------------
2016-04-21 15:53:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22800
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22801
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22802
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22803
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22804
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22805
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22806
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22807
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22808
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22809
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22810
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22811
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22812
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22813
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22814
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22815
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22816
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22817
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22818
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22819
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22820
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22821
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22822
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22823
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22824
2016-04-21 15:53:27 [DEBUG   ] 2016-04-21 15:53:27 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22825
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22800 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22801 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22802 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22803 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22804 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22805 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22806 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22807 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22808 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22809 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22810 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22811 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22812 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22813 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22814 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22815 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22816 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22817 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22818 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22819 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22820 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22821 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22822 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22823 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22824 exited with status 0
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22825 exited with status 0
2016-04-21 15:53:39 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] spawn_process: at 2016-04-21 15:53:39 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 22852
2016-04-21 15:53:39 [DEBUG   ] 2016-04-21 15:53:39 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 22853
2016-04-21 15:53:45 [DEBUG   ] 2016-04-21 15:53:45 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 22852 exited with status 0
2016-04-21 15:53:45 [DEBUG   ] 2016-04-21 15:53:45 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 22853 exited with status 0
2016-04-21 15:53:45 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2016-04-21 15:53:45 [DEBUG   ] spawn_process: at 2016-04-21 15:53:45 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2016-04-21 15:53:45 [DEBUG   ] spawn_process: at 2016-04-21 15:53:45 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2016-04-21 15:53:45 [INFO    ] Setting Beam 1 xbars
2016-04-21 15:53:45 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2016-04-21 15:53:45 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2016-04-21 15:53:45 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2016-04-21 15:53:45 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2016-04-21 15:53:45 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2016-04-21 15:53:46 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2016-04-21 15:53:46 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2016-04-21 15:53:46 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2016-04-21 15:53:46 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2016-04-21 15:53:46 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2016-04-21 15:53:46 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2016-04-21 15:53:46 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2016-04-21 15:53:46 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2016-04-21 15:53:46 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2016-04-21 15:53:47 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2016-04-21 15:53:47 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2016-04-21 15:53:47 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2016-04-21 15:53:47 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2016-04-21 15:53:47 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2016-04-21 15:53:47 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2016-04-21 15:53:47 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2016-04-21 15:53:47 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2016-04-21 15:53:47 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2016-04-21 15:53:48 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2016-04-21 15:53:48 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2016-04-21 15:53:48 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2016-04-21 15:53:48 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2016-04-21 15:53:48 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2016-04-21 15:53:48 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2016-04-21 15:53:48 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2016-04-21 15:53:48 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2016-04-21 15:53:48 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2016-04-21 15:53:48 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2016-04-21 15:53:49 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2016-04-21 15:53:49 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2016-04-21 15:53:49 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2016-04-21 15:53:49 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2016-04-21 15:53:49 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2016-04-21 15:53:49 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2016-04-21 15:53:49 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2016-04-21 15:53:49 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2016-04-21 15:53:49 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2016-04-21 15:53:50 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2016-04-21 15:53:50 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2016-04-21 15:53:50 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2016-04-21 15:53:50 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2016-04-21 15:53:50 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2016-04-21 15:53:50 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2016-04-21 15:53:50 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2016-04-21 15:53:50 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2016-04-21 15:53:50 [INFO    ] Setting Beam 2 xbars
2016-04-21 15:53:50 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2016-04-21 15:53:51 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2016-04-21 15:53:51 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2016-04-21 15:53:51 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2016-04-21 15:53:51 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2016-04-21 15:53:51 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2016-04-21 15:53:51 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2016-04-21 15:53:51 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2016-04-21 15:53:51 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2016-04-21 15:53:51 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2016-04-21 15:53:51 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2016-04-21 15:53:52 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2016-04-21 15:53:52 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2016-04-21 15:53:52 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2016-04-21 15:53:52 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2016-04-21 15:53:52 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2016-04-21 15:53:52 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2016-04-21 15:53:52 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2016-04-21 15:53:52 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2016-04-21 15:53:52 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2016-04-21 15:53:53 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2016-04-21 15:53:53 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2016-04-21 15:53:53 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2016-04-21 15:53:53 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2016-04-21 15:53:53 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2016-04-21 15:53:53 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2016-04-21 15:53:53 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2016-04-21 15:53:53 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2016-04-21 15:53:53 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2016-04-21 15:53:54 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2016-04-21 15:53:54 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2016-04-21 15:53:54 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2016-04-21 15:53:54 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2016-04-21 15:53:54 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2016-04-21 15:53:54 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2016-04-21 15:53:54 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2016-04-21 15:53:54 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2016-04-21 15:53:54 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2016-04-21 15:53:55 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2016-04-21 15:53:55 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2016-04-21 15:53:55 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2016-04-21 15:53:55 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2016-04-21 15:53:55 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2016-04-21 15:53:55 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2016-04-21 15:53:55 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2016-04-21 15:53:55 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2016-04-21 15:53:55 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2016-04-21 15:53:55 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2016-04-21 15:53:56 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2016-04-21 15:53:56 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2016-04-21 15:53:56 [INFO    ] Setting Beam 3 xbars
2016-04-21 15:53:56 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2016-04-21 15:53:56 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2016-04-21 15:53:56 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2016-04-21 15:53:56 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2016-04-21 15:53:56 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2016-04-21 15:53:56 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2016-04-21 15:53:56 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2016-04-21 15:53:57 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2016-04-21 15:53:57 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2016-04-21 15:53:57 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2016-04-21 15:53:57 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2016-04-21 15:53:57 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2016-04-21 15:53:57 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2016-04-21 15:53:57 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2016-04-21 15:53:57 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2016-04-21 15:53:57 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2016-04-21 15:53:58 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2016-04-21 15:53:58 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2016-04-21 15:53:58 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2016-04-21 15:53:58 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2016-04-21 15:53:58 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2016-04-21 15:53:58 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2016-04-21 15:53:58 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2016-04-21 15:53:58 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2016-04-21 15:53:58 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2016-04-21 15:53:59 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2016-04-21 15:53:59 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2016-04-21 15:53:59 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2016-04-21 15:53:59 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2016-04-21 15:53:59 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2016-04-21 15:53:59 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2016-04-21 15:53:59 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2016-04-21 15:53:59 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2016-04-21 15:53:59 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2016-04-21 15:53:59 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2016-04-21 15:54:00 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2016-04-21 15:54:00 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2016-04-21 15:54:00 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2016-04-21 15:54:00 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2016-04-21 15:54:00 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2016-04-21 15:54:00 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2016-04-21 15:54:00 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2016-04-21 15:54:00 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2016-04-21 15:54:00 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2016-04-21 15:54:01 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2016-04-21 15:54:01 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2016-04-21 15:54:01 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2016-04-21 15:54:01 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2016-04-21 15:54:01 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2016-04-21 15:54:01 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2016-04-21 15:54:01 [INFO    ] Setting Beam 4 xbars
2016-04-21 15:54:01 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2016-04-21 15:54:01 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2016-04-21 15:54:01 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2016-04-21 15:54:02 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2016-04-21 15:54:02 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2016-04-21 15:54:02 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2016-04-21 15:54:02 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2016-04-21 15:54:02 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2016-04-21 15:54:02 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2016-04-21 15:54:02 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2016-04-21 15:54:02 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2016-04-21 15:54:02 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2016-04-21 15:54:03 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2016-04-21 15:54:03 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2016-04-21 15:54:03 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2016-04-21 15:54:03 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2016-04-21 15:54:03 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2016-04-21 15:54:03 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2016-04-21 15:54:03 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2016-04-21 15:54:03 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2016-04-21 15:54:03 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2016-04-21 15:54:04 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2016-04-21 15:54:04 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2016-04-21 15:54:04 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2016-04-21 15:54:04 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2016-04-21 15:54:04 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2016-04-21 15:54:04 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2016-04-21 15:54:04 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2016-04-21 15:54:04 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2016-04-21 15:54:04 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2016-04-21 15:54:05 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2016-04-21 15:54:05 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2016-04-21 15:54:05 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2016-04-21 15:54:05 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2016-04-21 15:54:05 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2016-04-21 15:54:05 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2016-04-21 15:54:05 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2016-04-21 15:54:05 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2016-04-21 15:54:05 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2016-04-21 15:54:06 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2016-04-21 15:54:06 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2016-04-21 15:54:06 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2016-04-21 15:54:06 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2016-04-21 15:54:06 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2016-04-21 15:54:06 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2016-04-21 15:54:06 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2016-04-21 15:54:06 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2016-04-21 15:54:06 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2016-04-21 15:54:07 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2016-04-21 15:54:07 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2016-04-21 15:54:07 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2016-04-21 15:54:07 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2016-04-21 15:54:07 [INFO    ] All xbars set
2016-04-21 15:54:07 [INFO    ] Setting adder chain routing for all beams
2016-04-21 15:54:12 [INFO    ] Setting beam ids
2016-04-21 15:54:22 [INFO    ] Starting beam delay calibration
2016-04-21 15:54:29 [DEBUG   ] Got command RPT from MCS: ref #671939
2016-04-21 15:54:29 [DEBUG   ] summary = BOOTING
2016-04-21 15:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671939  15 57499 57269606 ABOOTINGBOOTING'
2016-04-21 15:54:29 [DEBUG   ] Got command RPT from MCS: ref #671940
2016-04-21 15:54:29 [DEBUG   ] info = Starting calibration
2016-04-21 15:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671940  28 57499 57269606 ABOOTINGStarting calibration'
2016-04-21 15:54:35 [INFO    ] Beam 1 latency is 5736
2016-04-21 15:54:35 [INFO    ] Beam 2 latency is 5739
2016-04-21 15:54:35 [INFO    ] Beam 3 latency is 5729
2016-04-21 15:54:35 [INFO    ] Beam 4 latency is 5712
2016-04-21 15:54:35 [INFO    ] Stop calibration
2016-04-21 15:54:43 [INFO    ] Beam delay calibration successful
2016-04-21 15:54:43 [INFO    ] Calibration passed
2016-04-21 15:54:43 [DEBUG   ] spawn_process: at 2016-04-21 15:54:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2016-04-21 15:54:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2016-04-21 15:54:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2016-04-21 15:54:43 [DEBUG   ] spawn_process: at 2016-04-21 15:54:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2016-04-21 15:54:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2016-04-21 15:54:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2016-04-21 15:54:43 [DEBUG   ] spawn_process: at 2016-04-21 15:54:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2016-04-21 15:54:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2016-04-21 15:54:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2016-04-21 15:54:43 [DEBUG   ] spawn_process: at 2016-04-21 15:54:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2016-04-21 15:54:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2016-04-21 15:54:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2016-04-21 15:54:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2016-04-21 15:54:44 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 298 ms (1461254084.299 s) with PID 24438 and time 1461254085
2016-04-21 15:54:44 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2016-04-21 15:54:44 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 385 ms (1461254084.386 s) with PID 24441 and time 1461254085
2016-04-21 15:54:45 [DEBUG   ] Finished updating ant stats in 0.860 seconds
2016-04-21 15:54:45 [INFO    ] Started antennas statistics background thread
2016-04-21 15:54:45 [INFO    ] Started board flags background thread
2016-04-21 15:54:45 [INFO    ] Started BAM background thread
2016-04-21 15:54:45 [INFO    ] Finished the INI process (ref. #671902) in 105.396 s
2016-04-21 15:54:46 [DEBUG   ] Finished updating board flags in 1.049 seconds
2016-04-21 15:55:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:55:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:55:30 [DEBUG   ] Got command RPT from MCS: ref #671959
2016-04-21 15:55:30 [DEBUG   ] summary = NORMAL
2016-04-21 15:55:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671959  14 57499 57330106 A NORMALNORMAL'
2016-04-21 15:55:30 [DEBUG   ] Got command RPT from MCS: ref #671960
2016-04-21 15:55:30 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 15:55:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671960  48 57499 57330106 A NORMALSystem calibrated and operating normally'
2016-04-21 15:55:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:55:46 [DEBUG   ] Finished updating board flags in 0.986 seconds
2016-04-21 15:56:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:56:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:56:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:56:46 [DEBUG   ] Finished updating board flags in 1.330 seconds
2016-04-21 15:57:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:57:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:57:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:57:47 [DEBUG   ] Finished updating board flags in 1.760 seconds
2016-04-21 15:58:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:58:14 [DEBUG   ] Got command RPT from MCS: ref #671962
2016-04-21 15:58:14 [DEBUG   ] summary = NORMAL
2016-04-21 15:58:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671962  14 57499 57494258 A NORMALNORMAL'
2016-04-21 15:58:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 15:58:45 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2016-04-21 15:58:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 15:58:47 [DEBUG   ] Finished updating board flags in 1.513 seconds
2016-04-21 15:59:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:59:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:59:29 [DEBUG   ] Got command RPT from MCS: ref #671971
2016-04-21 15:59:29 [DEBUG   ] summary = NORMAL
2016-04-21 15:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671971  14 57499 57569598 A NORMALNORMAL'
2016-04-21 15:59:29 [DEBUG   ] Got command RPT from MCS: ref #671972
2016-04-21 15:59:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 15:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671972  48 57499 57569598 A NORMALSystem calibrated and operating normally'
2016-04-21 15:59:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 15:59:47 [DEBUG   ] Finished updating board flags in 1.413 seconds
2016-04-21 16:00:05 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2016-04-21 16:00:25 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 16:00:45 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 16:00:47 [DEBUG   ] Finished updating board flags in 1.390 seconds
2016-04-21 16:01:05 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 16:01:25 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 16:01:45 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 16:01:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 16:01:47 [DEBUG   ] Finished updating board flags in 1.218 seconds
2016-04-21 16:02:05 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 16:02:25 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 16:02:45 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 16:02:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 16:02:47 [DEBUG   ] Finished updating board flags in 1.211 seconds
2016-04-21 16:03:05 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 16:03:14 [DEBUG   ] Got command RPT from MCS: ref #671991
2016-04-21 16:03:14 [DEBUG   ] summary = NORMAL
2016-04-21 16:03:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671991  14 57499 57794354 A NORMALNORMAL'
2016-04-21 16:03:25 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-21 16:03:45 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 16:03:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-21 16:03:47 [DEBUG   ] Finished updating board flags in 1.186 seconds
2016-04-21 16:04:05 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 16:04:25 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 16:04:29 [DEBUG   ] Got command RPT from MCS: ref #671995
2016-04-21 16:04:29 [DEBUG   ] summary = NORMAL
2016-04-21 16:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671995  14 57499 57869602 A NORMALNORMAL'
2016-04-21 16:04:29 [DEBUG   ] Got command RPT from MCS: ref #671996
2016-04-21 16:04:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 16:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   671996  48 57499 57869602 A NORMALSystem calibrated and operating normally'
2016-04-21 16:04:45 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 16:04:47 [DEBUG   ] Finished updating board flags in 1.046 seconds
2016-04-21 16:05:05 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2016-04-21 16:05:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 16:05:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 16:05:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-21 16:05:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 16:05:48 [DEBUG   ] Finished updating board flags in 2.005 seconds
2016-04-21 16:06:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 16:06:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 16:06:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 16:06:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 16:06:47 [DEBUG   ] Finished updating board flags in 1.401 seconds
2016-04-21 16:07:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 16:07:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 16:07:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 16:07:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 16:07:47 [DEBUG   ] Finished updating board flags in 1.417 seconds
2016-04-21 16:08:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 16:08:14 [DEBUG   ] Got command RPT from MCS: ref #672016
2016-04-21 16:08:14 [DEBUG   ] summary = NORMAL
2016-04-21 16:08:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672016  14 57499 58094442 A NORMALNORMAL'
2016-04-21 16:08:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 16:08:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 16:08:47 [DEBUG   ] Finished updating board flags in 1.368 seconds
2016-04-21 16:09:06 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 16:09:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 16:09:29 [DEBUG   ] Got command RPT from MCS: ref #672022
2016-04-21 16:09:29 [DEBUG   ] summary = NORMAL
2016-04-21 16:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672022  14 57499 58169602 A NORMALNORMAL'
2016-04-21 16:09:29 [DEBUG   ] Got command RPT from MCS: ref #672023
2016-04-21 16:09:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 16:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672023  48 57499 58169602 A NORMALSystem calibrated and operating normally'
2016-04-21 16:09:47 [DEBUG   ] Finished updating ant stats in 1.229 seconds
2016-04-21 16:09:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 16:09:48 [DEBUG   ] Finished updating board flags in 1.777 seconds
2016-04-21 16:10:00 [DEBUG   ] Got command TBN from MCS: ref #672039
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] tbn = exited with status True, code 0x00
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   672039   8 57499 58200122 A NORMAL'
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1461255001']
2016-04-21 16:10:00 [DEBUG   ] spawn_process: at 2016-04-21 16:10:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1461255001']
2016-04-21 16:10:00 [INFO    ] Finished spawning TBN in 0.049 s
2016-04-21 16:10:07 [DEBUG   ] Finished updating ant stats in 1.240 seconds
2016-04-21 16:10:27 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2016-04-21 16:10:47 [DEBUG   ] Finished updating ant stats in 1.043 seconds
2016-04-21 16:10:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 16:10:48 [DEBUG   ] Finished updating board flags in 1.814 seconds
2016-04-21 16:11:07 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2016-04-21 16:11:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 16:11:47 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2016-04-21 16:11:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 16:11:48 [DEBUG   ] Finished updating board flags in 1.810 seconds
2016-04-21 16:12:07 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2016-04-21 16:12:28 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2016-04-21 16:12:48 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2016-04-21 16:12:48 [DEBUG   ] Finished updating board flags in 1.845 seconds
2016-04-21 16:13:08 [DEBUG   ] Finished updating ant stats in 1.157 seconds
2016-04-21 16:13:14 [DEBUG   ] Got command RPT from MCS: ref #672043
2016-04-21 16:13:14 [DEBUG   ] summary = NORMAL
2016-04-21 16:13:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672043  14 57499 58394518 A NORMALNORMAL'
2016-04-21 16:13:28 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2016-04-21 16:13:48 [DEBUG   ] Finished updating ant stats in 0.849 seconds
2016-04-21 16:13:48 [DEBUG   ] Finished updating board flags in 1.821 seconds
2016-04-21 16:14:08 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2016-04-21 16:14:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 16:14:29 [DEBUG   ] Got command RPT from MCS: ref #672047
2016-04-21 16:14:29 [DEBUG   ] summary = NORMAL
2016-04-21 16:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672047  14 57499 58469606 A NORMALNORMAL'
2016-04-21 16:14:29 [DEBUG   ] Got command RPT from MCS: ref #672048
2016-04-21 16:14:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 16:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672048  48 57499 58469606 A NORMALSystem calibrated and operating normally'
2016-04-21 16:14:48 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2016-04-21 16:14:48 [DEBUG   ] Finished updating board flags in 1.792 seconds
2016-04-21 16:15:08 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2016-04-21 16:15:29 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2016-04-21 16:15:48 [DEBUG   ] Finished updating board flags in 1.584 seconds
2016-04-21 16:15:49 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2016-04-21 16:16:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 16:16:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 16:16:48 [DEBUG   ] Finished updating board flags in 1.410 seconds
2016-04-21 16:16:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 16:17:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 16:17:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 16:17:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 16:17:48 [DEBUG   ] Finished updating board flags in 1.434 seconds
2016-04-21 16:17:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 16:18:09 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2016-04-21 16:18:14 [DEBUG   ] Got command RPT from MCS: ref #672068
2016-04-21 16:18:14 [DEBUG   ] summary = NORMAL
2016-04-21 16:18:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672068  14 57499 58694598 A NORMALNORMAL'
2016-04-21 16:18:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 16:18:48 [DEBUG   ] Finished updating board flags in 1.440 seconds
2016-04-21 16:18:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 16:19:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 16:19:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 16:19:29 [DEBUG   ] Got command RPT from MCS: ref #672077
2016-04-21 16:19:29 [DEBUG   ] summary = NORMAL
2016-04-21 16:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672077  14 57499 58769602 A NORMALNORMAL'
2016-04-21 16:19:29 [DEBUG   ] Got command RPT from MCS: ref #672078
2016-04-21 16:19:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 16:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672078  48 57499 58769602 A NORMALSystem calibrated and operating normally'
2016-04-21 16:19:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 16:19:48 [DEBUG   ] Finished updating board flags in 1.472 seconds
2016-04-21 16:19:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 16:20:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 16:20:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 16:20:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 16:20:49 [DEBUG   ] Finished updating board flags in 1.975 seconds
2016-04-21 16:21:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 16:21:30 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2016-04-21 16:21:49 [DEBUG   ] Finished updating board flags in 2.095 seconds
2016-04-21 16:21:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 16:22:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 16:22:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 16:22:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 16:22:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 16:22:49 [DEBUG   ] Finished updating board flags in 1.972 seconds
2016-04-21 16:22:50 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 16:23:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 16:23:14 [DEBUG   ] Got command RPT from MCS: ref #672097
2016-04-21 16:23:14 [DEBUG   ] summary = NORMAL
2016-04-21 16:23:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672097  14 57499 58994690 A NORMALNORMAL'
2016-04-21 16:23:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 16:23:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-21 16:23:49 [DEBUG   ] Finished updating board flags in 1.853 seconds
2016-04-21 16:23:50 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 16:24:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 16:24:29 [DEBUG   ] Got command RPT from MCS: ref #672098
2016-04-21 16:24:29 [DEBUG   ] summary = NORMAL
2016-04-21 16:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672098  14 57499 59069602 A NORMALNORMAL'
2016-04-21 16:24:29 [DEBUG   ] Got command RPT from MCS: ref #672099
2016-04-21 16:24:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 16:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672099  48 57499 59069602 A NORMALSystem calibrated and operating normally'
2016-04-21 16:24:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 16:24:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 16:24:49 [DEBUG   ] Finished updating board flags in 1.807 seconds
2016-04-21 16:24:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 16:25:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 16:25:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 16:25:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 16:25:49 [DEBUG   ] Finished updating board flags in 1.815 seconds
2016-04-21 16:25:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 16:26:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 16:26:30 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-21 16:26:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 16:26:49 [DEBUG   ] Finished updating board flags in 1.714 seconds
2016-04-21 16:26:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 16:27:11 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2016-04-21 16:27:31 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2016-04-21 16:27:49 [DEBUG   ] Finished updating board flags in 1.618 seconds
2016-04-21 16:27:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 16:28:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 16:28:14 [DEBUG   ] Got command RPT from MCS: ref #672119
2016-04-21 16:28:14 [DEBUG   ] summary = NORMAL
2016-04-21 16:28:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672119  14 57499 59294782 A NORMALNORMAL'
2016-04-21 16:28:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 16:28:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 16:28:49 [DEBUG   ] Finished updating board flags in 1.577 seconds
2016-04-21 16:28:51 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 16:29:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 16:29:29 [DEBUG   ] Got command RPT from MCS: ref #672128
2016-04-21 16:29:29 [DEBUG   ] summary = NORMAL
2016-04-21 16:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672128  14 57499 59369606 A NORMALNORMAL'
2016-04-21 16:29:29 [DEBUG   ] Got command RPT from MCS: ref #672129
2016-04-21 16:29:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 16:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672129  48 57499 59369606 A NORMALSystem calibrated and operating normally'
2016-04-21 16:29:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 16:29:49 [DEBUG   ] Finished updating board flags in 1.423 seconds
2016-04-21 16:29:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 16:30:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 16:30:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 16:30:49 [DEBUG   ] Finished updating board flags in 1.379 seconds
2016-04-21 16:30:51 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2016-04-21 16:31:11 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2016-04-21 16:31:32 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2016-04-21 16:31:49 [DEBUG   ] Finished updating board flags in 1.380 seconds
2016-04-21 16:31:52 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-21 16:32:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 16:32:32 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-21 16:32:50 [DEBUG   ] Finished updating board flags in 2.036 seconds
2016-04-21 16:32:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 16:33:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 16:33:14 [DEBUG   ] Got command RPT from MCS: ref #672148
2016-04-21 16:33:14 [DEBUG   ] summary = NORMAL
2016-04-21 16:33:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672148  14 57499 59594854 A NORMALNORMAL'
2016-04-21 16:33:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 16:33:50 [DEBUG   ] Finished updating board flags in 1.987 seconds
2016-04-21 16:33:52 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 16:34:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 16:34:29 [DEBUG   ] Got command RPT from MCS: ref #672152
2016-04-21 16:34:29 [DEBUG   ] summary = NORMAL
2016-04-21 16:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672152  14 57499 59669606 A NORMALNORMAL'
2016-04-21 16:34:29 [DEBUG   ] Got command RPT from MCS: ref #672153
2016-04-21 16:34:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 16:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672153  48 57499 59669606 A NORMALSystem calibrated and operating normally'
2016-04-21 16:34:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 16:34:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 16:34:50 [DEBUG   ] Finished updating board flags in 1.816 seconds
2016-04-21 16:34:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 16:35:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 16:35:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 16:35:50 [DEBUG   ] Finished updating board flags in 1.803 seconds
2016-04-21 16:35:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 16:36:12 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2016-04-21 16:36:33 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2016-04-21 16:36:50 [DEBUG   ] Finished updating board flags in 1.794 seconds
2016-04-21 16:36:53 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2016-04-21 16:37:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 16:37:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 16:37:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 16:37:50 [DEBUG   ] Finished updating board flags in 1.607 seconds
2016-04-21 16:37:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 16:38:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 16:38:14 [DEBUG   ] Got command RPT from MCS: ref #672173
2016-04-21 16:38:14 [DEBUG   ] summary = NORMAL
2016-04-21 16:38:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672173  14 57499 59894954 A NORMALNORMAL'
2016-04-21 16:38:33 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 16:38:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 16:38:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 16:38:50 [DEBUG   ] Finished updating board flags in 1.591 seconds
2016-04-21 16:38:53 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2016-04-21 16:39:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 16:39:29 [DEBUG   ] Got command RPT from MCS: ref #672179
2016-04-21 16:39:29 [DEBUG   ] summary = NORMAL
2016-04-21 16:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672179  14 57499 59969606 A NORMALNORMAL'
2016-04-21 16:39:29 [DEBUG   ] Got command RPT from MCS: ref #672180
2016-04-21 16:39:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 16:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672180  48 57499 59969606 A NORMALSystem calibrated and operating normally'
2016-04-21 16:39:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 16:39:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 16:39:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 16:39:50 [DEBUG   ] Finished updating board flags in 1.419 seconds
2016-04-21 16:39:53 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-21 16:40:13 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-21 16:40:34 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2016-04-21 16:40:50 [DEBUG   ] Finished updating board flags in 1.405 seconds
2016-04-21 16:40:54 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2016-04-21 16:41:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 16:41:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 16:41:50 [DEBUG   ] Finished updating board flags in 1.395 seconds
2016-04-21 16:41:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 16:42:14 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-21 16:42:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 16:42:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 16:42:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 16:42:50 [DEBUG   ] Finished updating board flags in 1.353 seconds
2016-04-21 16:42:55 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2016-04-21 16:43:15 [DEBUG   ] Got command RPT from MCS: ref #672199
2016-04-21 16:43:15 [DEBUG   ] summary = NORMAL
2016-04-21 16:43:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672199  14 57499 60195046 A NORMALNORMAL'
2016-04-21 16:43:15 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2016-04-21 16:43:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 16:43:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 16:43:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 16:43:51 [DEBUG   ] Finished updating board flags in 2.049 seconds
2016-04-21 16:43:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 16:44:11 [DEBUG   ] Got command TBW from MCS: ref #672204
2016-04-21 16:44:11 [DEBUG   ] tbw = exited with status True, code 0x00
2016-04-21 16:44:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   672204   8 57499 60251218 A NORMAL'
2016-04-21 16:44:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2016-04-21 16:44:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2016-04-21 16:44:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2016-04-21 16:44:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2016-04-21 16:44:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2016-04-21 16:44:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2016-04-21 16:44:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2016-04-21 16:44:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2016-04-21 16:44:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2016-04-21 16:44:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2016-04-21 16:44:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2016-04-21 16:44:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2016-04-21 16:44:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2016-04-21 16:44:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2016-04-21 16:44:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2016-04-21 16:44:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2016-04-21 16:44:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2016-04-21 16:44:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2016-04-21 16:44:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2016-04-21 16:44:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2016-04-21 16:44:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2016-04-21 16:44:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2016-04-21 16:44:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2016-04-21 16:44:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2016-04-21 16:44:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2016-04-21 16:44:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2016-04-21 16:44:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2016-04-21 16:44:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2016-04-21 16:44:14 [DEBUG   ] spawn_process: at 2016-04-21 16:44:14 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2016-04-21 16:44:14 [INFO    ] Finished spawning TBW
2016-04-21 16:44:29 [DEBUG   ] Got command RPT from MCS: ref #672206
2016-04-21 16:44:29 [DEBUG   ] summary = NORMAL
2016-04-21 16:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672206  14 57499 60269610 A NORMALNORMAL'
2016-04-21 16:44:29 [DEBUG   ] Got command RPT from MCS: ref #672207
2016-04-21 16:44:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 16:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672207  48 57499 60269610 A NORMALSystem calibrated and operating normally'
2016-04-21 16:44:51 [DEBUG   ] Finished updating board flags in 1.865 seconds
2016-04-21 16:45:51 [DEBUG   ] Finished updating board flags in 1.826 seconds
2016-04-21 16:46:51 [DEBUG   ] Finished updating board flags in 1.841 seconds
2016-04-21 16:47:51 [DEBUG   ] Finished updating board flags in 1.658 seconds
2016-04-21 16:47:53 [INFO    ] __waitForTBW - TBW finished in 218.287 s
2016-04-21 16:47:54 [INFO    ] Started antennas statistics background thread
2016-04-21 16:47:54 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1461257275']
2016-04-21 16:47:54 [DEBUG   ] spawn_process: at 2016-04-21 16:47:54 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1461257275']
2016-04-21 16:47:54 [INFO    ] Finished spawning TBN in 0.052 s
2016-04-21 16:47:54 [DEBUG   ] Finished updating ant stats in 1.272 seconds
2016-04-21 16:48:14 [DEBUG   ] Finished updating ant stats in 1.237 seconds
2016-04-21 16:48:15 [DEBUG   ] Got command RPT from MCS: ref #672235
2016-04-21 16:48:15 [DEBUG   ] summary = NORMAL
2016-04-21 16:48:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672235  14 57499 60495126 A NORMALNORMAL'
2016-04-21 16:48:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 16:48:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 16:48:51 [DEBUG   ] Finished updating board flags in 1.817 seconds
2016-04-21 16:48:54 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2016-04-21 16:49:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 16:49:29 [DEBUG   ] Got command RPT from MCS: ref #672247
2016-04-21 16:49:29 [DEBUG   ] summary = NORMAL
2016-04-21 16:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672247  14 57499 60569614 A NORMALNORMAL'
2016-04-21 16:49:29 [DEBUG   ] Got command RPT from MCS: ref #672248
2016-04-21 16:49:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 16:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672248  48 57499 60569614 A NORMALSystem calibrated and operating normally'
2016-04-21 16:49:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 16:49:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-21 16:49:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 16:49:51 [DEBUG   ] Finished updating board flags in 1.796 seconds
2016-04-21 16:49:54 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-21 16:50:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 16:50:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 16:50:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 16:50:51 [DEBUG   ] Finished updating board flags in 1.617 seconds
2016-04-21 16:50:54 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 16:51:14 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2016-04-21 16:51:34 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 16:51:51 [DEBUG   ] Finished updating board flags in 1.584 seconds
2016-04-21 16:51:55 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-21 16:52:15 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-21 16:52:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 16:52:51 [DEBUG   ] Finished updating board flags in 1.417 seconds
2016-04-21 16:52:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 16:53:15 [DEBUG   ] Got command RPT from MCS: ref #672267
2016-04-21 16:53:15 [DEBUG   ] summary = NORMAL
2016-04-21 16:53:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672267  14 57499 60795214 A NORMALNORMAL'
2016-04-21 16:53:15 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 16:53:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 16:53:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 16:53:51 [DEBUG   ] Finished updating board flags in 1.413 seconds
2016-04-21 16:53:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 16:54:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 16:54:29 [DEBUG   ] Got command RPT from MCS: ref #672268
2016-04-21 16:54:29 [DEBUG   ] summary = NORMAL
2016-04-21 16:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672268  14 57499 60869610 A NORMALNORMAL'
2016-04-21 16:54:29 [DEBUG   ] Got command RPT from MCS: ref #672269
2016-04-21 16:54:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 16:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672269  48 57499 60869610 A NORMALSystem calibrated and operating normally'
2016-04-21 16:54:35 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-21 16:54:51 [DEBUG   ] Finished updating board flags in 1.403 seconds
2016-04-21 16:54:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 16:55:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 16:55:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 16:55:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2016-04-21 16:55:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 16:55:51 [DEBUG   ] Finished updating board flags in 1.374 seconds
2016-04-21 16:55:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 16:56:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 16:56:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 16:56:51 [DEBUG   ] Finished updating board flags in 1.394 seconds
2016-04-21 16:56:55 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2016-04-21 16:57:16 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2016-04-21 16:57:35 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2016-04-21 16:57:52 [DEBUG   ] Finished updating board flags in 2.045 seconds
2016-04-21 16:57:55 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2016-04-21 16:58:15 [DEBUG   ] Got command RPT from MCS: ref #672289
2016-04-21 16:58:15 [DEBUG   ] summary = NORMAL
2016-04-21 16:58:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672289  14 57499 61095290 A NORMALNORMAL'
2016-04-21 16:58:16 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-21 16:58:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 16:58:52 [DEBUG   ] Finished updating board flags in 1.970 seconds
2016-04-21 16:58:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 16:59:16 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 16:59:29 [DEBUG   ] Got command RPT from MCS: ref #672298
2016-04-21 16:59:29 [DEBUG   ] summary = NORMAL
2016-04-21 16:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672298  14 57499 61169610 A NORMALNORMAL'
2016-04-21 16:59:29 [DEBUG   ] Got command RPT from MCS: ref #672299
2016-04-21 16:59:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 16:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672299  48 57499 61169610 A NORMALSystem calibrated and operating normally'
2016-04-21 16:59:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 16:59:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 16:59:52 [DEBUG   ] Finished updating board flags in 1.818 seconds
2016-04-21 16:59:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 17:00:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 17:00:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 17:00:52 [DEBUG   ] Finished updating board flags in 1.786 seconds
2016-04-21 17:00:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 17:01:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 17:01:36 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-21 17:01:52 [DEBUG   ] Finished updating board flags in 1.621 seconds
2016-04-21 17:01:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-21 17:02:17 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2016-04-21 17:02:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 17:02:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 17:02:52 [DEBUG   ] Finished updating board flags in 1.580 seconds
2016-04-21 17:02:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 17:03:15 [DEBUG   ] Got command RPT from MCS: ref #672318
2016-04-21 17:03:15 [DEBUG   ] summary = NORMAL
2016-04-21 17:03:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672318  14 57499 61395378 A NORMALNORMAL'
2016-04-21 17:03:17 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-21 17:03:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 17:03:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 17:03:52 [DEBUG   ] Finished updating board flags in 1.420 seconds
2016-04-21 17:03:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 17:04:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 17:04:29 [DEBUG   ] Got command RPT from MCS: ref #672322
2016-04-21 17:04:29 [DEBUG   ] summary = NORMAL
2016-04-21 17:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672322  14 57499 61469618 A NORMALNORMAL'
2016-04-21 17:04:29 [DEBUG   ] Got command RPT from MCS: ref #672323
2016-04-21 17:04:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 17:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672323  48 57499 61469618 A NORMALSystem calibrated and operating normally'
2016-04-21 17:04:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 17:04:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 17:04:52 [DEBUG   ] Finished updating board flags in 1.411 seconds
2016-04-21 17:04:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 17:05:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 17:05:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 17:05:52 [DEBUG   ] Finished updating board flags in 1.375 seconds
2016-04-21 17:05:58 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2016-04-21 17:06:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 17:06:38 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-21 17:06:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 17:06:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 17:06:52 [DEBUG   ] Finished updating board flags in 1.367 seconds
2016-04-21 17:06:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 17:07:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 17:07:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 17:07:53 [DEBUG   ] Finished updating board flags in 2.059 seconds
2016-04-21 17:07:58 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 17:08:15 [DEBUG   ] Got command RPT from MCS: ref #672343
2016-04-21 17:08:15 [DEBUG   ] summary = NORMAL
2016-04-21 17:08:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672343  14 57499 61695462 A NORMALNORMAL'
2016-04-21 17:08:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 17:08:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 17:08:53 [DEBUG   ] Finished updating board flags in 1.993 seconds
2016-04-21 17:08:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 17:09:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 17:09:29 [DEBUG   ] Got command RPT from MCS: ref #672349
2016-04-21 17:09:29 [DEBUG   ] summary = NORMAL
2016-04-21 17:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672349  14 57499 61769610 A NORMALNORMAL'
2016-04-21 17:09:29 [DEBUG   ] Got command RPT from MCS: ref #672350
2016-04-21 17:09:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 17:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672350  48 57499 61769610 A NORMALSystem calibrated and operating normally'
2016-04-21 17:09:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 17:09:53 [DEBUG   ] Finished updating board flags in 1.806 seconds
2016-04-21 17:09:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 17:10:18 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 17:10:39 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2016-04-21 17:10:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 17:10:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 17:10:53 [DEBUG   ] Finished updating board flags in 1.789 seconds
2016-04-21 17:10:58 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2016-04-21 17:11:19 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2016-04-21 17:11:39 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2016-04-21 17:11:53 [DEBUG   ] Finished updating board flags in 1.617 seconds
2016-04-21 17:11:59 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-21 17:12:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 17:12:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 17:12:53 [DEBUG   ] Finished updating board flags in 1.588 seconds
2016-04-21 17:12:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 17:13:15 [DEBUG   ] Got command RPT from MCS: ref #672369
2016-04-21 17:13:15 [DEBUG   ] summary = NORMAL
2016-04-21 17:13:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672369  14 57499 61995542 A NORMALNORMAL'
2016-04-21 17:13:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 17:13:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 17:13:53 [DEBUG   ] Finished updating board flags in 1.412 seconds
2016-04-21 17:13:59 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 17:14:19 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2016-04-21 17:14:29 [DEBUG   ] Got command RPT from MCS: ref #672373
2016-04-21 17:14:29 [DEBUG   ] summary = NORMAL
2016-04-21 17:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672373  14 57499 62069618 A NORMALNORMAL'
2016-04-21 17:14:29 [DEBUG   ] Got command RPT from MCS: ref #672374
2016-04-21 17:14:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 17:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672374  48 57499 62069618 A NORMALSystem calibrated and operating normally'
2016-04-21 17:14:40 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2016-04-21 17:14:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 17:14:53 [DEBUG   ] Finished updating board flags in 1.392 seconds
2016-04-21 17:15:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 17:15:20 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-21 17:15:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 17:15:53 [DEBUG   ] Finished updating board flags in 1.378 seconds
2016-04-21 17:16:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 17:16:20 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 17:16:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 17:16:54 [DEBUG   ] Finished updating board flags in 2.036 seconds
2016-04-21 17:17:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 17:17:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 17:17:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 17:17:54 [DEBUG   ] Finished updating board flags in 1.995 seconds
2016-04-21 17:18:00 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2016-04-21 17:18:15 [DEBUG   ] Got command RPT from MCS: ref #672394
2016-04-21 17:18:15 [DEBUG   ] summary = NORMAL
2016-04-21 17:18:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672394  14 57499 62295630 A NORMALNORMAL'
2016-04-21 17:18:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 17:18:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 17:18:54 [DEBUG   ] Finished updating board flags in 1.847 seconds
2016-04-21 17:19:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 17:19:20 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-21 17:19:29 [DEBUG   ] Got command RPT from MCS: ref #672403
2016-04-21 17:19:29 [DEBUG   ] summary = NORMAL
2016-04-21 17:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672403  14 57499 62369622 A NORMALNORMAL'
2016-04-21 17:19:29 [DEBUG   ] Got command RPT from MCS: ref #672404
2016-04-21 17:19:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 17:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672404  48 57499 62369622 A NORMALSystem calibrated and operating normally'
2016-04-21 17:19:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 17:19:54 [DEBUG   ] Finished updating board flags in 1.757 seconds
2016-04-21 17:20:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 17:20:21 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-21 17:20:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 17:20:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 17:20:54 [DEBUG   ] Finished updating board flags in 1.611 seconds
2016-04-21 17:21:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 17:21:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 17:21:41 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 17:21:54 [DEBUG   ] Finished updating board flags in 1.587 seconds
2016-04-21 17:22:01 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2016-04-21 17:22:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 17:22:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 17:22:54 [DEBUG   ] Finished updating board flags in 1.411 seconds
2016-04-21 17:23:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-21 17:23:15 [DEBUG   ] Got command RPT from MCS: ref #672423
2016-04-21 17:23:15 [DEBUG   ] summary = NORMAL
2016-04-21 17:23:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672423  14 57499 62595702 A NORMALNORMAL'
2016-04-21 17:23:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 17:23:41 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 17:23:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 17:23:54 [DEBUG   ] Finished updating board flags in 1.443 seconds
2016-04-21 17:24:02 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2016-04-21 17:24:21 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2016-04-21 17:24:29 [DEBUG   ] Got command RPT from MCS: ref #672424
2016-04-21 17:24:29 [DEBUG   ] summary = NORMAL
2016-04-21 17:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672424  14 57499 62669614 A NORMALNORMAL'
2016-04-21 17:24:29 [DEBUG   ] Got command RPT from MCS: ref #672425
2016-04-21 17:24:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 17:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672425  48 57499 62669614 A NORMALSystem calibrated and operating normally'
2016-04-21 17:24:41 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 17:24:54 [DEBUG   ] Finished updating board flags in 1.353 seconds
2016-04-21 17:25:02 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2016-04-21 17:25:22 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-21 17:25:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 17:25:54 [DEBUG   ] Finished updating board flags in 1.366 seconds
2016-04-21 17:26:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 17:26:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 17:26:42 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 17:26:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 17:26:55 [DEBUG   ] Finished updating board flags in 2.058 seconds
2016-04-21 17:27:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 17:27:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 17:27:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 17:27:55 [DEBUG   ] Finished updating board flags in 1.992 seconds
2016-04-21 17:28:02 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-21 17:28:15 [DEBUG   ] Got command RPT from MCS: ref #672445
2016-04-21 17:28:15 [DEBUG   ] summary = NORMAL
2016-04-21 17:28:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672445  14 57499 62895802 A NORMALNORMAL'
2016-04-21 17:28:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 17:28:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 17:28:55 [DEBUG   ] Finished updating board flags in 1.824 seconds
2016-04-21 17:29:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 17:29:22 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-21 17:29:29 [DEBUG   ] Got command RPT from MCS: ref #672454
2016-04-21 17:29:29 [DEBUG   ] summary = NORMAL
2016-04-21 17:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672454  14 57499 62969622 A NORMALNORMAL'
2016-04-21 17:29:29 [DEBUG   ] Got command RPT from MCS: ref #672455
2016-04-21 17:29:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 17:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672455  48 57499 62969622 A NORMALSystem calibrated and operating normally'
2016-04-21 17:29:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 17:29:55 [DEBUG   ] Finished updating board flags in 1.761 seconds
2016-04-21 17:30:02 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2016-04-21 17:30:23 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-21 17:30:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 17:30:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 17:30:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 17:30:55 [DEBUG   ] Finished updating board flags in 1.624 seconds
2016-04-21 17:31:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 17:31:23 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-21 17:31:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 17:31:55 [DEBUG   ] Finished updating board flags in 1.605 seconds
2016-04-21 17:32:03 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2016-04-21 17:32:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 17:32:43 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 17:32:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 17:32:55 [DEBUG   ] Finished updating board flags in 1.613 seconds
2016-04-21 17:33:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 17:33:15 [DEBUG   ] Got command RPT from MCS: ref #672474
2016-04-21 17:33:15 [DEBUG   ] summary = NORMAL
2016-04-21 17:33:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672474  14 57499 63195886 A NORMALNORMAL'
2016-04-21 17:33:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 17:33:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 17:33:55 [DEBUG   ] Finished updating board flags in 1.565 seconds
2016-04-21 17:34:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 17:34:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 17:34:29 [DEBUG   ] Got command RPT from MCS: ref #672478
2016-04-21 17:34:29 [DEBUG   ] summary = NORMAL
2016-04-21 17:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672478  14 57499 63269614 A NORMALNORMAL'
2016-04-21 17:34:29 [DEBUG   ] Got command RPT from MCS: ref #672479
2016-04-21 17:34:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 17:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672479  48 57499 63269614 A NORMALSystem calibrated and operating normally'
2016-04-21 17:34:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 17:34:55 [DEBUG   ] Finished updating board flags in 1.423 seconds
2016-04-21 17:35:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 17:35:23 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-21 17:35:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 17:35:55 [DEBUG   ] Finished updating board flags in 1.384 seconds
2016-04-21 17:36:03 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 17:36:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-21 17:36:44 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2016-04-21 17:36:55 [DEBUG   ] Finished updating board flags in 1.361 seconds
2016-04-21 17:37:04 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-21 17:37:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 17:37:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 17:37:56 [DEBUG   ] Finished updating board flags in 2.048 seconds
2016-04-21 17:38:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 17:38:15 [DEBUG   ] Got command RPT from MCS: ref #672499
2016-04-21 17:38:15 [DEBUG   ] summary = NORMAL
2016-04-21 17:38:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672499  14 57499 63495970 A NORMALNORMAL'
2016-04-21 17:38:24 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-21 17:38:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 17:38:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 17:38:56 [DEBUG   ] Finished updating board flags in 2.010 seconds
2016-04-21 17:39:04 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-21 17:39:24 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2016-04-21 17:39:29 [DEBUG   ] Got command RPT from MCS: ref #672505
2016-04-21 17:39:29 [DEBUG   ] summary = NORMAL
2016-04-21 17:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672505  14 57499 63569618 A NORMALNORMAL'
2016-04-21 17:39:29 [DEBUG   ] Got command RPT from MCS: ref #672506
2016-04-21 17:39:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 17:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672506  48 57499 63569618 A NORMALSystem calibrated and operating normally'
2016-04-21 17:39:44 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-21 17:39:56 [DEBUG   ] Finished updating board flags in 1.985 seconds
2016-04-21 17:40:05 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2016-04-21 17:40:24 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2016-04-21 17:40:45 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2016-04-21 17:40:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 17:40:56 [DEBUG   ] Finished updating board flags in 1.820 seconds
2016-04-21 17:41:05 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-21 17:41:25 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-21 17:41:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 17:41:56 [DEBUG   ] Finished updating board flags in 1.789 seconds
2016-04-21 17:42:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 17:42:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 17:42:45 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2016-04-21 17:42:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 17:42:56 [DEBUG   ] Finished updating board flags in 1.609 seconds
2016-04-21 17:43:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 17:43:16 [DEBUG   ] Got command RPT from MCS: ref #672525
2016-04-21 17:43:16 [DEBUG   ] summary = NORMAL
2016-04-21 17:43:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672525  14 57499 63796046 A NORMALNORMAL'
2016-04-21 17:43:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 17:43:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 17:43:56 [DEBUG   ] Finished updating board flags in 1.612 seconds
2016-04-21 17:44:05 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2016-04-21 17:44:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 17:44:29 [DEBUG   ] Got command RPT from MCS: ref #672529
2016-04-21 17:44:29 [DEBUG   ] summary = NORMAL
2016-04-21 17:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672529  14 57499 63869622 A NORMALNORMAL'
2016-04-21 17:44:29 [DEBUG   ] Got command RPT from MCS: ref #672530
2016-04-21 17:44:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 17:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672530  48 57499 63869622 A NORMALSystem calibrated and operating normally'
2016-04-21 17:44:45 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2016-04-21 17:44:56 [DEBUG   ] Finished updating board flags in 1.589 seconds
2016-04-21 17:45:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 17:45:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 17:45:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 17:45:56 [DEBUG   ] Finished updating board flags in 1.409 seconds
2016-04-21 17:46:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 17:46:27 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2016-04-21 17:46:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 17:46:56 [DEBUG   ] Finished updating board flags in 1.390 seconds
2016-04-21 17:47:06 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2016-04-21 17:47:26 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-21 17:47:47 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2016-04-21 17:47:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 17:47:56 [DEBUG   ] Finished updating board flags in 1.367 seconds
2016-04-21 17:48:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 17:48:16 [DEBUG   ] Got command RPT from MCS: ref #672550
2016-04-21 17:48:16 [DEBUG   ] summary = NORMAL
2016-04-21 17:48:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672550  14 57499 64096134 A NORMALNORMAL'
2016-04-21 17:48:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 17:48:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 17:48:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 17:48:57 [DEBUG   ] Finished updating board flags in 2.102 seconds
2016-04-21 17:49:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 17:49:27 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2016-04-21 17:49:29 [DEBUG   ] Got command RPT from MCS: ref #672559
2016-04-21 17:49:29 [DEBUG   ] summary = NORMAL
2016-04-21 17:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672559  14 57499 64169618 A NORMALNORMAL'
2016-04-21 17:49:29 [DEBUG   ] Got command RPT from MCS: ref #672560
2016-04-21 17:49:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 17:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672560  48 57499 64169618 A NORMALSystem calibrated and operating normally'
2016-04-21 17:49:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 17:49:57 [DEBUG   ] Finished updating board flags in 1.936 seconds
2016-04-21 17:50:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 17:50:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 17:50:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 17:50:57 [DEBUG   ] Finished updating board flags in 1.820 seconds
2016-04-21 17:51:07 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-21 17:51:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 17:51:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 17:51:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 17:51:57 [DEBUG   ] Finished updating board flags in 1.781 seconds
2016-04-21 17:52:08 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2016-04-21 17:52:27 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2016-04-21 17:52:47 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-21 17:52:57 [DEBUG   ] Finished updating board flags in 1.612 seconds
2016-04-21 17:53:07 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2016-04-21 17:53:16 [DEBUG   ] Got command RPT from MCS: ref #672579
2016-04-21 17:53:16 [DEBUG   ] summary = NORMAL
2016-04-21 17:53:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672579  14 57499 64396210 A NORMALNORMAL'
2016-04-21 17:53:28 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-21 17:53:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 17:53:57 [DEBUG   ] Finished updating board flags in 1.611 seconds
2016-04-21 17:54:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 17:54:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 17:54:29 [DEBUG   ] Got command RPT from MCS: ref #672580
2016-04-21 17:54:29 [DEBUG   ] summary = NORMAL
2016-04-21 17:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672580  14 57499 64469618 A NORMALNORMAL'
2016-04-21 17:54:29 [DEBUG   ] Got command RPT from MCS: ref #672581
2016-04-21 17:54:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 17:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672581  48 57499 64469618 A NORMALSystem calibrated and operating normally'
2016-04-21 17:54:48 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2016-04-21 17:54:57 [DEBUG   ] Finished updating board flags in 1.581 seconds
2016-04-21 17:55:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 17:55:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 17:55:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 17:55:57 [DEBUG   ] Finished updating board flags in 1.418 seconds
2016-04-21 17:56:08 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-21 17:56:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 17:56:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 17:56:57 [DEBUG   ] Finished updating board flags in 1.389 seconds
2016-04-21 17:57:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 17:57:28 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-21 17:57:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 17:57:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 17:57:57 [DEBUG   ] Finished updating board flags in 1.373 seconds
2016-04-21 17:58:08 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-21 17:58:16 [DEBUG   ] Got command RPT from MCS: ref #672601
2016-04-21 17:58:16 [DEBUG   ] summary = NORMAL
2016-04-21 17:58:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672601  14 57499 64696298 A NORMALNORMAL'
2016-04-21 17:58:29 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2016-04-21 17:58:48 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2016-04-21 17:58:58 [DEBUG   ] Finished updating board flags in 2.042 seconds
2016-04-21 17:59:08 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-21 17:59:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 17:59:29 [DEBUG   ] Got command RPT from MCS: ref #672610
2016-04-21 17:59:29 [DEBUG   ] summary = NORMAL
2016-04-21 17:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672610  14 57499 64769622 A NORMALNORMAL'
2016-04-21 17:59:29 [DEBUG   ] Got command RPT from MCS: ref #672611
2016-04-21 17:59:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 17:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672611  48 57499 64769622 A NORMALSystem calibrated and operating normally'
2016-04-21 17:59:49 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2016-04-21 17:59:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 17:59:58 [DEBUG   ] Finished updating board flags in 1.989 seconds
2016-04-21 18:00:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 18:00:29 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2016-04-21 18:00:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 18:00:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 18:00:58 [DEBUG   ] Finished updating board flags in 1.811 seconds
2016-04-21 18:01:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 18:01:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 18:01:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 18:01:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 18:01:58 [DEBUG   ] Finished updating board flags in 1.799 seconds
2016-04-21 18:02:09 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-21 18:02:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 18:02:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 18:02:58 [DEBUG   ] Finished updating board flags in 1.601 seconds
2016-04-21 18:03:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-21 18:03:16 [DEBUG   ] Got command RPT from MCS: ref #672630
2016-04-21 18:03:16 [DEBUG   ] summary = NORMAL
2016-04-21 18:03:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672630  14 57499 64996370 A NORMALNORMAL'
2016-04-21 18:03:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2016-04-21 18:03:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 18:03:58 [DEBUG   ] Finished updating board flags in 1.613 seconds
2016-04-21 18:04:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 18:04:29 [DEBUG   ] Got command RPT from MCS: ref #672634
2016-04-21 18:04:29 [DEBUG   ] summary = NORMAL
2016-04-21 18:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672634  14 57499 65069626 A NORMALNORMAL'
2016-04-21 18:04:29 [DEBUG   ] Got command RPT from MCS: ref #672635
2016-04-21 18:04:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 18:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672635  48 57499 65069626 A NORMALSystem calibrated and operating normally'
2016-04-21 18:04:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 18:04:50 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 18:04:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 18:04:58 [DEBUG   ] Finished updating board flags in 1.576 seconds
2016-04-21 18:05:10 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2016-04-21 18:05:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 18:05:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 18:05:58 [DEBUG   ] Finished updating board flags in 1.425 seconds
2016-04-21 18:06:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2016-04-21 18:06:31 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2016-04-21 18:06:51 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-21 18:06:58 [DEBUG   ] Finished updating board flags in 1.390 seconds
2016-04-21 18:07:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 18:07:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 18:07:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 18:07:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 18:07:58 [DEBUG   ] Finished updating board flags in 1.365 seconds
2016-04-21 18:08:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 18:08:16 [DEBUG   ] Got command RPT from MCS: ref #672655
2016-04-21 18:08:16 [DEBUG   ] summary = NORMAL
2016-04-21 18:08:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672655  14 57499 65296442 A NORMALNORMAL'
2016-04-21 18:08:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 18:08:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 18:08:59 [DEBUG   ] Finished updating board flags in 2.052 seconds
2016-04-21 18:09:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 18:09:29 [DEBUG   ] Got command RPT from MCS: ref #672661
2016-04-21 18:09:29 [DEBUG   ] summary = NORMAL
2016-04-21 18:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672661  14 57499 65369626 A NORMALNORMAL'
2016-04-21 18:09:29 [DEBUG   ] Got command RPT from MCS: ref #672662
2016-04-21 18:09:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 18:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672662  48 57499 65369626 A NORMALSystem calibrated and operating normally'
2016-04-21 18:09:31 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-21 18:09:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 18:09:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 18:09:59 [DEBUG   ] Finished updating board flags in 1.981 seconds
2016-04-21 18:10:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 18:10:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 18:10:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 18:10:59 [DEBUG   ] Finished updating board flags in 1.816 seconds
2016-04-21 18:11:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 18:11:31 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-21 18:11:52 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-21 18:11:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 18:11:59 [DEBUG   ] Finished updating board flags in 1.782 seconds
2016-04-21 18:12:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 18:12:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 18:12:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 18:12:59 [DEBUG   ] Finished updating board flags in 1.624 seconds
2016-04-21 18:13:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 18:13:16 [DEBUG   ] Got command RPT from MCS: ref #672681
2016-04-21 18:13:16 [DEBUG   ] summary = NORMAL
2016-04-21 18:13:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672681  14 57499 65596506 A NORMALNORMAL'
2016-04-21 18:13:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 18:13:52 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 18:13:59 [DEBUG   ] Finished updating board flags in 1.587 seconds
2016-04-21 18:14:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 18:14:29 [DEBUG   ] Got command RPT from MCS: ref #672685
2016-04-21 18:14:29 [DEBUG   ] summary = NORMAL
2016-04-21 18:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672685  14 57499 65669626 A NORMALNORMAL'
2016-04-21 18:14:29 [DEBUG   ] Got command RPT from MCS: ref #672686
2016-04-21 18:14:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-21 18:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672686  48 57499 65669626 A NORMALSystem calibrated and operating normally'
2016-04-21 18:14:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 18:14:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 18:14:59 [DEBUG   ] Finished updating board flags in 1.412 seconds
2016-04-21 18:15:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 18:15:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 18:15:52 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-21 18:15:59 [DEBUG   ] Finished updating board flags in 1.402 seconds
2016-04-21 18:16:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 18:16:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 18:16:53 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-21 18:16:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 18:16:59 [DEBUG   ] Finished updating board flags in 1.401 seconds
2016-04-21 18:17:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 18:17:33 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-21 18:17:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 18:17:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 1, top port
2016-04-21 18:17:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 18:17:59 [CRITICAL] MGT underflow detected on beam(s) 4
2016-04-21 18:17:59 [DEBUG   ] Finished updating board flags in 1.413 seconds
2016-04-21 18:18:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 18:18:16 [DEBUG   ] Got command RPT from MCS: ref #672711
2016-04-21 18:18:16 [DEBUG   ] summary = ERROR
2016-04-21 18:18:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672711  13 57499 65896586 A  ERRORERROR'
2016-04-21 18:18:16 [DEBUG   ] Got command RPT from MCS: ref #672712
2016-04-21 18:18:16 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:18:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672712  77 57499 65896790 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:18:16 [DEBUG   ] Got command RPT from MCS: ref #672713
2016-04-21 18:18:16 [DEBUG   ] summary = ERROR
2016-04-21 18:18:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672713  13 57499 65896994 A  ERRORERROR'
2016-04-21 18:18:17 [DEBUG   ] Got command RPT from MCS: ref #672714
2016-04-21 18:18:17 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672714  77 57499 65897198 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:18:17 [DEBUG   ] Got command RPT from MCS: ref #672715
2016-04-21 18:18:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 18:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672715  12 57499 65897390 A  ERRORB�ÌÍ'
2016-04-21 18:18:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 18:18:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 18:18:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-21 18:18:59 [DEBUG   ] Finished updating board flags in 1.380 seconds
2016-04-21 18:19:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 18:19:29 [DEBUG   ] Got command RPT from MCS: ref #672724
2016-04-21 18:19:29 [DEBUG   ] summary = ERROR
2016-04-21 18:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672724  13 57499 65969630 A  ERRORERROR'
2016-04-21 18:19:29 [DEBUG   ] Got command RPT from MCS: ref #672725
2016-04-21 18:19:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672725  77 57499 65969630 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:19:33 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-21 18:19:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 18:19:59 [DEBUG   ] Finished updating board flags in 1.393 seconds
2016-04-21 18:20:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 18:20:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 18:20:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 18:21:00 [DEBUG   ] Finished updating board flags in 2.022 seconds
2016-04-21 18:21:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 18:21:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-21 18:21:54 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2016-04-21 18:22:00 [DEBUG   ] Finished updating board flags in 1.985 seconds
2016-04-21 18:22:13 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2016-04-21 18:22:33 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2016-04-21 18:22:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 18:23:00 [DEBUG   ] Finished updating board flags in 1.811 seconds
2016-04-21 18:23:14 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-21 18:23:16 [DEBUG   ] Got command RPT from MCS: ref #672744
2016-04-21 18:23:16 [DEBUG   ] summary = ERROR
2016-04-21 18:23:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672744  13 57499 66196678 A  ERRORERROR'
2016-04-21 18:23:16 [DEBUG   ] Got command RPT from MCS: ref #672745
2016-04-21 18:23:16 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:23:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672745  77 57499 66196882 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:23:17 [DEBUG   ] Got command RPT from MCS: ref #672746
2016-04-21 18:23:17 [DEBUG   ] summary = ERROR
2016-04-21 18:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672746  13 57499 66197086 A  ERRORERROR'
2016-04-21 18:23:17 [DEBUG   ] Got command RPT from MCS: ref #672747
2016-04-21 18:23:17 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672747  77 57499 66197278 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:23:17 [DEBUG   ] Got command RPT from MCS: ref #672748
2016-04-21 18:23:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 18:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672748  12 57499 66197482 A  ERRORB‹ÌÍ'
2016-04-21 18:23:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 18:23:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 18:24:00 [DEBUG   ] Finished updating board flags in 1.788 seconds
2016-04-21 18:24:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 18:24:29 [DEBUG   ] Got command RPT from MCS: ref #672749
2016-04-21 18:24:29 [DEBUG   ] summary = ERROR
2016-04-21 18:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672749  13 57499 66269630 A  ERRORERROR'
2016-04-21 18:24:29 [DEBUG   ] Got command RPT from MCS: ref #672750
2016-04-21 18:24:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672750  77 57499 66269630 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:24:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 18:24:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 18:25:00 [DEBUG   ] Finished updating board flags in 1.709 seconds
2016-04-21 18:25:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-21 18:25:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 18:25:54 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-21 18:26:00 [DEBUG   ] Finished updating board flags in 1.488 seconds
2016-04-21 18:26:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 18:26:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-21 18:26:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 18:26:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 18:27:00 [DEBUG   ] Finished updating board flags in 1.417 seconds
2016-04-21 18:27:15 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2016-04-21 18:27:35 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-21 18:27:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 18:28:00 [DEBUG   ] Finished updating board flags in 1.411 seconds
2016-04-21 18:28:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 18:28:16 [DEBUG   ] Got command RPT from MCS: ref #672770
2016-04-21 18:28:16 [DEBUG   ] summary = ERROR
2016-04-21 18:28:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672770  13 57499 66496758 A  ERRORERROR'
2016-04-21 18:28:16 [DEBUG   ] Got command RPT from MCS: ref #672771
2016-04-21 18:28:16 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:28:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672771  77 57499 66496962 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:28:17 [DEBUG   ] Got command RPT from MCS: ref #672772
2016-04-21 18:28:17 [DEBUG   ] summary = ERROR
2016-04-21 18:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672772  13 57499 66497166 A  ERRORERROR'
2016-04-21 18:28:17 [DEBUG   ] Got command RPT from MCS: ref #672773
2016-04-21 18:28:17 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672773  77 57499 66497358 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:28:17 [DEBUG   ] Got command RPT from MCS: ref #672774
2016-04-21 18:28:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 18:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672774  12 57499 66497562 A  ERRORBŒÌÍ'
2016-04-21 18:28:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 18:28:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 18:29:00 [DEBUG   ] Finished updating board flags in 1.384 seconds
2016-04-21 18:29:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 18:29:29 [DEBUG   ] Got command RPT from MCS: ref #672783
2016-04-21 18:29:29 [DEBUG   ] summary = ERROR
2016-04-21 18:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672783  13 57499 66569626 A  ERRORERROR'
2016-04-21 18:29:29 [DEBUG   ] Got command RPT from MCS: ref #672784
2016-04-21 18:29:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672784  77 57499 66569626 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:29:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 18:29:55 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-21 18:30:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 18:30:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 18:30:00 [DEBUG   ] Finished updating board flags in 1.390 seconds
2016-04-21 18:30:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 18:30:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 18:30:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 18:31:01 [DEBUG   ] Finished updating board flags in 2.034 seconds
2016-04-21 18:31:15 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-21 18:31:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 18:31:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 18:32:01 [DEBUG   ] Finished updating board flags in 2.000 seconds
2016-04-21 18:32:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 18:32:35 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-21 18:32:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-21 18:33:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 18:33:01 [DEBUG   ] Finished updating board flags in 2.029 seconds
2016-04-21 18:33:16 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2016-04-21 18:33:16 [DEBUG   ] Got command RPT from MCS: ref #672803
2016-04-21 18:33:16 [DEBUG   ] summary = ERROR
2016-04-21 18:33:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672803  13 57499 66796842 A  ERRORERROR'
2016-04-21 18:33:17 [DEBUG   ] Got command RPT from MCS: ref #672804
2016-04-21 18:33:17 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:33:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672804  77 57499 66797046 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:33:17 [DEBUG   ] Got command RPT from MCS: ref #672805
2016-04-21 18:33:17 [DEBUG   ] summary = ERROR
2016-04-21 18:33:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672805  13 57499 66797238 A  ERRORERROR'
2016-04-21 18:33:17 [DEBUG   ] Got command RPT from MCS: ref #672806
2016-04-21 18:33:17 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:33:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672806  77 57499 66797442 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:33:17 [DEBUG   ] Got command RPT from MCS: ref #672807
2016-04-21 18:33:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 18:33:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672807  12 57499 66797646 A  ERRORB‹ÌÍ'
2016-04-21 18:33:36 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-21 18:33:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 18:34:01 [DEBUG   ] Finished updating board flags in 1.960 seconds
2016-04-21 18:34:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 18:34:29 [DEBUG   ] Got command RPT from MCS: ref #672811
2016-04-21 18:34:29 [DEBUG   ] summary = ERROR
2016-04-21 18:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672811  13 57499 66869630 A  ERRORERROR'
2016-04-21 18:34:29 [DEBUG   ] Got command RPT from MCS: ref #672812
2016-04-21 18:34:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672812  77 57499 66869630 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:34:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 18:34:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 18:35:01 [DEBUG   ] Finished updating board flags in 1.818 seconds
2016-04-21 18:35:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 18:35:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 18:35:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 18:36:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 18:36:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 18:36:01 [DEBUG   ] Finished updating board flags in 1.807 seconds
2016-04-21 18:36:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 18:36:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 18:36:56 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-21 18:37:01 [DEBUG   ] Finished updating board flags in 1.779 seconds
2016-04-21 18:37:16 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2016-04-21 18:37:36 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-21 18:37:56 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2016-04-21 18:38:01 [DEBUG   ] Finished updating board flags in 1.622 seconds
2016-04-21 18:38:16 [DEBUG   ] Got command RPT from MCS: ref #672832
2016-04-21 18:38:16 [DEBUG   ] summary = ERROR
2016-04-21 18:38:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672832  13 57499 67096918 A  ERRORERROR'
2016-04-21 18:38:17 [DEBUG   ] Got command RPT from MCS: ref #672833
2016-04-21 18:38:17 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:38:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672833  77 57499 67097122 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:38:17 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2016-04-21 18:38:17 [DEBUG   ] Got command RPT from MCS: ref #672834
2016-04-21 18:38:17 [DEBUG   ] summary = ERROR
2016-04-21 18:38:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672834  13 57499 67097326 A  ERRORERROR'
2016-04-21 18:38:17 [DEBUG   ] Got command RPT from MCS: ref #672835
2016-04-21 18:38:17 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:38:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672835  77 57499 67097518 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:38:17 [DEBUG   ] Got command RPT from MCS: ref #672836
2016-04-21 18:38:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 18:38:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672836  12 57499 67097722 A  ERRORBŒÌÍ'
2016-04-21 18:38:37 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-21 18:38:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 18:39:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 18:39:01 [DEBUG   ] Finished updating board flags in 1.585 seconds
2016-04-21 18:39:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 18:39:29 [DEBUG   ] Got command RPT from MCS: ref #672842
2016-04-21 18:39:29 [DEBUG   ] summary = ERROR
2016-04-21 18:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672842  13 57499 67169634 A  ERRORERROR'
2016-04-21 18:39:29 [DEBUG   ] Got command RPT from MCS: ref #672843
2016-04-21 18:39:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672843  77 57499 67169634 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:39:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 18:39:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 18:40:01 [DEBUG   ] Finished updating board flags in 1.420 seconds
2016-04-21 18:40:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 18:40:37 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2016-04-21 18:40:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 18:41:01 [DEBUG   ] Finished updating board flags in 1.381 seconds
2016-04-21 18:41:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 18:41:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 18:41:57 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-21 18:42:01 [DEBUG   ] Finished updating board flags in 1.376 seconds
2016-04-21 18:42:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 18:42:38 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2016-04-21 18:42:58 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2016-04-21 18:43:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 18:43:02 [DEBUG   ] Finished updating board flags in 2.042 seconds
2016-04-21 18:43:17 [DEBUG   ] Got command RPT from MCS: ref #672862
2016-04-21 18:43:17 [DEBUG   ] summary = ERROR
2016-04-21 18:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672862  13 57499 67397006 A  ERRORERROR'
2016-04-21 18:43:17 [DEBUG   ] Got command RPT from MCS: ref #672863
2016-04-21 18:43:17 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672863  77 57499 67397210 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:43:17 [DEBUG   ] Got command RPT from MCS: ref #672864
2016-04-21 18:43:17 [DEBUG   ] summary = ERROR
2016-04-21 18:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672864  13 57499 67397414 A  ERRORERROR'
2016-04-21 18:43:17 [DEBUG   ] Got command RPT from MCS: ref #672865
2016-04-21 18:43:17 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672865  77 57499 67397606 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:43:17 [DEBUG   ] Got command RPT from MCS: ref #672866
2016-04-21 18:43:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 18:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672866  12 57499 67397810 A  ERRORB�ÌÍ'
2016-04-21 18:43:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 18:43:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 18:43:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 18:44:02 [DEBUG   ] Finished updating board flags in 1.984 seconds
2016-04-21 18:44:18 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 18:44:29 [DEBUG   ] Got command RPT from MCS: ref #672870
2016-04-21 18:44:29 [DEBUG   ] summary = ERROR
2016-04-21 18:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672870  13 57499 67469630 A  ERRORERROR'
2016-04-21 18:44:29 [DEBUG   ] Got command RPT from MCS: ref #672871
2016-04-21 18:44:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672871  77 57499 67469630 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:44:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 18:44:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 18:45:02 [DEBUG   ] Finished updating board flags in 1.822 seconds
2016-04-21 18:45:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 18:45:38 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-21 18:45:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 18:46:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 18:46:02 [DEBUG   ] Finished updating board flags in 1.784 seconds
2016-04-21 18:46:19 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-21 18:46:39 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-21 18:46:59 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-21 18:47:02 [DEBUG   ] Finished updating board flags in 1.612 seconds
2016-04-21 18:47:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 18:47:39 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-21 18:47:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 18:48:02 [DEBUG   ] Finished updating board flags in 1.593 seconds
2016-04-21 18:48:17 [DEBUG   ] Got command RPT from MCS: ref #672891
2016-04-21 18:48:17 [DEBUG   ] summary = ERROR
2016-04-21 18:48:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672891  13 57499 67697086 A  ERRORERROR'
2016-04-21 18:48:17 [DEBUG   ] Got command RPT from MCS: ref #672892
2016-04-21 18:48:17 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:48:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672892  77 57499 67697494 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:48:17 [DEBUG   ] Got command RPT from MCS: ref #672893
2016-04-21 18:48:17 [DEBUG   ] summary = ERROR
2016-04-21 18:48:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672893  13 57499 67697686 A  ERRORERROR'
2016-04-21 18:48:17 [DEBUG   ] Got command RPT from MCS: ref #672894
2016-04-21 18:48:17 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:48:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672894  77 57499 67697890 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:48:18 [DEBUG   ] Got command RPT from MCS: ref #672895
2016-04-21 18:48:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 18:48:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672895  12 57499 67698094 A  ERRORB‹ÌÍ'
2016-04-21 18:48:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 18:48:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 18:48:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 18:49:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 18:49:02 [DEBUG   ] Finished updating board flags in 1.415 seconds
2016-04-21 18:49:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 18:49:29 [DEBUG   ] Got command RPT from MCS: ref #672904
2016-04-21 18:49:29 [DEBUG   ] summary = ERROR
2016-04-21 18:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672904  13 57499 67769634 A  ERRORERROR'
2016-04-21 18:49:29 [DEBUG   ] Got command RPT from MCS: ref #672905
2016-04-21 18:49:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672905  77 57499 67769634 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:49:39 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-21 18:50:00 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2016-04-21 18:50:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 18:50:02 [DEBUG   ] Finished updating board flags in 1.385 seconds
2016-04-21 18:50:19 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2016-04-21 18:50:40 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2016-04-21 18:51:00 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2016-04-21 18:51:02 [DEBUG   ] Finished updating board flags in 1.357 seconds
2016-04-21 18:51:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 18:51:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 18:52:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 18:52:03 [DEBUG   ] Finished updating board flags in 2.060 seconds
2016-04-21 18:52:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 18:52:40 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 18:53:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 18:53:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 18:53:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 18:53:03 [DEBUG   ] Finished updating board flags in 2.041 seconds
2016-04-21 18:53:17 [DEBUG   ] Got command RPT from MCS: ref #672924
2016-04-21 18:53:17 [DEBUG   ] summary = ERROR
2016-04-21 18:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672924  13 57499 67997170 A  ERRORERROR'
2016-04-21 18:53:17 [DEBUG   ] Got command RPT from MCS: ref #672925
2016-04-21 18:53:17 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672925  77 57499 67997374 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:53:17 [DEBUG   ] Got command RPT from MCS: ref #672926
2016-04-21 18:53:17 [DEBUG   ] summary = ERROR
2016-04-21 18:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672926  13 57499 67997566 A  ERRORERROR'
2016-04-21 18:53:17 [DEBUG   ] Got command RPT from MCS: ref #672927
2016-04-21 18:53:17 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672927  77 57499 67997770 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:53:17 [DEBUG   ] Got command RPT from MCS: ref #672928
2016-04-21 18:53:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 18:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672928  12 57499 67997974 A  ERRORB�ÌÍ'
2016-04-21 18:53:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 18:53:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 18:54:00 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-21 18:54:03 [DEBUG   ] Finished updating board flags in 2.017 seconds
2016-04-21 18:54:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 18:54:29 [DEBUG   ] Got command RPT from MCS: ref #672929
2016-04-21 18:54:29 [DEBUG   ] summary = ERROR
2016-04-21 18:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672929  13 57499 68069634 A  ERRORERROR'
2016-04-21 18:54:29 [DEBUG   ] Got command RPT from MCS: ref #672930
2016-04-21 18:54:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672930  77 57499 68069634 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:54:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 18:55:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-21 18:55:03 [DEBUG   ] Finished updating board flags in 1.942 seconds
2016-04-21 18:55:21 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2016-04-21 18:55:41 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-21 18:56:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 18:56:03 [DEBUG   ] Finished updating board flags in 1.799 seconds
2016-04-21 18:56:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 18:56:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 18:57:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 18:57:03 [DEBUG   ] Finished updating board flags in 1.618 seconds
2016-04-21 18:57:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 18:57:41 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 18:58:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 18:58:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 18:58:03 [DEBUG   ] Finished updating board flags in 1.587 seconds
2016-04-21 18:58:17 [DEBUG   ] Got command RPT from MCS: ref #672950
2016-04-21 18:58:17 [DEBUG   ] summary = ERROR
2016-04-21 18:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672950  13 57499 68297258 A  ERRORERROR'
2016-04-21 18:58:17 [DEBUG   ] Got command RPT from MCS: ref #672951
2016-04-21 18:58:17 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672951  77 57499 68297450 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:58:17 [DEBUG   ] Got command RPT from MCS: ref #672952
2016-04-21 18:58:17 [DEBUG   ] summary = ERROR
2016-04-21 18:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672952  13 57499 68297654 A  ERRORERROR'
2016-04-21 18:58:17 [DEBUG   ] Got command RPT from MCS: ref #672953
2016-04-21 18:58:17 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672953  77 57499 68297858 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:58:18 [DEBUG   ] Got command RPT from MCS: ref #672954
2016-04-21 18:58:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 18:58:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672954  12 57499 68298062 A  ERRORB‹ÌÍ'
2016-04-21 18:58:21 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2016-04-21 18:58:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 18:59:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-21 18:59:03 [DEBUG   ] Finished updating board flags in 1.425 seconds
2016-04-21 18:59:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 18:59:29 [DEBUG   ] Got command RPT from MCS: ref #672963
2016-04-21 18:59:29 [DEBUG   ] summary = ERROR
2016-04-21 18:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672963  13 57499 68369638 A  ERRORERROR'
2016-04-21 18:59:29 [DEBUG   ] Got command RPT from MCS: ref #672964
2016-04-21 18:59:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 18:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672964  77 57499 68369638 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 18:59:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 19:00:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-21 19:00:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 19:00:03 [DEBUG   ] Finished updating board flags in 1.383 seconds
2016-04-21 19:00:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 19:00:41 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 19:01:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 19:01:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 19:01:03 [DEBUG   ] Finished updating board flags in 1.354 seconds
2016-04-21 19:01:22 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2016-04-21 19:01:42 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2016-04-21 19:02:02 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-21 19:02:04 [DEBUG   ] Finished updating board flags in 2.061 seconds
2016-04-21 19:02:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 19:02:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 19:03:02 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 19:03:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 19:03:04 [DEBUG   ] Finished updating board flags in 1.992 seconds
2016-04-21 19:03:17 [DEBUG   ] Got command RPT from MCS: ref #672983
2016-04-21 19:03:17 [DEBUG   ] summary = ERROR
2016-04-21 19:03:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672983  13 57499 68597330 A  ERRORERROR'
2016-04-21 19:03:17 [DEBUG   ] Got command RPT from MCS: ref #672984
2016-04-21 19:03:17 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:03:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672984  77 57499 68597534 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:03:17 [DEBUG   ] Got command RPT from MCS: ref #672985
2016-04-21 19:03:17 [DEBUG   ] summary = ERROR
2016-04-21 19:03:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672985  13 57499 68597738 A  ERRORERROR'
2016-04-21 19:03:17 [DEBUG   ] Got command RPT from MCS: ref #672986
2016-04-21 19:03:17 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:03:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672986  77 57499 68597942 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:03:18 [DEBUG   ] Got command RPT from MCS: ref #672987
2016-04-21 19:03:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 19:03:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672987  12 57499 68598134 A  ERRORBŠÌÍ'
2016-04-21 19:03:22 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 19:03:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 19:04:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 19:04:04 [DEBUG   ] Finished updating board flags in 1.802 seconds
2016-04-21 19:04:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 19:04:29 [DEBUG   ] Got command RPT from MCS: ref #672991
2016-04-21 19:04:29 [DEBUG   ] summary = ERROR
2016-04-21 19:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672991  13 57499 68669642 A  ERRORERROR'
2016-04-21 19:04:29 [DEBUG   ] Got command RPT from MCS: ref #672992
2016-04-21 19:04:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   672992  77 57499 68669642 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:04:42 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 19:05:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2016-04-21 19:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2016-04-21 19:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2016-04-21 19:05:04 [DEBUG   ] Finished updating board flags in 1.800 seconds
2016-04-21 19:05:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 19:05:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2016-04-21 19:06:03 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2016-04-21 19:06:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2016-04-21 19:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2016-04-21 19:06:04 [DEBUG   ] Finished updating board flags in 1.624 seconds
2016-04-21 19:06:23 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-21 19:06:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 19:07:03 [DEBUG   ] Finished updating ant stats in 1.052 seconds
2016-04-21 19:07:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 19:07:04 [DEBUG   ] Finished updating board flags in 1.571 seconds
2016-04-21 19:07:23 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2016-04-21 19:07:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 19:08:03 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2016-04-21 19:08:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 19:08:04 [DEBUG   ] Finished updating board flags in 1.413 seconds
2016-04-21 19:08:17 [DEBUG   ] Got command RPT from MCS: ref #673012
2016-04-21 19:08:17 [DEBUG   ] summary = ERROR
2016-04-21 19:08:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673012  13 57499 68897426 A  ERRORERROR'
2016-04-21 19:08:17 [DEBUG   ] Got command RPT from MCS: ref #673013
2016-04-21 19:08:17 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:08:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673013  77 57499 68897630 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:08:17 [DEBUG   ] Got command RPT from MCS: ref #673014
2016-04-21 19:08:17 [DEBUG   ] summary = ERROR
2016-04-21 19:08:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673014  13 57499 68897822 A  ERRORERROR'
2016-04-21 19:08:18 [DEBUG   ] Got command RPT from MCS: ref #673015
2016-04-21 19:08:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673015  77 57499 68898026 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:08:18 [DEBUG   ] Got command RPT from MCS: ref #673016
2016-04-21 19:08:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 19:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673016  12 57499 68898230 A  ERRORBŠÌÍ'
2016-04-21 19:08:23 [DEBUG   ] Finished updating ant stats in 0.755 seconds
2016-04-21 19:08:43 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-21 19:09:03 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2016-04-21 19:09:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 19:09:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 19:09:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 19:09:04 [DEBUG   ] Finished updating board flags in 1.392 seconds
2016-04-21 19:09:23 [DEBUG   ] Finished updating ant stats in 0.551 seconds
2016-04-21 19:09:29 [DEBUG   ] Got command RPT from MCS: ref #673022
2016-04-21 19:09:29 [DEBUG   ] summary = ERROR
2016-04-21 19:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673022  13 57499 68969642 A  ERRORERROR'
2016-04-21 19:09:29 [DEBUG   ] Got command RPT from MCS: ref #673023
2016-04-21 19:09:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673023  77 57499 68969642 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:09:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-21 19:10:04 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2016-04-21 19:10:04 [DEBUG   ] Finished updating board flags in 1.354 seconds
2016-04-21 19:10:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 19:10:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 19:11:04 [DEBUG   ] Finished updating ant stats in 1.252 seconds
2016-04-21 19:11:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 19:11:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 19:11:05 [DEBUG   ] Finished updating board flags in 2.069 seconds
2016-04-21 19:11:24 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2016-04-21 19:11:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 19:12:04 [DEBUG   ] Finished updating ant stats in 0.851 seconds
2016-04-21 19:12:05 [DEBUG   ] Finished updating board flags in 1.985 seconds
2016-04-21 19:12:24 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2016-04-21 19:12:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 19:13:04 [DEBUG   ] Finished updating ant stats in 0.449 seconds
2016-04-21 19:13:05 [DEBUG   ] Finished updating board flags in 1.816 seconds
2016-04-21 19:13:17 [DEBUG   ] Got command RPT from MCS: ref #673042
2016-04-21 19:13:17 [DEBUG   ] summary = ERROR
2016-04-21 19:13:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673042  13 57499 69197514 A  ERRORERROR'
2016-04-21 19:13:17 [DEBUG   ] Got command RPT from MCS: ref #673043
2016-04-21 19:13:17 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:13:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673043  77 57499 69197706 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:13:17 [DEBUG   ] Got command RPT from MCS: ref #673044
2016-04-21 19:13:17 [DEBUG   ] summary = ERROR
2016-04-21 19:13:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673044  13 57499 69197910 A  ERRORERROR'
2016-04-21 19:13:18 [DEBUG   ] Got command RPT from MCS: ref #673045
2016-04-21 19:13:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:13:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673045  77 57499 69198114 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:13:18 [DEBUG   ] Got command RPT from MCS: ref #673046
2016-04-21 19:13:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 19:13:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673046  12 57499 69198318 A  ERRORB‹ÌÍ'
2016-04-21 19:13:25 [DEBUG   ] Finished updating ant stats in 1.357 seconds
2016-04-21 19:13:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 19:14:05 [DEBUG   ] Finished updating ant stats in 1.243 seconds
2016-04-21 19:14:05 [DEBUG   ] Finished updating board flags in 1.855 seconds
2016-04-21 19:14:25 [DEBUG   ] Finished updating ant stats in 1.160 seconds
2016-04-21 19:14:29 [DEBUG   ] Got command RPT from MCS: ref #673050
2016-04-21 19:14:29 [DEBUG   ] summary = ERROR
2016-04-21 19:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673050  13 57499 69269638 A  ERRORERROR'
2016-04-21 19:14:29 [DEBUG   ] Got command RPT from MCS: ref #673051
2016-04-21 19:14:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673051  77 57499 69269638 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:14:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 19:15:05 [DEBUG   ] Finished updating ant stats in 1.044 seconds
2016-04-21 19:15:05 [DEBUG   ] Finished updating board flags in 1.818 seconds
2016-04-21 19:15:25 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2016-04-21 19:15:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 19:16:05 [DEBUG   ] Finished updating ant stats in 0.843 seconds
2016-04-21 19:16:05 [DEBUG   ] Finished updating board flags in 1.785 seconds
2016-04-21 19:16:25 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2016-04-21 19:16:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 19:17:05 [DEBUG   ] Finished updating ant stats in 0.442 seconds
2016-04-21 19:17:05 [DEBUG   ] Finished updating board flags in 1.614 seconds
2016-04-21 19:17:26 [DEBUG   ] Finished updating ant stats in 1.360 seconds
2016-04-21 19:17:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 19:18:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 19:18:05 [DEBUG   ] Finished updating board flags in 1.562 seconds
2016-04-21 19:18:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 19:18:17 [DEBUG   ] Got command RPT from MCS: ref #673071
2016-04-21 19:18:17 [DEBUG   ] summary = ERROR
2016-04-21 19:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673071  13 57499 69497586 A  ERRORERROR'
2016-04-21 19:18:17 [DEBUG   ] Got command RPT from MCS: ref #673072
2016-04-21 19:18:17 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673072  77 57499 69497790 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:18:17 [DEBUG   ] Got command RPT from MCS: ref #673073
2016-04-21 19:18:17 [DEBUG   ] summary = ERROR
2016-04-21 19:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673073  13 57499 69497994 A  ERRORERROR'
2016-04-21 19:18:18 [DEBUG   ] Got command RPT from MCS: ref #673074
2016-04-21 19:18:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673074  77 57499 69498186 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:18:18 [DEBUG   ] Got command RPT from MCS: ref #673075
2016-04-21 19:18:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 19:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673075  12 57499 69498390 A  ERRORB‹ÌÍ'
2016-04-21 19:18:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 19:18:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 19:19:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 19:19:05 [DEBUG   ] Finished updating board flags in 1.472 seconds
2016-04-21 19:19:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-21 19:19:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 19:19:29 [DEBUG   ] Got command RPT from MCS: ref #673084
2016-04-21 19:19:29 [DEBUG   ] summary = ERROR
2016-04-21 19:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673084  13 57499 69569646 A  ERRORERROR'
2016-04-21 19:19:29 [DEBUG   ] Got command RPT from MCS: ref #673085
2016-04-21 19:19:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673085  77 57499 69569646 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:19:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 19:20:05 [DEBUG   ] Finished updating board flags in 1.464 seconds
2016-04-21 19:20:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 19:20:26 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2016-04-21 19:20:46 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2016-04-21 19:21:05 [DEBUG   ] Finished updating board flags in 1.454 seconds
2016-04-21 19:21:06 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2016-04-21 19:21:27 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2016-04-21 19:21:47 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2016-04-21 19:22:06 [DEBUG   ] Finished updating board flags in 2.241 seconds
2016-04-21 19:22:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 19:22:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 19:22:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 19:23:06 [DEBUG   ] Finished updating board flags in 2.193 seconds
2016-04-21 19:23:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 19:23:17 [DEBUG   ] Got command RPT from MCS: ref #673104
2016-04-21 19:23:17 [DEBUG   ] summary = ERROR
2016-04-21 19:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673104  13 57499 69797666 A  ERRORERROR'
2016-04-21 19:23:17 [DEBUG   ] Got command RPT from MCS: ref #673105
2016-04-21 19:23:17 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673105  77 57499 69797870 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:23:18 [DEBUG   ] Got command RPT from MCS: ref #673106
2016-04-21 19:23:18 [DEBUG   ] summary = ERROR
2016-04-21 19:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673106  13 57499 69798074 A  ERRORERROR'
2016-04-21 19:23:18 [DEBUG   ] Got command RPT from MCS: ref #673107
2016-04-21 19:23:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673107  77 57499 69798266 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:23:18 [DEBUG   ] Got command RPT from MCS: ref #673108
2016-04-21 19:23:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 19:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673108  12 57499 69798470 A  ERRORBŠÌÍ'
2016-04-21 19:23:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 19:23:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 19:24:06 [DEBUG   ] Finished updating board flags in 1.992 seconds
2016-04-21 19:24:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 19:24:27 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-21 19:24:29 [DEBUG   ] Got command RPT from MCS: ref #673109
2016-04-21 19:24:29 [DEBUG   ] summary = ERROR
2016-04-21 19:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673109  13 57499 69869638 A  ERRORERROR'
2016-04-21 19:24:29 [DEBUG   ] Got command RPT from MCS: ref #673110
2016-04-21 19:24:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673110  77 57499 69869638 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:24:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 19:25:06 [DEBUG   ] Finished updating board flags in 1.811 seconds
2016-04-21 19:25:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 19:25:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 19:25:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 19:26:06 [DEBUG   ] Finished updating board flags in 1.753 seconds
2016-04-21 19:26:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 19:26:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 19:26:48 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2016-04-21 19:27:06 [DEBUG   ] Finished updating board flags in 1.619 seconds
2016-04-21 19:27:07 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2016-04-21 19:27:28 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2016-04-21 19:27:48 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-21 19:28:06 [DEBUG   ] Finished updating board flags in 1.570 seconds
2016-04-21 19:28:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 19:28:17 [DEBUG   ] Got command RPT from MCS: ref #673130
2016-04-21 19:28:17 [DEBUG   ] summary = ERROR
2016-04-21 19:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673130  13 57499 70097758 A  ERRORERROR'
2016-04-21 19:28:17 [DEBUG   ] Got command RPT from MCS: ref #673131
2016-04-21 19:28:17 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673131  77 57499 70097962 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:28:18 [DEBUG   ] Got command RPT from MCS: ref #673132
2016-04-21 19:28:18 [DEBUG   ] summary = ERROR
2016-04-21 19:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673132  13 57499 70098166 A  ERRORERROR'
2016-04-21 19:28:18 [DEBUG   ] Got command RPT from MCS: ref #673133
2016-04-21 19:28:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673133  77 57499 70098358 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:28:18 [DEBUG   ] Got command RPT from MCS: ref #673134
2016-04-21 19:28:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 19:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673134  12 57499 70098562 A  ERRORB‹ÌÍ'
2016-04-21 19:28:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 19:28:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 19:29:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 19:29:06 [DEBUG   ] Finished updating board flags in 1.416 seconds
2016-04-21 19:29:08 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 19:29:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 19:29:29 [DEBUG   ] Got command RPT from MCS: ref #673143
2016-04-21 19:29:29 [DEBUG   ] summary = ERROR
2016-04-21 19:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673143  13 57499 70169646 A  ERRORERROR'
2016-04-21 19:29:29 [DEBUG   ] Got command RPT from MCS: ref #673144
2016-04-21 19:29:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673144  77 57499 70169646 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:29:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 19:30:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-21 19:30:06 [DEBUG   ] Finished updating board flags in 1.416 seconds
2016-04-21 19:30:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 19:30:28 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-21 19:30:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 19:31:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 19:31:06 [DEBUG   ] Finished updating board flags in 1.368 seconds
2016-04-21 19:31:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 19:31:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 19:31:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 19:32:06 [DEBUG   ] Finished updating board flags in 1.360 seconds
2016-04-21 19:32:08 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2016-04-21 19:32:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 19:32:49 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2016-04-21 19:33:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 19:33:07 [DEBUG   ] Finished updating board flags in 2.064 seconds
2016-04-21 19:33:09 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2016-04-21 19:33:17 [DEBUG   ] Got command RPT from MCS: ref #673163
2016-04-21 19:33:17 [DEBUG   ] summary = ERROR
2016-04-21 19:33:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673163  13 57499 70397834 A  ERRORERROR'
2016-04-21 19:33:18 [DEBUG   ] Got command RPT from MCS: ref #673164
2016-04-21 19:33:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673164  77 57499 70398038 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:33:18 [DEBUG   ] Got command RPT from MCS: ref #673165
2016-04-21 19:33:18 [DEBUG   ] summary = ERROR
2016-04-21 19:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673165  13 57499 70398242 A  ERRORERROR'
2016-04-21 19:33:18 [DEBUG   ] Got command RPT from MCS: ref #673166
2016-04-21 19:33:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673166  77 57499 70398434 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:33:18 [DEBUG   ] Got command RPT from MCS: ref #673167
2016-04-21 19:33:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 19:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673167  12 57499 70398638 A  ERRORBŠÌÍ'
2016-04-21 19:33:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 19:33:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 19:34:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 19:34:07 [DEBUG   ] Finished updating board flags in 1.983 seconds
2016-04-21 19:34:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 19:34:29 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 19:34:29 [DEBUG   ] Got command RPT from MCS: ref #673171
2016-04-21 19:34:29 [DEBUG   ] summary = ERROR
2016-04-21 19:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673171  13 57499 70469650 A  ERRORERROR'
2016-04-21 19:34:29 [DEBUG   ] Got command RPT from MCS: ref #673172
2016-04-21 19:34:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673172  77 57499 70469650 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:34:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 19:35:07 [DEBUG   ] Finished updating board flags in 1.823 seconds
2016-04-21 19:35:09 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2016-04-21 19:35:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 19:35:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 19:36:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 19:36:07 [DEBUG   ] Finished updating board flags in 1.790 seconds
2016-04-21 19:36:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 19:36:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 19:36:49 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2016-04-21 19:37:07 [DEBUG   ] Finished updating board flags in 1.609 seconds
2016-04-21 19:37:10 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2016-04-21 19:37:29 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2016-04-21 19:37:50 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2016-04-21 19:38:07 [DEBUG   ] Finished updating board flags in 1.626 seconds
2016-04-21 19:38:10 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2016-04-21 19:38:17 [DEBUG   ] Got command RPT from MCS: ref #673192
2016-04-21 19:38:17 [DEBUG   ] summary = ERROR
2016-04-21 19:38:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673192  13 57499 70697922 A  ERRORERROR'
2016-04-21 19:38:18 [DEBUG   ] Got command RPT from MCS: ref #673193
2016-04-21 19:38:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673193  77 57499 70698114 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:38:18 [DEBUG   ] Got command RPT from MCS: ref #673194
2016-04-21 19:38:18 [DEBUG   ] summary = ERROR
2016-04-21 19:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673194  13 57499 70698318 A  ERRORERROR'
2016-04-21 19:38:18 [DEBUG   ] Got command RPT from MCS: ref #673195
2016-04-21 19:38:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673195  77 57499 70698522 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:38:18 [DEBUG   ] Got command RPT from MCS: ref #673196
2016-04-21 19:38:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 19:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673196  12 57499 70698726 A  ERRORBŠÌÍ'
2016-04-21 19:38:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 19:38:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 19:39:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 19:39:07 [DEBUG   ] Finished updating board flags in 1.564 seconds
2016-04-21 19:39:10 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2016-04-21 19:39:29 [DEBUG   ] Got command RPT from MCS: ref #673202
2016-04-21 19:39:29 [DEBUG   ] summary = ERROR
2016-04-21 19:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673202  13 57499 70769650 A  ERRORERROR'
2016-04-21 19:39:29 [DEBUG   ] Got command RPT from MCS: ref #673203
2016-04-21 19:39:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673203  77 57499 70769650 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:39:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 19:39:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 19:40:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 19:40:07 [DEBUG   ] Finished updating board flags in 1.420 seconds
2016-04-21 19:40:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 19:40:30 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-21 19:40:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 19:41:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 19:41:07 [DEBUG   ] Finished updating board flags in 1.402 seconds
2016-04-21 19:41:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 19:41:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 19:41:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 19:42:07 [DEBUG   ] Finished updating board flags in 1.379 seconds
2016-04-21 19:42:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 19:42:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 19:42:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 19:43:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 19:43:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 19:43:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 19:43:07 [DEBUG   ] Finished updating board flags in 1.408 seconds
2016-04-21 19:43:11 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2016-04-21 19:43:17 [DEBUG   ] Got command RPT from MCS: ref #673222
2016-04-21 19:43:17 [DEBUG   ] summary = ERROR
2016-04-21 19:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673222  13 57499 70997994 A  ERRORERROR'
2016-04-21 19:43:18 [DEBUG   ] Got command RPT from MCS: ref #673223
2016-04-21 19:43:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:43:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673223  77 57499 70998198 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:43:18 [DEBUG   ] Got command RPT from MCS: ref #673224
2016-04-21 19:43:18 [DEBUG   ] summary = ERROR
2016-04-21 19:43:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673224  13 57499 70998390 A  ERRORERROR'
2016-04-21 19:43:18 [DEBUG   ] Got command RPT from MCS: ref #673225
2016-04-21 19:43:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:43:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673225  77 57499 70998594 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:43:18 [DEBUG   ] Got command RPT from MCS: ref #673226
2016-04-21 19:43:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 19:43:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673226  12 57499 70998798 A  ERRORB‹ÌÍ'
2016-04-21 19:43:30 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2016-04-21 19:43:50 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-21 19:44:07 [DEBUG   ] Finished updating board flags in 1.413 seconds
2016-04-21 19:44:11 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2016-04-21 19:44:29 [DEBUG   ] Got command RPT from MCS: ref #673230
2016-04-21 19:44:29 [DEBUG   ] summary = ERROR
2016-04-21 19:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673230  13 57499 71069646 A  ERRORERROR'
2016-04-21 19:44:29 [DEBUG   ] Got command RPT from MCS: ref #673231
2016-04-21 19:44:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673231  77 57499 71069646 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:44:31 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-21 19:44:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 19:45:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 19:45:08 [DEBUG   ] Finished updating board flags in 2.246 seconds
2016-04-21 19:45:11 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2016-04-21 19:45:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 19:45:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 19:46:08 [DEBUG   ] Finished updating board flags in 2.146 seconds
2016-04-21 19:46:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 19:46:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 19:46:52 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2016-04-21 19:47:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 19:47:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 19:47:08 [DEBUG   ] Finished updating board flags in 2.013 seconds
2016-04-21 19:47:12 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2016-04-21 19:47:32 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2016-04-21 19:47:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 19:48:08 [DEBUG   ] Finished updating board flags in 2.001 seconds
2016-04-21 19:48:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 19:48:18 [DEBUG   ] Got command RPT from MCS: ref #673251
2016-04-21 19:48:18 [DEBUG   ] summary = ERROR
2016-04-21 19:48:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673251  13 57499 71298090 A  ERRORERROR'
2016-04-21 19:48:18 [DEBUG   ] Got command RPT from MCS: ref #673252
2016-04-21 19:48:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:48:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673252  77 57499 71298282 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:48:18 [DEBUG   ] Got command RPT from MCS: ref #673253
2016-04-21 19:48:18 [DEBUG   ] summary = ERROR
2016-04-21 19:48:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673253  13 57499 71298474 A  ERRORERROR'
2016-04-21 19:48:18 [DEBUG   ] Got command RPT from MCS: ref #673254
2016-04-21 19:48:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:48:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673254  77 57499 71298678 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:48:18 [DEBUG   ] Got command RPT from MCS: ref #673255
2016-04-21 19:48:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 19:48:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673255  12 57499 71298882 A  ERRORBŠÌÍ'
2016-04-21 19:48:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 19:48:52 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 19:49:08 [DEBUG   ] Finished updating board flags in 2.019 seconds
2016-04-21 19:49:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 19:49:29 [DEBUG   ] Got command RPT from MCS: ref #673264
2016-04-21 19:49:29 [DEBUG   ] summary = ERROR
2016-04-21 19:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673264  13 57499 71369650 A  ERRORERROR'
2016-04-21 19:49:29 [DEBUG   ] Got command RPT from MCS: ref #673265
2016-04-21 19:49:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673265  77 57499 71369650 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:49:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 19:49:52 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 19:50:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 19:50:08 [DEBUG   ] Finished updating board flags in 1.979 seconds
2016-04-21 19:50:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 19:50:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 19:50:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 19:51:08 [DEBUG   ] Finished updating board flags in 1.824 seconds
2016-04-21 19:51:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 19:51:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 19:51:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 19:52:08 [DEBUG   ] Finished updating board flags in 1.778 seconds
2016-04-21 19:52:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 19:52:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 19:52:53 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2016-04-21 19:53:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 19:53:08 [DEBUG   ] Finished updating board flags in 1.630 seconds
2016-04-21 19:53:13 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2016-04-21 19:53:18 [DEBUG   ] Got command RPT from MCS: ref #673284
2016-04-21 19:53:18 [DEBUG   ] summary = ERROR
2016-04-21 19:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673284  13 57499 71598162 A  ERRORERROR'
2016-04-21 19:53:18 [DEBUG   ] Got command RPT from MCS: ref #673285
2016-04-21 19:53:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673285  77 57499 71598366 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:53:18 [DEBUG   ] Got command RPT from MCS: ref #673286
2016-04-21 19:53:18 [DEBUG   ] summary = ERROR
2016-04-21 19:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673286  13 57499 71598558 A  ERRORERROR'
2016-04-21 19:53:18 [DEBUG   ] Got command RPT from MCS: ref #673287
2016-04-21 19:53:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673287  77 57499 71598762 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:53:18 [DEBUG   ] Got command RPT from MCS: ref #673288
2016-04-21 19:53:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 19:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673288  12 57499 71598966 A  ERRORB‹ÌÍ'
2016-04-21 19:53:32 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2016-04-21 19:53:52 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2016-04-21 19:54:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-21 19:54:08 [DEBUG   ] Finished updating board flags in 1.624 seconds
2016-04-21 19:54:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-21 19:54:29 [DEBUG   ] Got command RPT from MCS: ref #673289
2016-04-21 19:54:29 [DEBUG   ] summary = ERROR
2016-04-21 19:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673289  13 57499 71669646 A  ERRORERROR'
2016-04-21 19:54:29 [DEBUG   ] Got command RPT from MCS: ref #673290
2016-04-21 19:54:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673290  77 57499 71669646 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:54:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 19:54:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 19:55:08 [DEBUG   ] Finished updating board flags in 1.561 seconds
2016-04-21 19:55:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 19:55:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 19:55:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 19:56:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 19:56:08 [DEBUG   ] Finished updating board flags in 1.444 seconds
2016-04-21 19:56:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 19:56:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 19:56:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 19:57:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 19:57:08 [DEBUG   ] Finished updating board flags in 1.469 seconds
2016-04-21 19:57:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 19:57:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 19:57:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 19:58:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 19:58:08 [DEBUG   ] Finished updating board flags in 1.464 seconds
2016-04-21 19:58:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 19:58:18 [DEBUG   ] Got command RPT from MCS: ref #673310
2016-04-21 19:58:18 [DEBUG   ] summary = ERROR
2016-04-21 19:58:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673310  13 57499 71898238 A  ERRORERROR'
2016-04-21 19:58:18 [DEBUG   ] Got command RPT from MCS: ref #673311
2016-04-21 19:58:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:58:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673311  77 57499 71898442 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:58:18 [DEBUG   ] Got command RPT from MCS: ref #673312
2016-04-21 19:58:18 [DEBUG   ] summary = ERROR
2016-04-21 19:58:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673312  13 57499 71898646 A  ERRORERROR'
2016-04-21 19:58:18 [DEBUG   ] Got command RPT from MCS: ref #673313
2016-04-21 19:58:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:58:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673313  77 57499 71898850 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:58:19 [DEBUG   ] Got command RPT from MCS: ref #673314
2016-04-21 19:58:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 19:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673314  12 57499 71899042 A  ERRORB‹ÌÍ'
2016-04-21 19:58:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 19:58:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 19:59:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 19:59:08 [DEBUG   ] Finished updating board flags in 1.567 seconds
2016-04-21 19:59:13 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2016-04-21 19:59:29 [DEBUG   ] Got command RPT from MCS: ref #673323
2016-04-21 19:59:29 [DEBUG   ] summary = ERROR
2016-04-21 19:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673323  13 57499 71969650 A  ERRORERROR'
2016-04-21 19:59:29 [DEBUG   ] Got command RPT from MCS: ref #673324
2016-04-21 19:59:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 19:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673324  77 57499 71969650 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 19:59:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 19:59:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 20:00:09 [DEBUG   ] Finished updating board flags in 2.175 seconds
2016-04-21 20:00:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 20:00:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 20:00:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 20:01:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 20:01:09 [DEBUG   ] Finished updating board flags in 1.897 seconds
2016-04-21 20:01:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 20:01:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 20:01:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 20:02:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 20:02:09 [DEBUG   ] Finished updating board flags in 1.829 seconds
2016-04-21 20:02:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 20:02:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 20:02:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 20:03:09 [DEBUG   ] Finished updating board flags in 1.782 seconds
2016-04-21 20:03:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 20:03:18 [DEBUG   ] Got command RPT from MCS: ref #673343
2016-04-21 20:03:18 [DEBUG   ] summary = ERROR
2016-04-21 20:03:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673343  13 57499 72198334 A  ERRORERROR'
2016-04-21 20:03:18 [DEBUG   ] Got command RPT from MCS: ref #673344
2016-04-21 20:03:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:03:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673344  77 57499 72198538 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:03:18 [DEBUG   ] Got command RPT from MCS: ref #673345
2016-04-21 20:03:18 [DEBUG   ] summary = ERROR
2016-04-21 20:03:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673345  13 57499 72198742 A  ERRORERROR'
2016-04-21 20:03:18 [DEBUG   ] Got command RPT from MCS: ref #673346
2016-04-21 20:03:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:03:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673346  77 57499 72198934 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:03:19 [DEBUG   ] Got command RPT from MCS: ref #673347
2016-04-21 20:03:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 20:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673347  12 57499 72199138 A  ERRORBŠÌÍ'
2016-04-21 20:03:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 20:03:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 20:04:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-21 20:04:09 [DEBUG   ] Finished updating board flags in 1.623 seconds
2016-04-21 20:04:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 20:04:29 [DEBUG   ] Got command RPT from MCS: ref #673351
2016-04-21 20:04:29 [DEBUG   ] summary = ERROR
2016-04-21 20:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673351  13 57499 72269654 A  ERRORERROR'
2016-04-21 20:04:29 [DEBUG   ] Got command RPT from MCS: ref #673352
2016-04-21 20:04:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673352  77 57499 72269654 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:04:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 20:04:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 20:05:09 [DEBUG   ] Finished updating board flags in 1.641 seconds
2016-04-21 20:05:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 20:05:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 20:05:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 20:06:09 [DEBUG   ] Finished updating board flags in 1.555 seconds
2016-04-21 20:06:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 20:06:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 20:06:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 20:07:09 [DEBUG   ] Finished updating board flags in 1.553 seconds
2016-04-21 20:07:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 20:07:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 20:07:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 20:08:09 [DEBUG   ] Finished updating board flags in 1.552 seconds
2016-04-21 20:08:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 20:08:18 [DEBUG   ] Got command RPT from MCS: ref #673372
2016-04-21 20:08:18 [DEBUG   ] summary = ERROR
2016-04-21 20:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673372  13 57499 72498418 A  ERRORERROR'
2016-04-21 20:08:18 [DEBUG   ] Got command RPT from MCS: ref #673373
2016-04-21 20:08:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673373  77 57499 72498622 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:08:18 [DEBUG   ] Got command RPT from MCS: ref #673374
2016-04-21 20:08:18 [DEBUG   ] summary = ERROR
2016-04-21 20:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673374  13 57499 72498826 A  ERRORERROR'
2016-04-21 20:08:19 [DEBUG   ] Got command RPT from MCS: ref #673375
2016-04-21 20:08:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673375  77 57499 72499018 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:08:19 [DEBUG   ] Got command RPT from MCS: ref #673376
2016-04-21 20:08:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 20:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673376  12 57499 72499222 A  ERRORB‹ÌÍ'
2016-04-21 20:08:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 20:08:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 20:09:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 20:09:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 20:09:10 [DEBUG   ] Finished updating board flags in 2.148 seconds
2016-04-21 20:09:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 20:09:29 [DEBUG   ] Got command RPT from MCS: ref #673382
2016-04-21 20:09:29 [DEBUG   ] summary = ERROR
2016-04-21 20:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673382  13 57499 72569650 A  ERRORERROR'
2016-04-21 20:09:29 [DEBUG   ] Got command RPT from MCS: ref #673383
2016-04-21 20:09:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673383  77 57499 72569650 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:09:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 20:09:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 20:10:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-21 20:10:10 [DEBUG   ] Finished updating board flags in 2.010 seconds
2016-04-21 20:10:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-21 20:10:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 20:10:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 20:11:10 [DEBUG   ] Finished updating board flags in 1.951 seconds
2016-04-21 20:11:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 20:11:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 20:11:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 20:12:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 20:12:10 [DEBUG   ] Finished updating board flags in 1.810 seconds
2016-04-21 20:12:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 20:12:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 20:12:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 20:13:10 [DEBUG   ] Finished updating board flags in 1.817 seconds
2016-04-21 20:13:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 20:13:18 [DEBUG   ] Got command RPT from MCS: ref #673402
2016-04-21 20:13:18 [DEBUG   ] summary = ERROR
2016-04-21 20:13:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673402  13 57499 72798506 A  ERRORERROR'
2016-04-21 20:13:18 [DEBUG   ] Got command RPT from MCS: ref #673403
2016-04-21 20:13:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:13:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673403  77 57499 72798710 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:13:18 [DEBUG   ] Got command RPT from MCS: ref #673404
2016-04-21 20:13:18 [DEBUG   ] summary = ERROR
2016-04-21 20:13:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673404  13 57499 72798902 A  ERRORERROR'
2016-04-21 20:13:19 [DEBUG   ] Got command RPT from MCS: ref #673405
2016-04-21 20:13:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673405  77 57499 72799106 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:13:19 [DEBUG   ] Got command RPT from MCS: ref #673406
2016-04-21 20:13:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 20:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673406  12 57499 72799310 A  ERRORBŠÌÍ'
2016-04-21 20:13:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 20:13:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 20:14:10 [DEBUG   ] Finished updating board flags in 1.760 seconds
2016-04-21 20:14:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 20:14:29 [DEBUG   ] Got command RPT from MCS: ref #673410
2016-04-21 20:14:29 [DEBUG   ] summary = ERROR
2016-04-21 20:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673410  13 57499 72869658 A  ERRORERROR'
2016-04-21 20:14:29 [DEBUG   ] Got command RPT from MCS: ref #673411
2016-04-21 20:14:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673411  77 57499 72869658 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:14:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 20:14:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 20:15:10 [DEBUG   ] Finished updating board flags in 1.636 seconds
2016-04-21 20:15:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 20:15:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 20:15:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 20:16:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 20:16:10 [DEBUG   ] Finished updating board flags in 1.627 seconds
2016-04-21 20:16:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 20:16:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 20:16:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 20:17:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 20:17:10 [DEBUG   ] Finished updating board flags in 1.610 seconds
2016-04-21 20:17:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 20:17:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 20:17:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 20:18:10 [DEBUG   ] Finished updating board flags in 1.649 seconds
2016-04-21 20:18:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 20:18:18 [DEBUG   ] Got command RPT from MCS: ref #673431
2016-04-21 20:18:18 [DEBUG   ] summary = ERROR
2016-04-21 20:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673431  13 57499 73098586 A  ERRORERROR'
2016-04-21 20:18:18 [DEBUG   ] Got command RPT from MCS: ref #673432
2016-04-21 20:18:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673432  77 57499 73098790 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:18:18 [DEBUG   ] Got command RPT from MCS: ref #673433
2016-04-21 20:18:18 [DEBUG   ] summary = ERROR
2016-04-21 20:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673433  13 57499 73098994 A  ERRORERROR'
2016-04-21 20:18:19 [DEBUG   ] Got command RPT from MCS: ref #673434
2016-04-21 20:18:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673434  77 57499 73099186 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:18:19 [DEBUG   ] Got command RPT from MCS: ref #673435
2016-04-21 20:18:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 20:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673435  12 57499 73099430 A  ERRORBŠÌÍ'
2016-04-21 20:18:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 20:18:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 20:19:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 20:19:10 [DEBUG   ] Finished updating board flags in 1.630 seconds
2016-04-21 20:19:13 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-21 20:19:29 [DEBUG   ] Got command RPT from MCS: ref #673444
2016-04-21 20:19:29 [DEBUG   ] summary = ERROR
2016-04-21 20:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673444  13 57499 73169658 A  ERRORERROR'
2016-04-21 20:19:29 [DEBUG   ] Got command RPT from MCS: ref #673445
2016-04-21 20:19:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673445  77 57499 73169658 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:19:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 20:19:53 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-21 20:20:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 20:20:10 [DEBUG   ] Finished updating board flags in 1.636 seconds
2016-04-21 20:20:13 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-21 20:20:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-21 20:20:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 20:21:10 [DEBUG   ] Finished updating board flags in 1.628 seconds
2016-04-21 20:21:14 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2016-04-21 20:21:34 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-21 20:21:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 20:22:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 20:22:10 [DEBUG   ] Finished updating board flags in 1.625 seconds
2016-04-21 20:22:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 20:22:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 20:22:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 20:23:10 [DEBUG   ] Finished updating board flags in 1.624 seconds
2016-04-21 20:23:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 20:23:18 [DEBUG   ] Got command RPT from MCS: ref #673464
2016-04-21 20:23:18 [DEBUG   ] summary = ERROR
2016-04-21 20:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673464  13 57499 73398666 A  ERRORERROR'
2016-04-21 20:23:18 [DEBUG   ] Got command RPT from MCS: ref #673465
2016-04-21 20:23:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673465  77 57499 73398870 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:23:19 [DEBUG   ] Got command RPT from MCS: ref #673466
2016-04-21 20:23:19 [DEBUG   ] summary = ERROR
2016-04-21 20:23:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673466  13 57499 73399074 A  ERRORERROR'
2016-04-21 20:23:19 [DEBUG   ] Got command RPT from MCS: ref #673467
2016-04-21 20:23:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:23:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673467  77 57499 73399278 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:23:19 [DEBUG   ] Got command RPT from MCS: ref #673468
2016-04-21 20:23:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 20:23:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673468  12 57499 73399470 A  ERRORB‹ÌÍ'
2016-04-21 20:23:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 20:23:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 20:24:10 [DEBUG   ] Finished updating board flags in 1.637 seconds
2016-04-21 20:24:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 20:24:29 [DEBUG   ] Got command RPT from MCS: ref #673469
2016-04-21 20:24:29 [DEBUG   ] summary = ERROR
2016-04-21 20:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673469  13 57499 73469654 A  ERRORERROR'
2016-04-21 20:24:29 [DEBUG   ] Got command RPT from MCS: ref #673470
2016-04-21 20:24:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673470  77 57499 73469654 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:24:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 20:24:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 20:25:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 20:25:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 20:25:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 20:25:10 [DEBUG   ] Finished updating board flags in 1.639 seconds
2016-04-21 20:25:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 20:25:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 20:25:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 20:26:11 [DEBUG   ] Finished updating board flags in 1.634 seconds
2016-04-21 20:26:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 20:26:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 20:26:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 20:27:11 [DEBUG   ] Finished updating board flags in 1.642 seconds
2016-04-21 20:27:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 20:27:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 20:27:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 20:28:11 [DEBUG   ] Finished updating board flags in 2.329 seconds
2016-04-21 20:28:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 20:28:18 [DEBUG   ] Got command RPT from MCS: ref #673490
2016-04-21 20:28:18 [DEBUG   ] summary = ERROR
2016-04-21 20:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673490  13 57499 73698754 A  ERRORERROR'
2016-04-21 20:28:18 [DEBUG   ] Got command RPT from MCS: ref #673491
2016-04-21 20:28:18 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673491  77 57499 73698946 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:28:19 [DEBUG   ] Got command RPT from MCS: ref #673492
2016-04-21 20:28:19 [DEBUG   ] summary = ERROR
2016-04-21 20:28:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673492  13 57499 73699150 A  ERRORERROR'
2016-04-21 20:28:19 [DEBUG   ] Got command RPT from MCS: ref #673493
2016-04-21 20:28:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:28:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673493  77 57499 73699354 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:28:19 [DEBUG   ] Got command RPT from MCS: ref #673494
2016-04-21 20:28:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 20:28:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673494  12 57499 73699558 A  ERRORB‹ÌÍ'
2016-04-21 20:28:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 20:28:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 20:29:11 [DEBUG   ] Finished updating board flags in 2.208 seconds
2016-04-21 20:29:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 20:29:29 [DEBUG   ] Got command RPT from MCS: ref #673503
2016-04-21 20:29:29 [DEBUG   ] summary = ERROR
2016-04-21 20:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673503  13 57499 73769654 A  ERRORERROR'
2016-04-21 20:29:29 [DEBUG   ] Got command RPT from MCS: ref #673504
2016-04-21 20:29:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673504  77 57499 73769654 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:29:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 20:29:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 20:30:11 [DEBUG   ] Finished updating board flags in 2.054 seconds
2016-04-21 20:30:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 20:30:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 20:30:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 20:31:11 [DEBUG   ] Finished updating board flags in 2.001 seconds
2016-04-21 20:31:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 20:31:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 20:31:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 20:32:11 [DEBUG   ] Finished updating board flags in 1.989 seconds
2016-04-21 20:32:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 20:32:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 20:32:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 20:33:11 [DEBUG   ] Finished updating board flags in 1.812 seconds
2016-04-21 20:33:14 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2016-04-21 20:33:18 [DEBUG   ] Got command RPT from MCS: ref #673523
2016-04-21 20:33:18 [DEBUG   ] summary = ERROR
2016-04-21 20:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673523  13 57499 73998842 A  ERRORERROR'
2016-04-21 20:33:19 [DEBUG   ] Got command RPT from MCS: ref #673524
2016-04-21 20:33:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:33:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673524  77 57499 73999034 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:33:19 [DEBUG   ] Got command RPT from MCS: ref #673525
2016-04-21 20:33:19 [DEBUG   ] summary = ERROR
2016-04-21 20:33:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673525  13 57499 73999238 A  ERRORERROR'
2016-04-21 20:33:19 [DEBUG   ] Got command RPT from MCS: ref #673526
2016-04-21 20:33:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:33:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673526  77 57499 73999442 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:33:19 [DEBUG   ] Got command RPT from MCS: ref #673527
2016-04-21 20:33:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 20:33:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673527  12 57499 73999634 A  ERRORBŠÌÍ'
2016-04-21 20:33:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 20:33:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 20:34:11 [DEBUG   ] Finished updating board flags in 1.811 seconds
2016-04-21 20:34:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 20:34:29 [DEBUG   ] Got command RPT from MCS: ref #673531
2016-04-21 20:34:29 [DEBUG   ] summary = ERROR
2016-04-21 20:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673531  13 57499 74069654 A  ERRORERROR'
2016-04-21 20:34:29 [DEBUG   ] Got command RPT from MCS: ref #673532
2016-04-21 20:34:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673532  77 57499 74069654 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:34:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 20:34:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 20:35:11 [DEBUG   ] Finished updating board flags in 1.840 seconds
2016-04-21 20:35:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 20:35:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 20:35:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 20:36:11 [DEBUG   ] Finished updating board flags in 1.846 seconds
2016-04-21 20:36:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 20:36:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 20:36:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 20:37:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 20:37:11 [DEBUG   ] Finished updating board flags in 1.736 seconds
2016-04-21 20:37:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 20:37:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 20:37:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 20:38:11 [DEBUG   ] Finished updating board flags in 1.624 seconds
2016-04-21 20:38:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 20:38:18 [DEBUG   ] Got command RPT from MCS: ref #673552
2016-04-21 20:38:18 [DEBUG   ] summary = ERROR
2016-04-21 20:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673552  13 57499 74298922 A  ERRORERROR'
2016-04-21 20:38:19 [DEBUG   ] Got command RPT from MCS: ref #673553
2016-04-21 20:38:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673553  77 57499 74299126 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:38:19 [DEBUG   ] Got command RPT from MCS: ref #673554
2016-04-21 20:38:19 [DEBUG   ] summary = ERROR
2016-04-21 20:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673554  13 57499 74299330 A  ERRORERROR'
2016-04-21 20:38:19 [DEBUG   ] Got command RPT from MCS: ref #673555
2016-04-21 20:38:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673555  77 57499 74299522 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:38:19 [DEBUG   ] Got command RPT from MCS: ref #673556
2016-04-21 20:38:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 20:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673556  12 57499 74299726 A  ERRORB‹ÌÍ'
2016-04-21 20:38:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 20:38:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 20:39:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 20:39:11 [DEBUG   ] Finished updating board flags in 1.563 seconds
2016-04-21 20:39:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 20:39:29 [DEBUG   ] Got command RPT from MCS: ref #673562
2016-04-21 20:39:29 [DEBUG   ] summary = ERROR
2016-04-21 20:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673562  13 57499 74369654 A  ERRORERROR'
2016-04-21 20:39:29 [DEBUG   ] Got command RPT from MCS: ref #673563
2016-04-21 20:39:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673563  77 57499 74369654 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:39:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 20:39:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 20:40:11 [DEBUG   ] Finished updating board flags in 1.424 seconds
2016-04-21 20:40:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 20:40:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 20:40:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 20:41:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 20:41:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 20:41:11 [DEBUG   ] Finished updating board flags in 1.533 seconds
2016-04-21 20:41:14 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2016-04-21 20:41:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 20:41:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 20:42:11 [DEBUG   ] Finished updating board flags in 1.538 seconds
2016-04-21 20:42:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 20:42:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 20:42:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 20:43:12 [DEBUG   ] Finished updating board flags in 2.169 seconds
2016-04-21 20:43:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 20:43:19 [DEBUG   ] Got command RPT from MCS: ref #673582
2016-04-21 20:43:19 [DEBUG   ] summary = ERROR
2016-04-21 20:43:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673582  13 57499 74599010 A  ERRORERROR'
2016-04-21 20:43:19 [DEBUG   ] Got command RPT from MCS: ref #673583
2016-04-21 20:43:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:43:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673583  77 57499 74599202 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:43:19 [DEBUG   ] Got command RPT from MCS: ref #673584
2016-04-21 20:43:19 [DEBUG   ] summary = ERROR
2016-04-21 20:43:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673584  13 57499 74599428 A  ERRORERROR'
2016-04-21 20:43:19 [DEBUG   ] Got command RPT from MCS: ref #673585
2016-04-21 20:43:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:43:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673585  77 57499 74599606 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:43:19 [DEBUG   ] Got command RPT from MCS: ref #673586
2016-04-21 20:43:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 20:43:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673586  12 57499 74599810 A  ERRORBŠÌÍ'
2016-04-21 20:43:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 20:43:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 20:44:12 [DEBUG   ] Finished updating board flags in 1.998 seconds
2016-04-21 20:44:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 20:44:29 [DEBUG   ] Got command RPT from MCS: ref #673590
2016-04-21 20:44:29 [DEBUG   ] summary = ERROR
2016-04-21 20:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673590  13 57499 74669662 A  ERRORERROR'
2016-04-21 20:44:29 [DEBUG   ] Got command RPT from MCS: ref #673591
2016-04-21 20:44:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673591  77 57499 74669662 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:44:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 20:44:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 20:45:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 20:45:12 [DEBUG   ] Finished updating board flags in 1.753 seconds
2016-04-21 20:45:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 20:45:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 20:45:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 20:46:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 20:46:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 20:46:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 20:46:12 [DEBUG   ] Finished updating board flags in 1.577 seconds
2016-04-21 20:46:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 20:46:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 20:46:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 20:47:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 20:47:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 20:47:12 [DEBUG   ] Finished updating board flags in 1.428 seconds
2016-04-21 20:47:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 20:47:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 20:47:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 20:48:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 20:48:12 [DEBUG   ] Finished updating board flags in 1.473 seconds
2016-04-21 20:48:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 20:48:19 [DEBUG   ] Got command RPT from MCS: ref #673611
2016-04-21 20:48:19 [DEBUG   ] summary = ERROR
2016-04-21 20:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673611  13 57499 74899098 A  ERRORERROR'
2016-04-21 20:48:19 [DEBUG   ] Got command RPT from MCS: ref #673612
2016-04-21 20:48:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673612  77 57499 74899302 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:48:19 [DEBUG   ] Got command RPT from MCS: ref #673613
2016-04-21 20:48:19 [DEBUG   ] summary = ERROR
2016-04-21 20:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673613  13 57499 74899506 A  ERRORERROR'
2016-04-21 20:48:19 [DEBUG   ] Got command RPT from MCS: ref #673614
2016-04-21 20:48:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673614  77 57499 74899710 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:48:19 [DEBUG   ] Got command RPT from MCS: ref #673615
2016-04-21 20:48:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 20:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673615  12 57499 74899902 A  ERRORB‰ÌÍ'
2016-04-21 20:48:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 20:48:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 20:49:12 [DEBUG   ] Finished updating board flags in 1.587 seconds
2016-04-21 20:49:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 20:49:29 [DEBUG   ] Got command RPT from MCS: ref #673624
2016-04-21 20:49:29 [DEBUG   ] summary = ERROR
2016-04-21 20:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673624  13 57499 74969666 A  ERRORERROR'
2016-04-21 20:49:29 [DEBUG   ] Got command RPT from MCS: ref #673625
2016-04-21 20:49:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673625  77 57499 74969666 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:49:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 20:49:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 20:50:13 [DEBUG   ] Finished updating board flags in 2.253 seconds
2016-04-21 20:50:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 20:50:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 20:50:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 20:51:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 20:51:13 [DEBUG   ] Finished updating board flags in 2.098 seconds
2016-04-21 20:51:14 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2016-04-21 20:51:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 20:51:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 20:52:13 [DEBUG   ] Finished updating board flags in 2.005 seconds
2016-04-21 20:52:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 20:52:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 20:52:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 20:53:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 20:53:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 20:53:13 [DEBUG   ] Finished updating board flags in 1.967 seconds
2016-04-21 20:53:14 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-21 20:53:19 [DEBUG   ] Got command RPT from MCS: ref #673644
2016-04-21 20:53:19 [DEBUG   ] summary = ERROR
2016-04-21 20:53:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673644  13 57499 75199186 A  ERRORERROR'
2016-04-21 20:53:19 [DEBUG   ] Got command RPT from MCS: ref #673645
2016-04-21 20:53:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:53:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673645  77 57499 75199424 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:53:19 [DEBUG   ] Got command RPT from MCS: ref #673646
2016-04-21 20:53:19 [DEBUG   ] summary = ERROR
2016-04-21 20:53:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673646  13 57499 75199590 A  ERRORERROR'
2016-04-21 20:53:19 [DEBUG   ] Got command RPT from MCS: ref #673647
2016-04-21 20:53:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:53:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673647  77 57499 75199794 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:53:19 [DEBUG   ] Got command RPT from MCS: ref #673648
2016-04-21 20:53:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 20:53:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673648  12 57499 75199986 A  ERRORB‹ÌÍ'
2016-04-21 20:53:35 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2016-04-21 20:53:55 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-21 20:54:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-21 20:54:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 20:54:13 [DEBUG   ] Finished updating board flags in 1.825 seconds
2016-04-21 20:54:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 20:54:29 [DEBUG   ] Got command RPT from MCS: ref #673649
2016-04-21 20:54:29 [DEBUG   ] summary = ERROR
2016-04-21 20:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673649  13 57499 75269685 A  ERRORERROR'
2016-04-21 20:54:29 [DEBUG   ] Got command RPT from MCS: ref #673650
2016-04-21 20:54:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673650  77 57499 75269685 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:54:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 20:54:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 20:55:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 20:55:13 [DEBUG   ] Finished updating board flags in 1.779 seconds
2016-04-21 20:55:15 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-21 20:55:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 20:55:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 20:56:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 20:56:13 [DEBUG   ] Finished updating board flags in 1.624 seconds
2016-04-21 20:56:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 20:56:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 20:56:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 20:57:13 [DEBUG   ] Finished updating board flags in 1.582 seconds
2016-04-21 20:57:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 20:57:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 20:57:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 20:58:13 [DEBUG   ] Finished updating board flags in 1.554 seconds
2016-04-21 20:58:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 20:58:19 [DEBUG   ] Got command RPT from MCS: ref #673670
2016-04-21 20:58:19 [DEBUG   ] summary = ERROR
2016-04-21 20:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673670  13 57499 75499278 A  ERRORERROR'
2016-04-21 20:58:19 [DEBUG   ] Got command RPT from MCS: ref #673671
2016-04-21 20:58:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673671  77 57499 75499482 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:58:19 [DEBUG   ] Got command RPT from MCS: ref #673672
2016-04-21 20:58:19 [DEBUG   ] summary = ERROR
2016-04-21 20:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673672  13 57499 75499674 A  ERRORERROR'
2016-04-21 20:58:19 [DEBUG   ] Got command RPT from MCS: ref #673673
2016-04-21 20:58:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673673  77 57499 75499878 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 20:58:20 [DEBUG   ] Got command RPT from MCS: ref #673674
2016-04-21 20:58:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 20:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673674  12 57499 75500082 A  ERRORBŠÌÍ'
2016-04-21 20:58:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 20:58:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 20:59:11 [DEBUG   ] Got command TBW from MCS: ref #673684
2016-04-21 20:59:11 [DEBUG   ] tbw = exited with status True, code 0x00
2016-04-21 20:59:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   673684   8 57499 75551562 A  ERROR'
2016-04-21 20:59:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2016-04-21 20:59:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2016-04-21 20:59:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2016-04-21 20:59:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2016-04-21 20:59:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2016-04-21 20:59:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2016-04-21 20:59:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2016-04-21 20:59:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2016-04-21 20:59:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2016-04-21 20:59:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2016-04-21 20:59:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2016-04-21 20:59:13 [DEBUG   ] Finished updating board flags in 1.547 seconds
2016-04-21 20:59:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2016-04-21 20:59:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2016-04-21 20:59:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2016-04-21 20:59:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2016-04-21 20:59:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2016-04-21 20:59:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2016-04-21 20:59:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2016-04-21 20:59:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2016-04-21 20:59:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2016-04-21 20:59:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2016-04-21 20:59:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2016-04-21 20:59:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2016-04-21 20:59:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2016-04-21 20:59:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2016-04-21 20:59:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2016-04-21 20:59:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2016-04-21 20:59:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2016-04-21 20:59:15 [DEBUG   ] spawn_process: at 2016-04-21 20:59:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2016-04-21 20:59:15 [INFO    ] Finished spawning TBW
2016-04-21 20:59:29 [DEBUG   ] Got command RPT from MCS: ref #673686
2016-04-21 20:59:29 [DEBUG   ] summary = ERROR
2016-04-21 20:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673686  13 57499 75569666 A  ERRORERROR'
2016-04-21 20:59:29 [DEBUG   ] Got command RPT from MCS: ref #673687
2016-04-21 20:59:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 20:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673687  77 57499 75569666 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:00:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 21:00:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 21:00:14 [DEBUG   ] Finished updating board flags in 2.058 seconds
2016-04-21 21:01:13 [DEBUG   ] Finished updating board flags in 1.323 seconds
2016-04-21 21:02:14 [DEBUG   ] Finished updating board flags in 1.868 seconds
2016-04-21 21:02:54 [INFO    ] __waitForTBW - TBW finished in 219.199 s
2016-04-21 21:02:55 [DEBUG   ] Finished updating ant stats in 0.986 seconds
2016-04-21 21:02:55 [INFO    ] Started antennas statistics background thread
2016-04-21 21:02:55 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1461272576']
2016-04-21 21:02:55 [DEBUG   ] spawn_process: at 2016-04-21 21:02:55 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1461272576']
2016-04-21 21:02:55 [INFO    ] Finished spawning TBN in 0.047 s
2016-04-21 21:03:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 21:03:14 [DEBUG   ] Finished updating board flags in 2.004 seconds
2016-04-21 21:03:15 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2016-04-21 21:03:19 [DEBUG   ] Got command RPT from MCS: ref #673714
2016-04-21 21:03:19 [DEBUG   ] summary = ERROR
2016-04-21 21:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673714  13 57499 75799358 A  ERRORERROR'
2016-04-21 21:03:19 [DEBUG   ] Got command RPT from MCS: ref #673715
2016-04-21 21:03:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673715  77 57499 75799562 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:03:19 [DEBUG   ] Got command RPT from MCS: ref #673716
2016-04-21 21:03:19 [DEBUG   ] summary = ERROR
2016-04-21 21:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673716  13 57499 75799754 A  ERRORERROR'
2016-04-21 21:03:19 [DEBUG   ] Got command RPT from MCS: ref #673717
2016-04-21 21:03:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673717  77 57499 75799958 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:03:20 [DEBUG   ] Got command RPT from MCS: ref #673718
2016-04-21 21:03:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 21:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673718  12 57499 75800162 A  ERRORBŠÌÍ'
2016-04-21 21:03:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 21:03:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 21:04:14 [DEBUG   ] Finished updating board flags in 1.900 seconds
2016-04-21 21:04:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 21:04:29 [DEBUG   ] Got command RPT from MCS: ref #673725
2016-04-21 21:04:29 [DEBUG   ] summary = ERROR
2016-04-21 21:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673725  13 57499 75869666 A  ERRORERROR'
2016-04-21 21:04:29 [DEBUG   ] Got command RPT from MCS: ref #673726
2016-04-21 21:04:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673726  77 57499 75869666 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:04:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 21:04:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 21:05:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 21:05:14 [DEBUG   ] Finished updating board flags in 1.826 seconds
2016-04-21 21:05:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 21:05:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 21:05:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 21:06:14 [DEBUG   ] Finished updating board flags in 1.768 seconds
2016-04-21 21:06:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 21:06:35 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 21:06:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 21:07:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 21:07:14 [DEBUG   ] Finished updating board flags in 1.596 seconds
2016-04-21 21:07:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 21:07:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 21:07:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 21:08:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 21:08:14 [DEBUG   ] Finished updating board flags in 1.438 seconds
2016-04-21 21:08:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 21:08:19 [DEBUG   ] Got command RPT from MCS: ref #673746
2016-04-21 21:08:19 [DEBUG   ] summary = ERROR
2016-04-21 21:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673746  13 57499 76099442 A  ERRORERROR'
2016-04-21 21:08:19 [DEBUG   ] Got command RPT from MCS: ref #673747
2016-04-21 21:08:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673747  77 57499 76099646 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:08:19 [DEBUG   ] Got command RPT from MCS: ref #673748
2016-04-21 21:08:19 [DEBUG   ] summary = ERROR
2016-04-21 21:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673748  13 57499 76099838 A  ERRORERROR'
2016-04-21 21:08:20 [DEBUG   ] Got command RPT from MCS: ref #673749
2016-04-21 21:08:20 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:08:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673749  77 57499 76100042 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:08:20 [DEBUG   ] Got command RPT from MCS: ref #673750
2016-04-21 21:08:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 21:08:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673750  12 57499 76100246 A  ERRORBŠÌÍ'
2016-04-21 21:08:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 21:08:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 21:09:14 [DEBUG   ] Finished updating board flags in 1.438 seconds
2016-04-21 21:09:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 21:09:29 [DEBUG   ] Got command RPT from MCS: ref #673756
2016-04-21 21:09:29 [DEBUG   ] summary = ERROR
2016-04-21 21:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673756  13 57499 76169662 A  ERRORERROR'
2016-04-21 21:09:29 [DEBUG   ] Got command RPT from MCS: ref #673757
2016-04-21 21:09:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673757  77 57499 76169662 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:09:36 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2016-04-21 21:09:56 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2016-04-21 21:10:14 [DEBUG   ] Finished updating board flags in 1.434 seconds
2016-04-21 21:10:16 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-21 21:10:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 21:10:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 21:11:14 [DEBUG   ] Finished updating board flags in 1.434 seconds
2016-04-21 21:11:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 21:11:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 21:11:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 21:12:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 21:12:14 [DEBUG   ] Finished updating board flags in 1.434 seconds
2016-04-21 21:12:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 21:12:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 21:12:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 21:13:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 21:13:14 [DEBUG   ] Finished updating board flags in 1.552 seconds
2016-04-21 21:13:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 21:13:19 [DEBUG   ] Got command RPT from MCS: ref #673776
2016-04-21 21:13:19 [DEBUG   ] summary = ERROR
2016-04-21 21:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673776  13 57499 76399526 A  ERRORERROR'
2016-04-21 21:13:19 [DEBUG   ] Got command RPT from MCS: ref #673777
2016-04-21 21:13:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673777  77 57499 76399730 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:13:19 [DEBUG   ] Got command RPT from MCS: ref #673778
2016-04-21 21:13:19 [DEBUG   ] summary = ERROR
2016-04-21 21:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673778  13 57499 76399922 A  ERRORERROR'
2016-04-21 21:13:20 [DEBUG   ] Got command RPT from MCS: ref #673779
2016-04-21 21:13:20 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:13:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673779  77 57499 76400126 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:13:20 [DEBUG   ] Got command RPT from MCS: ref #673780
2016-04-21 21:13:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 21:13:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673780  12 57499 76400330 A  ERRORBŠÌÍ'
2016-04-21 21:13:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 21:13:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 21:14:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 21:14:15 [DEBUG   ] Finished updating board flags in 2.189 seconds
2016-04-21 21:14:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 21:14:29 [DEBUG   ] Got command RPT from MCS: ref #673784
2016-04-21 21:14:29 [DEBUG   ] summary = ERROR
2016-04-21 21:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673784  13 57499 76469670 A  ERRORERROR'
2016-04-21 21:14:29 [DEBUG   ] Got command RPT from MCS: ref #673785
2016-04-21 21:14:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673785  77 57499 76469670 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:14:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 21:14:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 21:15:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 21:15:15 [DEBUG   ] Finished updating board flags in 1.907 seconds
2016-04-21 21:15:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 21:15:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 21:15:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 21:16:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 21:16:16 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2016-04-21 21:16:16 [DEBUG   ] Finished updating board flags in 2.552 seconds
2016-04-21 21:16:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 21:16:56 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-21 21:17:15 [DEBUG   ] Finished updating board flags in 1.625 seconds
2016-04-21 21:17:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 21:17:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 21:17:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 21:18:15 [DEBUG   ] Finished updating board flags in 1.624 seconds
2016-04-21 21:18:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 21:18:19 [DEBUG   ] Got command RPT from MCS: ref #673805
2016-04-21 21:18:19 [DEBUG   ] summary = ERROR
2016-04-21 21:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673805  13 57499 76699626 A  ERRORERROR'
2016-04-21 21:18:19 [DEBUG   ] Got command RPT from MCS: ref #673806
2016-04-21 21:18:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673806  77 57499 76699818 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:18:20 [DEBUG   ] Got command RPT from MCS: ref #673807
2016-04-21 21:18:20 [DEBUG   ] summary = ERROR
2016-04-21 21:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673807  13 57499 76700022 A  ERRORERROR'
2016-04-21 21:18:20 [DEBUG   ] Got command RPT from MCS: ref #673808
2016-04-21 21:18:20 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673808  77 57499 76700226 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:18:20 [DEBUG   ] Got command RPT from MCS: ref #673809
2016-04-21 21:18:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 21:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673809  12 57499 76700418 A  ERRORB‰ÌÍ'
2016-04-21 21:18:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 21:18:57 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2016-04-21 21:19:15 [DEBUG   ] Finished updating board flags in 1.573 seconds
2016-04-21 21:19:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 21:19:29 [DEBUG   ] Got command RPT from MCS: ref #673818
2016-04-21 21:19:29 [DEBUG   ] summary = ERROR
2016-04-21 21:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673818  13 57499 76769670 A  ERRORERROR'
2016-04-21 21:19:29 [DEBUG   ] Got command RPT from MCS: ref #673819
2016-04-21 21:19:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673819  77 57499 76769670 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:19:37 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2016-04-21 21:19:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 21:20:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 21:20:15 [DEBUG   ] Finished updating board flags in 1.478 seconds
2016-04-21 21:20:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 21:20:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 21:20:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-21 21:21:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 21:21:16 [DEBUG   ] Finished updating board flags in 1.988 seconds
2016-04-21 21:21:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 21:21:37 [DEBUG   ] Finished updating ant stats in 1.599 seconds
2016-04-21 21:21:56 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2016-04-21 21:22:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-21 21:22:16 [DEBUG   ] Finished updating board flags in 2.232 seconds
2016-04-21 21:22:17 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2016-04-21 21:22:37 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2016-04-21 21:22:57 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-21 21:23:16 [DEBUG   ] Finished updating board flags in 2.157 seconds
2016-04-21 21:23:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 21:23:19 [DEBUG   ] Got command RPT from MCS: ref #673838
2016-04-21 21:23:19 [DEBUG   ] summary = ERROR
2016-04-21 21:23:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673838  13 57499 76999698 A  ERRORERROR'
2016-04-21 21:23:19 [DEBUG   ] Got command RPT from MCS: ref #673839
2016-04-21 21:23:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:23:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673839  77 57499 76999902 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:23:20 [DEBUG   ] Got command RPT from MCS: ref #673840
2016-04-21 21:23:20 [DEBUG   ] summary = ERROR
2016-04-21 21:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673840  13 57499 77000106 A  ERRORERROR'
2016-04-21 21:23:20 [DEBUG   ] Got command RPT from MCS: ref #673841
2016-04-21 21:23:20 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673841  77 57499 77000310 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:23:20 [DEBUG   ] Got command RPT from MCS: ref #673842
2016-04-21 21:23:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 21:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673842  12 57499 77000502 A  ERRORB‹ÌÍ'
2016-04-21 21:23:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 21:23:57 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 21:24:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-21 21:24:16 [DEBUG   ] Finished updating board flags in 2.021 seconds
2016-04-21 21:24:17 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-21 21:24:29 [DEBUG   ] Got command RPT from MCS: ref #673843
2016-04-21 21:24:29 [DEBUG   ] summary = ERROR
2016-04-21 21:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673843  13 57499 77069670 A  ERRORERROR'
2016-04-21 21:24:29 [DEBUG   ] Got command RPT from MCS: ref #673844
2016-04-21 21:24:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673844  77 57499 77069670 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:24:37 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-21 21:24:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 21:25:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 21:25:16 [DEBUG   ] Finished updating board flags in 1.985 seconds
2016-04-21 21:25:17 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-21 21:25:38 [DEBUG   ] Finished updating ant stats in 1.310 seconds
2016-04-21 21:25:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 21:26:16 [DEBUG   ] Finished updating board flags in 1.470 seconds
2016-04-21 21:26:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-21 21:26:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 21:26:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 21:27:16 [DEBUG   ] Finished updating board flags in 1.390 seconds
2016-04-21 21:27:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 21:27:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 21:27:58 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 21:28:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 21:28:18 [DEBUG   ] Finished updating board flags in 2.949 seconds
2016-04-21 21:28:19 [DEBUG   ] Got command RPT from MCS: ref #673864
2016-04-21 21:28:19 [DEBUG   ] summary = ERROR
2016-04-21 21:28:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673864  13 57499 77299802 A  ERRORERROR'
2016-04-21 21:28:19 [DEBUG   ] Got command RPT from MCS: ref #673865
2016-04-21 21:28:19 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:28:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673865  77 57499 77299994 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:28:20 [DEBUG   ] Got command RPT from MCS: ref #673866
2016-04-21 21:28:20 [DEBUG   ] summary = ERROR
2016-04-21 21:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673866  13 57499 77300198 A  ERRORERROR'
2016-04-21 21:28:20 [DEBUG   ] Got command RPT from MCS: ref #673867
2016-04-21 21:28:20 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673867  77 57499 77300402 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:28:20 [DEBUG   ] Got command RPT from MCS: ref #673868
2016-04-21 21:28:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 21:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673868  12 57499 77300606 A  ERRORB‹ÌÍ'
2016-04-21 21:28:38 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2016-04-21 21:28:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 21:29:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 21:29:17 [DEBUG   ] Finished updating board flags in 2.071 seconds
2016-04-21 21:29:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 21:29:29 [DEBUG   ] Got command RPT from MCS: ref #673877
2016-04-21 21:29:29 [DEBUG   ] summary = ERROR
2016-04-21 21:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673877  13 57499 77369670 A  ERRORERROR'
2016-04-21 21:29:29 [DEBUG   ] Got command RPT from MCS: ref #673878
2016-04-21 21:29:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673878  77 57499 77369670 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:29:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 21:29:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 21:30:17 [DEBUG   ] Finished updating board flags in 2.075 seconds
2016-04-21 21:30:18 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 21:30:38 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2016-04-21 21:30:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 21:31:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 21:31:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 21:31:17 [DEBUG   ] Finished updating board flags in 1.896 seconds
2016-04-21 21:31:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 21:31:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 21:31:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 21:32:17 [DEBUG   ] Finished updating board flags in 1.808 seconds
2016-04-21 21:32:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 21:32:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 21:32:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 21:33:17 [DEBUG   ] Finished updating board flags in 1.790 seconds
2016-04-21 21:33:19 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-21 21:33:19 [DEBUG   ] Got command RPT from MCS: ref #673897
2016-04-21 21:33:19 [DEBUG   ] summary = ERROR
2016-04-21 21:33:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673897  13 57499 77599878 A  ERRORERROR'
2016-04-21 21:33:20 [DEBUG   ] Got command RPT from MCS: ref #673898
2016-04-21 21:33:20 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673898  77 57499 77600082 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:33:20 [DEBUG   ] Got command RPT from MCS: ref #673899
2016-04-21 21:33:20 [DEBUG   ] summary = ERROR
2016-04-21 21:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673899  13 57499 77600286 A  ERRORERROR'
2016-04-21 21:33:20 [DEBUG   ] Got command RPT from MCS: ref #673900
2016-04-21 21:33:20 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673900  77 57499 77600478 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:33:20 [DEBUG   ] Got command RPT from MCS: ref #673901
2016-04-21 21:33:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 21:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673901  12 57499 77600682 A  ERRORBŠÌÍ'
2016-04-21 21:33:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 21:33:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 21:34:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 21:34:17 [DEBUG   ] Finished updating board flags in 1.613 seconds
2016-04-21 21:34:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 21:34:29 [DEBUG   ] Got command RPT from MCS: ref #673905
2016-04-21 21:34:29 [DEBUG   ] summary = ERROR
2016-04-21 21:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673905  13 57499 77669666 A  ERRORERROR'
2016-04-21 21:34:29 [DEBUG   ] Got command RPT from MCS: ref #673906
2016-04-21 21:34:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673906  77 57499 77669666 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:34:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 21:34:59 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2016-04-21 21:35:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 21:35:17 [DEBUG   ] Finished updating board flags in 1.608 seconds
2016-04-21 21:35:20 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2016-04-21 21:35:40 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-21 21:36:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 21:36:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 21:36:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 21:36:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 21:36:17 [DEBUG   ] Finished updating board flags in 1.591 seconds
2016-04-21 21:36:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 21:36:40 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-21 21:37:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 21:37:17 [DEBUG   ] Finished updating board flags in 1.407 seconds
2016-04-21 21:37:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 21:37:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 21:38:00 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-21 21:38:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 21:38:17 [DEBUG   ] Finished updating board flags in 1.393 seconds
2016-04-21 21:38:19 [DEBUG   ] Got command RPT from MCS: ref #673926
2016-04-21 21:38:19 [DEBUG   ] summary = ERROR
2016-04-21 21:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673926  13 57499 77899982 A  ERRORERROR'
2016-04-21 21:38:20 [DEBUG   ] Got command RPT from MCS: ref #673927
2016-04-21 21:38:20 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673927  77 57499 77900186 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:38:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 21:38:20 [DEBUG   ] Got command RPT from MCS: ref #673928
2016-04-21 21:38:20 [DEBUG   ] summary = ERROR
2016-04-21 21:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673928  13 57499 77900390 A  ERRORERROR'
2016-04-21 21:38:20 [DEBUG   ] Got command RPT from MCS: ref #673929
2016-04-21 21:38:20 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673929  77 57499 77900582 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:38:20 [DEBUG   ] Got command RPT from MCS: ref #673930
2016-04-21 21:38:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 21:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673930  12 57499 77900786 A  ERRORBŠÌÍ'
2016-04-21 21:38:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 21:39:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 21:39:17 [DEBUG   ] Finished updating board flags in 1.352 seconds
2016-04-21 21:39:20 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-21 21:39:29 [DEBUG   ] Got command RPT from MCS: ref #673936
2016-04-21 21:39:29 [DEBUG   ] summary = ERROR
2016-04-21 21:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673936  13 57499 77969678 A  ERRORERROR'
2016-04-21 21:39:29 [DEBUG   ] Got command RPT from MCS: ref #673937
2016-04-21 21:39:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673937  77 57499 77969678 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:39:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 21:40:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 21:40:18 [DEBUG   ] Finished updating board flags in 2.064 seconds
2016-04-21 21:40:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 21:40:40 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-21 21:41:01 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2016-04-21 21:41:18 [DEBUG   ] Finished updating board flags in 2.003 seconds
2016-04-21 21:41:21 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2016-04-21 21:41:41 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-21 21:42:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 21:42:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 21:42:18 [DEBUG   ] Finished updating board flags in 1.996 seconds
2016-04-21 21:42:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 21:42:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 21:43:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 21:43:18 [DEBUG   ] Finished updating board flags in 1.809 seconds
2016-04-21 21:43:20 [DEBUG   ] Got command RPT from MCS: ref #673956
2016-04-21 21:43:20 [DEBUG   ] summary = ERROR
2016-04-21 21:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673956  13 57499 78200070 A  ERRORERROR'
2016-04-21 21:43:20 [DEBUG   ] Got command RPT from MCS: ref #673957
2016-04-21 21:43:20 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673957  77 57499 78200274 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:43:20 [DEBUG   ] Got command RPT from MCS: ref #673958
2016-04-21 21:43:20 [DEBUG   ] summary = ERROR
2016-04-21 21:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673958  13 57499 78200470 A  ERRORERROR'
2016-04-21 21:43:20 [DEBUG   ] Got command RPT from MCS: ref #673959
2016-04-21 21:43:20 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673959  77 57499 78200674 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:43:20 [DEBUG   ] Got command RPT from MCS: ref #673960
2016-04-21 21:43:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 21:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673960  12 57499 78200878 A  ERRORB‹ÌÍ'
2016-04-21 21:43:21 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 21:43:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 21:44:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 21:44:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 21:44:18 [DEBUG   ] Finished updating board flags in 1.789 seconds
2016-04-21 21:44:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-21 21:44:29 [DEBUG   ] Got command RPT from MCS: ref #673964
2016-04-21 21:44:29 [DEBUG   ] summary = ERROR
2016-04-21 21:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673964  13 57499 78269678 A  ERRORERROR'
2016-04-21 21:44:29 [DEBUG   ] Got command RPT from MCS: ref #673965
2016-04-21 21:44:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673965  77 57499 78269678 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:44:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 21:45:01 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2016-04-21 21:45:18 [DEBUG   ] Finished updating board flags in 1.621 seconds
2016-04-21 21:45:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 21:45:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 21:46:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 21:46:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 21:46:18 [DEBUG   ] Finished updating board flags in 1.578 seconds
2016-04-21 21:46:21 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 21:46:41 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-21 21:47:02 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2016-04-21 21:47:18 [DEBUG   ] Finished updating board flags in 1.419 seconds
2016-04-21 21:47:22 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2016-04-21 21:47:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 21:48:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 21:48:18 [DEBUG   ] Finished updating board flags in 1.388 seconds
2016-04-21 21:48:20 [DEBUG   ] Got command RPT from MCS: ref #673985
2016-04-21 21:48:20 [DEBUG   ] summary = ERROR
2016-04-21 21:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673985  13 57499 78500170 A  ERRORERROR'
2016-04-21 21:48:20 [DEBUG   ] Got command RPT from MCS: ref #673986
2016-04-21 21:48:20 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673986  77 57499 78500374 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:48:20 [DEBUG   ] Got command RPT from MCS: ref #673987
2016-04-21 21:48:20 [DEBUG   ] summary = ERROR
2016-04-21 21:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673987  13 57499 78500578 A  ERRORERROR'
2016-04-21 21:48:20 [DEBUG   ] Got command RPT from MCS: ref #673988
2016-04-21 21:48:20 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673988  77 57499 78500770 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:48:20 [DEBUG   ] Got command RPT from MCS: ref #673989
2016-04-21 21:48:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 21:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673989  12 57499 78500974 A  ERRORBŠÌÍ'
2016-04-21 21:48:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 21:48:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 21:49:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 21:49:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 21:49:18 [DEBUG   ] Finished updating board flags in 1.365 seconds
2016-04-21 21:49:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 21:49:29 [DEBUG   ] Got command RPT from MCS: ref #673998
2016-04-21 21:49:29 [DEBUG   ] summary = ERROR
2016-04-21 21:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673998  13 57499 78569674 A  ERRORERROR'
2016-04-21 21:49:29 [DEBUG   ] Got command RPT from MCS: ref #673999
2016-04-21 21:49:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   673999  77 57499 78569674 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:49:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 21:50:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 21:50:19 [DEBUG   ] Finished updating board flags in 2.052 seconds
2016-04-21 21:50:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 21:50:43 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2016-04-21 21:51:03 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2016-04-21 21:51:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 21:51:19 [DEBUG   ] Finished updating board flags in 1.990 seconds
2016-04-21 21:51:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 21:51:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 21:52:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 21:52:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 21:52:19 [DEBUG   ] Finished updating board flags in 1.813 seconds
2016-04-21 21:52:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 21:52:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 21:53:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 21:53:19 [DEBUG   ] Finished updating board flags in 1.796 seconds
2016-04-21 21:53:20 [DEBUG   ] Got command RPT from MCS: ref #674018
2016-04-21 21:53:20 [DEBUG   ] summary = ERROR
2016-04-21 21:53:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674018  13 57499 78800258 A  ERRORERROR'
2016-04-21 21:53:20 [DEBUG   ] Got command RPT from MCS: ref #674019
2016-04-21 21:53:20 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:53:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674019  77 57499 78800462 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:53:20 [DEBUG   ] Got command RPT from MCS: ref #674020
2016-04-21 21:53:20 [DEBUG   ] summary = ERROR
2016-04-21 21:53:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674020  13 57499 78800666 A  ERRORERROR'
2016-04-21 21:53:20 [DEBUG   ] Got command RPT from MCS: ref #674021
2016-04-21 21:53:20 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:53:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674021  77 57499 78800858 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:53:21 [DEBUG   ] Got command RPT from MCS: ref #674022
2016-04-21 21:53:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 21:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674022  12 57499 78801062 A  ERRORB‹ÌÍ'
2016-04-21 21:53:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 21:53:43 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 21:54:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 21:54:19 [DEBUG   ] Finished updating board flags in 1.641 seconds
2016-04-21 21:54:23 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-21 21:54:29 [DEBUG   ] Got command RPT from MCS: ref #674023
2016-04-21 21:54:29 [DEBUG   ] summary = ERROR
2016-04-21 21:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674023  13 57499 78869678 A  ERRORERROR'
2016-04-21 21:54:29 [DEBUG   ] Got command RPT from MCS: ref #674024
2016-04-21 21:54:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674024  77 57499 78869678 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:54:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 21:55:04 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2016-04-21 21:55:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 21:55:19 [DEBUG   ] Finished updating board flags in 1.556 seconds
2016-04-21 21:55:24 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-21 21:55:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 21:56:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 21:56:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 21:56:19 [DEBUG   ] Finished updating board flags in 1.412 seconds
2016-04-21 21:56:24 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-21 21:56:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 21:57:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 21:57:19 [DEBUG   ] Finished updating board flags in 1.391 seconds
2016-04-21 21:57:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 21:57:44 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-21 21:58:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 21:58:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 21:58:19 [DEBUG   ] Finished updating board flags in 1.367 seconds
2016-04-21 21:58:20 [DEBUG   ] Got command RPT from MCS: ref #674044
2016-04-21 21:58:20 [DEBUG   ] summary = ERROR
2016-04-21 21:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674044  13 57499 79100338 A  ERRORERROR'
2016-04-21 21:58:20 [DEBUG   ] Got command RPT from MCS: ref #674045
2016-04-21 21:58:20 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674045  77 57499 79100542 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:58:20 [DEBUG   ] Got command RPT from MCS: ref #674046
2016-04-21 21:58:20 [DEBUG   ] summary = ERROR
2016-04-21 21:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674046  13 57499 79100746 A  ERRORERROR'
2016-04-21 21:58:20 [DEBUG   ] Got command RPT from MCS: ref #674047
2016-04-21 21:58:20 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674047  77 57499 79100950 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:58:21 [DEBUG   ] Got command RPT from MCS: ref #674048
2016-04-21 21:58:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 21:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674048  12 57499 79101142 A  ERRORB‹ÌÍ'
2016-04-21 21:58:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 21:58:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 21:59:04 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-21 21:59:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 21:59:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 21:59:20 [DEBUG   ] Finished updating board flags in 2.091 seconds
2016-04-21 21:59:25 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2016-04-21 21:59:29 [DEBUG   ] Got command RPT from MCS: ref #674057
2016-04-21 21:59:29 [DEBUG   ] summary = ERROR
2016-04-21 21:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674057  13 57499 79169678 A  ERRORERROR'
2016-04-21 21:59:29 [DEBUG   ] Got command RPT from MCS: ref #674058
2016-04-21 21:59:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 21:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674058  77 57499 79169678 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 21:59:44 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2016-04-21 22:00:05 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2016-04-21 22:00:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 22:00:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 22:00:20 [DEBUG   ] Finished updating board flags in 1.956 seconds
2016-04-21 22:00:25 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-21 22:00:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 22:01:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 22:01:20 [DEBUG   ] Finished updating board flags in 1.829 seconds
2016-04-21 22:01:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 22:01:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 22:02:05 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 22:02:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 22:02:20 [DEBUG   ] Finished updating board flags in 1.816 seconds
2016-04-21 22:02:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 22:02:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 22:03:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 22:03:20 [DEBUG   ] Got command RPT from MCS: ref #674077
2016-04-21 22:03:20 [DEBUG   ] summary = ERROR
2016-04-21 22:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674077  13 57499 79400418 A  ERRORERROR'
2016-04-21 22:03:20 [DEBUG   ] Got command RPT from MCS: ref #674078
2016-04-21 22:03:20 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674078  77 57499 79400626 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:03:20 [DEBUG   ] Finished updating board flags in 1.775 seconds
2016-04-21 22:03:20 [DEBUG   ] Got command RPT from MCS: ref #674079
2016-04-21 22:03:20 [DEBUG   ] summary = ERROR
2016-04-21 22:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674079  13 57499 79400818 A  ERRORERROR'
2016-04-21 22:03:21 [DEBUG   ] Got command RPT from MCS: ref #674080
2016-04-21 22:03:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674080  77 57499 79401022 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:03:21 [DEBUG   ] Got command RPT from MCS: ref #674081
2016-04-21 22:03:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 22:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674081  12 57499 79401226 A  ERRORBŠÌÍ'
2016-04-21 22:03:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 22:03:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 22:04:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 22:04:20 [DEBUG   ] Finished updating board flags in 1.605 seconds
2016-04-21 22:04:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 22:04:29 [DEBUG   ] Got command RPT from MCS: ref #674084
2016-04-21 22:04:29 [DEBUG   ] summary = ERROR
2016-04-21 22:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674084  13 57499 79469682 A  ERRORERROR'
2016-04-21 22:04:29 [DEBUG   ] Got command RPT from MCS: ref #674085
2016-04-21 22:04:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674085  77 57499 79469682 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:04:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 22:05:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 22:05:20 [DEBUG   ] Finished updating board flags in 1.585 seconds
2016-04-21 22:05:25 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-21 22:05:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 22:06:05 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2016-04-21 22:06:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-21 22:06:20 [DEBUG   ] Finished updating board flags in 1.433 seconds
2016-04-21 22:06:26 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2016-04-21 22:06:46 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2016-04-21 22:07:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 22:07:20 [DEBUG   ] Finished updating board flags in 1.383 seconds
2016-04-21 22:07:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 22:07:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 22:08:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 22:08:20 [DEBUG   ] Got command RPT from MCS: ref #674106
2016-04-21 22:08:20 [DEBUG   ] summary = ERROR
2016-04-21 22:08:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674106  13 57499 79700498 A  ERRORERROR'
2016-04-21 22:08:20 [DEBUG   ] Got command RPT from MCS: ref #674107
2016-04-21 22:08:20 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:08:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674107  77 57499 79700703 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:08:20 [DEBUG   ] Got command RPT from MCS: ref #674108
2016-04-21 22:08:20 [DEBUG   ] summary = ERROR
2016-04-21 22:08:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674108  13 57499 79700906 A  ERRORERROR'
2016-04-21 22:08:21 [DEBUG   ] Got command RPT from MCS: ref #674109
2016-04-21 22:08:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674109  77 57499 79701098 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:08:21 [DEBUG   ] Got command RPT from MCS: ref #674110
2016-04-21 22:08:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 22:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674110  12 57499 79701302 A  ERRORB†ÌÍ'
2016-04-21 22:08:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 22:08:21 [DEBUG   ] Finished updating board flags in 2.204 seconds
2016-04-21 22:08:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 22:08:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 22:09:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 22:09:20 [DEBUG   ] Finished updating board flags in 1.312 seconds
2016-04-21 22:09:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 22:09:29 [DEBUG   ] Got command RPT from MCS: ref #674116
2016-04-21 22:09:29 [DEBUG   ] summary = ERROR
2016-04-21 22:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674116  13 57499 79769674 A  ERRORERROR'
2016-04-21 22:09:29 [DEBUG   ] Got command RPT from MCS: ref #674117
2016-04-21 22:09:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674117  77 57499 79769674 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:09:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 22:10:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 22:10:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 22:10:21 [DEBUG   ] Finished updating board flags in 2.084 seconds
2016-04-21 22:10:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-21 22:10:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 22:11:06 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2016-04-21 22:11:21 [DEBUG   ] Finished updating board flags in 2.026 seconds
2016-04-21 22:11:27 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2016-04-21 22:11:47 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-21 22:12:07 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-21 22:12:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 22:12:21 [DEBUG   ] Finished updating board flags in 2.011 seconds
2016-04-21 22:12:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 22:12:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 22:13:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 22:13:20 [DEBUG   ] Got command RPT from MCS: ref #674136
2016-04-21 22:13:20 [DEBUG   ] summary = ERROR
2016-04-21 22:13:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674136  13 57499 80000570 A  ERRORERROR'
2016-04-21 22:13:20 [DEBUG   ] Got command RPT from MCS: ref #674137
2016-04-21 22:13:20 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:13:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674137  77 57499 80000774 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:13:20 [DEBUG   ] Got command RPT from MCS: ref #674138
2016-04-21 22:13:20 [DEBUG   ] summary = ERROR
2016-04-21 22:13:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674138  13 57499 80000978 A  ERRORERROR'
2016-04-21 22:13:21 [DEBUG   ] Got command RPT from MCS: ref #674139
2016-04-21 22:13:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674139  77 57499 80001174 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:13:21 [DEBUG   ] Got command RPT from MCS: ref #674140
2016-04-21 22:13:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 22:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674140  12 57499 80001378 A  ERRORB†ÌÍ'
2016-04-21 22:13:21 [DEBUG   ] Finished updating board flags in 1.970 seconds
2016-04-21 22:13:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 22:13:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 22:14:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 22:14:21 [DEBUG   ] Finished updating board flags in 1.812 seconds
2016-04-21 22:14:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 22:14:29 [DEBUG   ] Got command RPT from MCS: ref #674144
2016-04-21 22:14:29 [DEBUG   ] summary = ERROR
2016-04-21 22:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674144  13 57499 80069678 A  ERRORERROR'
2016-04-21 22:14:29 [DEBUG   ] Got command RPT from MCS: ref #674145
2016-04-21 22:14:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674145  77 57499 80069678 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:14:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 22:15:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 22:15:21 [DEBUG   ] Finished updating board flags in 1.873 seconds
2016-04-21 22:15:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 22:15:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 22:16:07 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-21 22:16:21 [DEBUG   ] Finished updating board flags in 1.737 seconds
2016-04-21 22:16:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 22:16:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 22:17:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 22:17:21 [DEBUG   ] Finished updating board flags in 1.603 seconds
2016-04-21 22:17:28 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2016-04-21 22:17:48 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-21 22:18:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 22:18:20 [DEBUG   ] Got command RPT from MCS: ref #674170
2016-04-21 22:18:20 [DEBUG   ] summary = ERROR
2016-04-21 22:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674170  13 57499 80300654 A  ERRORERROR'
2016-04-21 22:18:20 [DEBUG   ] Got command RPT from MCS: ref #674171
2016-04-21 22:18:20 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674171  77 57499 80300846 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:18:21 [DEBUG   ] Got command RPT from MCS: ref #674172
2016-04-21 22:18:21 [DEBUG   ] summary = ERROR
2016-04-21 22:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674172  13 57499 80301050 A  ERRORERROR'
2016-04-21 22:18:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 22:18:21 [DEBUG   ] Got command RPT from MCS: ref #674173
2016-04-21 22:18:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674173  77 57499 80301254 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:18:21 [DEBUG   ] Got command RPT from MCS: ref #674174
2016-04-21 22:18:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 22:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674174  12 57499 80301458 A  ERRORBŠÌÍ'
2016-04-21 22:18:21 [DEBUG   ] Finished updating board flags in 1.577 seconds
2016-04-21 22:18:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 22:18:48 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-21 22:19:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 22:19:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 22:19:21 [DEBUG   ] Finished updating board flags in 1.425 seconds
2016-04-21 22:19:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 22:19:29 [DEBUG   ] Got command RPT from MCS: ref #674180
2016-04-21 22:19:29 [DEBUG   ] summary = ERROR
2016-04-21 22:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674180  13 57499 80369682 A  ERRORERROR'
2016-04-21 22:19:29 [DEBUG   ] Got command RPT from MCS: ref #674181
2016-04-21 22:19:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674181  77 57499 80369682 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:19:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 22:20:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 22:20:21 [DEBUG   ] Finished updating board flags in 1.412 seconds
2016-04-21 22:20:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 22:20:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 22:21:08 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-21 22:21:21 [DEBUG   ] Finished updating board flags in 1.398 seconds
2016-04-21 22:21:28 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-21 22:21:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 22:22:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 22:22:22 [DEBUG   ] Finished updating board flags in 2.197 seconds
2016-04-21 22:22:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 22:22:48 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-21 22:23:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 22:23:20 [DEBUG   ] Got command RPT from MCS: ref #674203
2016-04-21 22:23:20 [DEBUG   ] summary = ERROR
2016-04-21 22:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674203  13 57499 80600730 A  ERRORERROR'
2016-04-21 22:23:20 [DEBUG   ] Got command RPT from MCS: ref #674204
2016-04-21 22:23:20 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674204  77 57499 80600934 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:23:21 [DEBUG   ] Got command RPT from MCS: ref #674205
2016-04-21 22:23:21 [DEBUG   ] summary = ERROR
2016-04-21 22:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674205  13 57499 80601138 A  ERRORERROR'
2016-04-21 22:23:21 [DEBUG   ] Got command RPT from MCS: ref #674206
2016-04-21 22:23:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674206  77 57499 80601330 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:23:21 [DEBUG   ] Got command RPT from MCS: ref #674207
2016-04-21 22:23:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 22:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674207  12 57499 80601534 A  ERRORB€'
2016-04-21 22:23:22 [DEBUG   ] Finished updating board flags in 1.986 seconds
2016-04-21 22:23:29 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2016-04-21 22:23:49 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-21 22:24:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 22:24:22 [DEBUG   ] Finished updating board flags in 1.804 seconds
2016-04-21 22:24:29 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-21 22:24:29 [DEBUG   ] Got command RPT from MCS: ref #674208
2016-04-21 22:24:29 [DEBUG   ] summary = ERROR
2016-04-21 22:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674208  13 57499 80669682 A  ERRORERROR'
2016-04-21 22:24:29 [DEBUG   ] Got command RPT from MCS: ref #674209
2016-04-21 22:24:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674209  77 57499 80669682 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:24:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 22:25:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 22:25:22 [DEBUG   ] Finished updating board flags in 1.807 seconds
2016-04-21 22:25:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 22:25:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 22:26:00 [DEBUG   ] Got command TBN from MCS: ref #674228
2016-04-21 22:26:00 [DEBUG   ] spawn_process: at 2016-04-21 22:26:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1461277562']
2016-04-21 22:26:00 [DEBUG   ] spawn_process: at 2016-04-21 22:26:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1461277562']
2016-04-21 22:26:00 [DEBUG   ] spawn_process: at 2016-04-21 22:26:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1461277562']
2016-04-21 22:26:00 [DEBUG   ] tbn = exited with status True, code 0x00
2016-04-21 22:26:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   674228   8 57499 80760987 A  ERROR'
2016-04-21 22:26:00 [DEBUG   ] spawn_process: at 2016-04-21 22:26:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1461277562']
2016-04-21 22:26:00 [DEBUG   ] spawn_process: at 2016-04-21 22:26:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1461277562']
2016-04-21 22:26:00 [DEBUG   ] spawn_process: at 2016-04-21 22:26:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1461277562']
2016-04-21 22:26:00 [DEBUG   ] spawn_process: at 2016-04-21 22:26:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1461277562']
2016-04-21 22:26:00 [DEBUG   ] spawn_process: at 2016-04-21 22:26:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1461277562']
2016-04-21 22:26:00 [DEBUG   ] spawn_process: at 2016-04-21 22:26:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1461277562']
2016-04-21 22:26:01 [DEBUG   ] spawn_process: at 2016-04-21 22:26:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1461277562']
2016-04-21 22:26:01 [DEBUG   ] spawn_process: at 2016-04-21 22:26:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1461277562']
2016-04-21 22:26:01 [DEBUG   ] spawn_process: at 2016-04-21 22:26:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1461277562']
2016-04-21 22:26:01 [DEBUG   ] spawn_process: at 2016-04-21 22:26:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1461277562']
2016-04-21 22:26:01 [DEBUG   ] spawn_process: at 2016-04-21 22:26:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1461277562']
2016-04-21 22:26:01 [DEBUG   ] spawn_process: at 2016-04-21 22:26:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1461277562']
2016-04-21 22:26:01 [DEBUG   ] spawn_process: at 2016-04-21 22:26:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1461277562']
2016-04-21 22:26:01 [DEBUG   ] spawn_process: at 2016-04-21 22:26:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1461277562']
2016-04-21 22:26:01 [DEBUG   ] spawn_process: at 2016-04-21 22:26:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1461277562']
2016-04-21 22:26:01 [DEBUG   ] spawn_process: at 2016-04-21 22:26:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1461277562']
2016-04-21 22:26:01 [DEBUG   ] spawn_process: at 2016-04-21 22:26:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1461277562']
2016-04-21 22:26:01 [DEBUG   ] spawn_process: at 2016-04-21 22:26:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1461277562']
2016-04-21 22:26:01 [DEBUG   ] spawn_process: at 2016-04-21 22:26:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1461277562']
2016-04-21 22:26:01 [DEBUG   ] spawn_process: at 2016-04-21 22:26:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1461277562']
2016-04-21 22:26:01 [DEBUG   ] spawn_process: at 2016-04-21 22:26:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1461277562']
2016-04-21 22:26:01 [DEBUG   ] spawn_process: at 2016-04-21 22:26:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1461277562']
2016-04-21 22:26:01 [DEBUG   ] spawn_process: at 2016-04-21 22:26:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1461277562']
2016-04-21 22:26:01 [INFO    ] Finished spawning TBN in 0.051 s
2016-04-21 22:26:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 22:26:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 22:26:22 [DEBUG   ] Finished updating board flags in 1.789 seconds
2016-04-21 22:26:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 22:26:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 22:27:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 22:27:22 [DEBUG   ] Finished updating board flags in 1.618 seconds
2016-04-21 22:27:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 22:27:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 22:28:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 22:28:20 [DEBUG   ] Got command RPT from MCS: ref #674230
2016-04-21 22:28:20 [DEBUG   ] summary = ERROR
2016-04-21 22:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674230  13 57499 80900826 A  ERRORERROR'
2016-04-21 22:28:21 [DEBUG   ] Got command RPT from MCS: ref #674231
2016-04-21 22:28:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674231  77 57499 80901018 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:28:21 [DEBUG   ] Got command RPT from MCS: ref #674232
2016-04-21 22:28:21 [DEBUG   ] summary = ERROR
2016-04-21 22:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674232  13 57499 80901222 A  ERRORERROR'
2016-04-21 22:28:21 [DEBUG   ] Got command RPT from MCS: ref #674233
2016-04-21 22:28:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674233  77 57499 80901418 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:28:21 [DEBUG   ] Got command RPT from MCS: ref #674234
2016-04-21 22:28:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 22:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674234  12 57499 80901622 A  ERRORB€'
2016-04-21 22:28:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 22:28:22 [DEBUG   ] Finished updating board flags in 1.585 seconds
2016-04-21 22:28:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-21 22:28:49 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2016-04-21 22:29:10 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2016-04-21 22:29:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-21 22:29:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 22:29:22 [DEBUG   ] Finished updating board flags in 1.414 seconds
2016-04-21 22:29:29 [DEBUG   ] Got command RPT from MCS: ref #674243
2016-04-21 22:29:29 [DEBUG   ] summary = ERROR
2016-04-21 22:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674243  13 57499 80969682 A  ERRORERROR'
2016-04-21 22:29:29 [DEBUG   ] Got command RPT from MCS: ref #674244
2016-04-21 22:29:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674244  77 57499 80969682 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:29:30 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2016-04-21 22:29:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 22:30:10 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-21 22:30:22 [DEBUG   ] Finished updating board flags in 1.404 seconds
2016-04-21 22:30:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 22:30:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 22:31:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 22:31:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 22:31:22 [DEBUG   ] Finished updating board flags in 1.386 seconds
2016-04-21 22:31:30 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-21 22:31:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 22:32:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 22:32:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 22:32:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 22:32:22 [DEBUG   ] Finished updating board flags in 1.356 seconds
2016-04-21 22:32:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 22:32:50 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-21 22:33:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 22:33:20 [DEBUG   ] Got command RPT from MCS: ref #674263
2016-04-21 22:33:20 [DEBUG   ] summary = ERROR
2016-04-21 22:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674263  13 57499 81200922 A  ERRORERROR'
2016-04-21 22:33:21 [DEBUG   ] Got command RPT from MCS: ref #674264
2016-04-21 22:33:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674264  77 57499 81201126 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:33:21 [DEBUG   ] Got command RPT from MCS: ref #674265
2016-04-21 22:33:21 [DEBUG   ] summary = ERROR
2016-04-21 22:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674265  13 57499 81201330 A  ERRORERROR'
2016-04-21 22:33:21 [DEBUG   ] Got command RPT from MCS: ref #674266
2016-04-21 22:33:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674266  77 57499 81201522 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:33:21 [DEBUG   ] Got command RPT from MCS: ref #674267
2016-04-21 22:33:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 22:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674267  12 57499 81201726 A  ERRORB‰ÌÍ'
2016-04-21 22:33:23 [DEBUG   ] Finished updating board flags in 2.059 seconds
2016-04-21 22:33:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 22:33:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 22:34:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-21 22:34:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 22:34:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 22:34:23 [DEBUG   ] Finished updating board flags in 1.997 seconds
2016-04-21 22:34:29 [DEBUG   ] Got command RPT from MCS: ref #674268
2016-04-21 22:34:29 [DEBUG   ] summary = ERROR
2016-04-21 22:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674268  13 57499 81269678 A  ERRORERROR'
2016-04-21 22:34:29 [DEBUG   ] Got command RPT from MCS: ref #674269
2016-04-21 22:34:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674269  77 57499 81269678 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:34:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-21 22:34:50 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2016-04-21 22:35:11 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2016-04-21 22:35:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 22:35:23 [DEBUG   ] Finished updating board flags in 1.809 seconds
2016-04-21 22:35:31 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-21 22:35:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 22:36:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 22:36:23 [DEBUG   ] Finished updating board flags in 1.797 seconds
2016-04-21 22:36:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 22:36:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 22:37:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 22:37:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 22:37:23 [DEBUG   ] Finished updating board flags in 1.600 seconds
2016-04-21 22:37:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 22:37:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 22:38:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 22:38:21 [DEBUG   ] Got command RPT from MCS: ref #674292
2016-04-21 22:38:21 [DEBUG   ] summary = ERROR
2016-04-21 22:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674292  13 57499 81501006 A  ERRORERROR'
2016-04-21 22:38:21 [DEBUG   ] Got command RPT from MCS: ref #674293
2016-04-21 22:38:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674293  77 57499 81501210 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:38:21 [DEBUG   ] Got command RPT from MCS: ref #674294
2016-04-21 22:38:21 [DEBUG   ] summary = ERROR
2016-04-21 22:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674294  13 57499 81501414 A  ERRORERROR'
2016-04-21 22:38:21 [DEBUG   ] Got command RPT from MCS: ref #674295
2016-04-21 22:38:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674295  77 57499 81501606 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:38:21 [DEBUG   ] Got command RPT from MCS: ref #674296
2016-04-21 22:38:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 22:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674296  12 57499 81501810 A  ERRORB‹ÌÍ'
2016-04-21 22:38:23 [DEBUG   ] Finished updating board flags in 1.604 seconds
2016-04-21 22:38:31 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-21 22:38:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 22:39:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 22:39:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 22:39:23 [DEBUG   ] Finished updating board flags in 1.595 seconds
2016-04-21 22:39:29 [DEBUG   ] Got command RPT from MCS: ref #674302
2016-04-21 22:39:29 [DEBUG   ] summary = ERROR
2016-04-21 22:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674302  13 57499 81569682 A  ERRORERROR'
2016-04-21 22:39:29 [DEBUG   ] Got command RPT from MCS: ref #674303
2016-04-21 22:39:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674303  77 57499 81569682 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:39:31 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-21 22:39:51 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2016-04-21 22:40:12 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2016-04-21 22:40:23 [DEBUG   ] Finished updating board flags in 1.410 seconds
2016-04-21 22:40:32 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-21 22:40:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 22:41:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 22:41:23 [DEBUG   ] Finished updating board flags in 1.386 seconds
2016-04-21 22:41:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 22:41:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 22:42:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 22:42:23 [DEBUG   ] Finished updating board flags in 1.354 seconds
2016-04-21 22:42:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 22:42:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 22:43:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 22:43:21 [DEBUG   ] Got command RPT from MCS: ref #674322
2016-04-21 22:43:21 [DEBUG   ] summary = ERROR
2016-04-21 22:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674322  13 57499 81801086 A  ERRORERROR'
2016-04-21 22:43:21 [DEBUG   ] Got command RPT from MCS: ref #674323
2016-04-21 22:43:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674323  77 57499 81801290 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:43:21 [DEBUG   ] Got command RPT from MCS: ref #674324
2016-04-21 22:43:21 [DEBUG   ] summary = ERROR
2016-04-21 22:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674324  13 57499 81801482 A  ERRORERROR'
2016-04-21 22:43:21 [DEBUG   ] Got command RPT from MCS: ref #674325
2016-04-21 22:43:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674325  77 57499 81801686 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:43:21 [DEBUG   ] Got command RPT from MCS: ref #674326
2016-04-21 22:43:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 22:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674326  12 57499 81801890 A  ERRORBŠÌÍ'
2016-04-21 22:43:24 [DEBUG   ] Finished updating board flags in 2.061 seconds
2016-04-21 22:43:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 22:43:52 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2016-04-21 22:44:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 22:44:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 22:44:24 [DEBUG   ] Finished updating board flags in 1.994 seconds
2016-04-21 22:44:29 [DEBUG   ] Got command RPT from MCS: ref #674330
2016-04-21 22:44:29 [DEBUG   ] summary = ERROR
2016-04-21 22:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674330  13 57499 81869690 A  ERRORERROR'
2016-04-21 22:44:29 [DEBUG   ] Got command RPT from MCS: ref #674331
2016-04-21 22:44:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674331  77 57499 81869690 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:44:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 22:44:52 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-21 22:45:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 22:45:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 22:45:24 [DEBUG   ] Finished updating board flags in 1.831 seconds
2016-04-21 22:45:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 22:45:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 22:46:13 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2016-04-21 22:46:24 [DEBUG   ] Finished updating board flags in 1.807 seconds
2016-04-21 22:46:33 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-21 22:46:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 22:47:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 22:47:24 [DEBUG   ] Finished updating board flags in 1.769 seconds
2016-04-21 22:47:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 22:47:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 22:48:13 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 22:48:21 [DEBUG   ] Got command RPT from MCS: ref #674351
2016-04-21 22:48:21 [DEBUG   ] summary = ERROR
2016-04-21 22:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674351  13 57499 82101170 A  ERRORERROR'
2016-04-21 22:48:21 [DEBUG   ] Got command RPT from MCS: ref #674352
2016-04-21 22:48:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674352  77 57499 82101374 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:48:21 [DEBUG   ] Got command RPT from MCS: ref #674353
2016-04-21 22:48:21 [DEBUG   ] summary = ERROR
2016-04-21 22:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674353  13 57499 82101578 A  ERRORERROR'
2016-04-21 22:48:21 [DEBUG   ] Got command RPT from MCS: ref #674354
2016-04-21 22:48:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674354  77 57499 82101782 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:48:21 [DEBUG   ] Got command RPT from MCS: ref #674355
2016-04-21 22:48:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 22:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674355  12 57499 82101974 A  ERRORBŠÌÍ'
2016-04-21 22:48:24 [DEBUG   ] Finished updating board flags in 1.608 seconds
2016-04-21 22:48:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 22:48:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 22:49:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 22:49:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 22:49:24 [DEBUG   ] Finished updating board flags in 1.594 seconds
2016-04-21 22:49:29 [DEBUG   ] Got command RPT from MCS: ref #674361
2016-04-21 22:49:29 [DEBUG   ] summary = ERROR
2016-04-21 22:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674361  13 57499 82169686 A  ERRORERROR'
2016-04-21 22:49:29 [DEBUG   ] Got command RPT from MCS: ref #674362
2016-04-21 22:49:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674362  77 57499 82169686 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:49:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 22:49:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 22:50:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 22:50:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 22:50:24 [DEBUG   ] Finished updating board flags in 1.459 seconds
2016-04-21 22:50:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 22:50:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-21 22:51:13 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2016-04-21 22:51:24 [DEBUG   ] Finished updating board flags in 1.409 seconds
2016-04-21 22:51:34 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2016-04-21 22:51:54 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2016-04-21 22:52:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 22:52:24 [DEBUG   ] Finished updating board flags in 1.361 seconds
2016-04-21 22:52:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-21 22:52:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 22:53:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 22:53:21 [DEBUG   ] Got command RPT from MCS: ref #674384
2016-04-21 22:53:21 [DEBUG   ] summary = ERROR
2016-04-21 22:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674384  13 57499 82401270 A  ERRORERROR'
2016-04-21 22:53:21 [DEBUG   ] Got command RPT from MCS: ref #674385
2016-04-21 22:53:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674385  77 57499 82401474 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:53:21 [DEBUG   ] Got command RPT from MCS: ref #674386
2016-04-21 22:53:21 [DEBUG   ] summary = ERROR
2016-04-21 22:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674386  13 57499 82401666 A  ERRORERROR'
2016-04-21 22:53:21 [DEBUG   ] Got command RPT from MCS: ref #674387
2016-04-21 22:53:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674387  77 57499 82401870 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:53:22 [DEBUG   ] Got command RPT from MCS: ref #674388
2016-04-21 22:53:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 22:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674388  12 57499 82402074 A  ERRORBŠÌÍ'
2016-04-21 22:53:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 22:53:25 [DEBUG   ] Finished updating board flags in 2.199 seconds
2016-04-21 22:53:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 22:53:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-21 22:54:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 22:54:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 22:54:25 [DEBUG   ] Finished updating board flags in 1.982 seconds
2016-04-21 22:54:29 [DEBUG   ] Got command RPT from MCS: ref #674389
2016-04-21 22:54:29 [DEBUG   ] summary = ERROR
2016-04-21 22:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674389  13 57499 82469686 A  ERRORERROR'
2016-04-21 22:54:29 [DEBUG   ] Got command RPT from MCS: ref #674390
2016-04-21 22:54:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674390  77 57499 82469686 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:54:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 22:54:54 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 22:55:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-21 22:55:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 22:55:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 22:55:25 [DEBUG   ] Finished updating board flags in 1.851 seconds
2016-04-21 22:55:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 22:55:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 22:56:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 22:56:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 22:56:25 [DEBUG   ] Finished updating board flags in 1.750 seconds
2016-04-21 22:56:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-21 22:56:55 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2016-04-21 22:57:15 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-21 22:57:25 [DEBUG   ] Finished updating board flags in 1.614 seconds
2016-04-21 22:57:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 22:57:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 22:58:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 22:58:21 [DEBUG   ] Got command RPT from MCS: ref #674410
2016-04-21 22:58:21 [DEBUG   ] summary = ERROR
2016-04-21 22:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674410  13 57499 82701358 A  ERRORERROR'
2016-04-21 22:58:21 [DEBUG   ] Got command RPT from MCS: ref #674411
2016-04-21 22:58:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674411  77 57499 82701550 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:58:21 [DEBUG   ] Got command RPT from MCS: ref #674412
2016-04-21 22:58:21 [DEBUG   ] summary = ERROR
2016-04-21 22:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674412  13 57499 82701754 A  ERRORERROR'
2016-04-21 22:58:21 [DEBUG   ] Got command RPT from MCS: ref #674413
2016-04-21 22:58:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674413  77 57499 82701958 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:58:22 [DEBUG   ] Got command RPT from MCS: ref #674414
2016-04-21 22:58:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 22:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674414  12 57499 82702162 A  ERRORB‹ÌÍ'
2016-04-21 22:58:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 22:58:25 [DEBUG   ] Finished updating board flags in 1.594 seconds
2016-04-21 22:58:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 22:58:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 22:59:15 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 22:59:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 22:59:25 [DEBUG   ] Finished updating board flags in 1.405 seconds
2016-04-21 22:59:29 [DEBUG   ] Got command RPT from MCS: ref #674423
2016-04-21 22:59:29 [DEBUG   ] summary = ERROR
2016-04-21 22:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674423  13 57499 82769686 A  ERRORERROR'
2016-04-21 22:59:29 [DEBUG   ] Got command RPT from MCS: ref #674424
2016-04-21 22:59:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 22:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674424  77 57499 82769686 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 22:59:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-21 22:59:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 23:00:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 23:00:25 [DEBUG   ] Finished updating board flags in 1.391 seconds
2016-04-21 23:00:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 23:00:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 23:01:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 23:01:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 23:01:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 23:01:25 [DEBUG   ] Finished updating board flags in 1.379 seconds
2016-04-21 23:01:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 23:01:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 23:02:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 23:02:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 23:02:26 [DEBUG   ] Finished updating board flags in 2.047 seconds
2016-04-21 23:02:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 23:02:56 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2016-04-21 23:03:16 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2016-04-21 23:03:21 [DEBUG   ] Got command RPT from MCS: ref #674443
2016-04-21 23:03:21 [DEBUG   ] summary = ERROR
2016-04-21 23:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674443  13 57499 83001426 A  ERRORERROR'
2016-04-21 23:03:21 [DEBUG   ] Got command RPT from MCS: ref #674444
2016-04-21 23:03:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674444  77 57499 83001630 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:03:21 [DEBUG   ] Got command RPT from MCS: ref #674445
2016-04-21 23:03:21 [DEBUG   ] summary = ERROR
2016-04-21 23:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674445  13 57499 83001834 A  ERRORERROR'
2016-04-21 23:03:22 [DEBUG   ] Got command RPT from MCS: ref #674446
2016-04-21 23:03:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674446  77 57499 83002038 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:03:22 [DEBUG   ] Got command RPT from MCS: ref #674447
2016-04-21 23:03:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 23:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674447  12 57499 83002230 A  ERRORBŠÌÍ'
2016-04-21 23:03:26 [DEBUG   ] Finished updating board flags in 2.003 seconds
2016-04-21 23:03:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-21 23:03:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 23:04:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 23:04:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 23:04:26 [DEBUG   ] Finished updating board flags in 1.985 seconds
2016-04-21 23:04:29 [DEBUG   ] Got command RPT from MCS: ref #674448
2016-04-21 23:04:29 [DEBUG   ] summary = ERROR
2016-04-21 23:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674448  13 57499 83069690 A  ERRORERROR'
2016-04-21 23:04:29 [DEBUG   ] Got command RPT from MCS: ref #674449
2016-04-21 23:04:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674449  77 57499 83069690 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:04:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 23:04:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 23:05:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 23:05:26 [DEBUG   ] Finished updating board flags in 1.813 seconds
2016-04-21 23:05:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 23:05:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 23:06:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 23:06:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 23:06:26 [DEBUG   ] Finished updating board flags in 1.833 seconds
2016-04-21 23:06:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 23:06:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 23:07:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 23:07:26 [DEBUG   ] Finished updating board flags in 1.804 seconds
2016-04-21 23:07:36 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 23:07:57 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2016-04-21 23:08:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 23:08:21 [DEBUG   ] Got command RPT from MCS: ref #674472
2016-04-21 23:08:21 [DEBUG   ] summary = ERROR
2016-04-21 23:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674472  13 57499 83301518 A  ERRORERROR'
2016-04-21 23:08:21 [DEBUG   ] Got command RPT from MCS: ref #674473
2016-04-21 23:08:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674473  77 57499 83301722 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:08:21 [DEBUG   ] Got command RPT from MCS: ref #674474
2016-04-21 23:08:21 [DEBUG   ] summary = ERROR
2016-04-21 23:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674474  13 57499 83301926 A  ERRORERROR'
2016-04-21 23:08:22 [DEBUG   ] Got command RPT from MCS: ref #674475
2016-04-21 23:08:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674475  77 57499 83302118 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:08:22 [DEBUG   ] Got command RPT from MCS: ref #674476
2016-04-21 23:08:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 23:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674476  12 57499 83302322 A  ERRORB‹ÌÍ'
2016-04-21 23:08:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 23:08:26 [DEBUG   ] Finished updating board flags in 1.752 seconds
2016-04-21 23:08:36 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2016-04-21 23:08:57 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2016-04-21 23:09:17 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2016-04-21 23:09:26 [DEBUG   ] Finished updating board flags in 1.612 seconds
2016-04-21 23:09:29 [DEBUG   ] Got command RPT from MCS: ref #674482
2016-04-21 23:09:29 [DEBUG   ] summary = ERROR
2016-04-21 23:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674482  13 57499 83369694 A  ERRORERROR'
2016-04-21 23:09:29 [DEBUG   ] Got command RPT from MCS: ref #674483
2016-04-21 23:09:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674483  77 57499 83369694 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:09:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 23:09:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 23:10:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 23:10:26 [DEBUG   ] Finished updating board flags in 1.608 seconds
2016-04-21 23:10:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 23:10:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 23:11:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 23:11:26 [DEBUG   ] Finished updating board flags in 1.602 seconds
2016-04-21 23:11:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 23:11:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 23:12:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 23:12:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 23:12:26 [DEBUG   ] Finished updating board flags in 1.635 seconds
2016-04-21 23:12:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 23:12:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 23:13:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 23:13:21 [DEBUG   ] Got command RPT from MCS: ref #674502
2016-04-21 23:13:21 [DEBUG   ] summary = ERROR
2016-04-21 23:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674502  13 57499 83601598 A  ERRORERROR'
2016-04-21 23:13:21 [DEBUG   ] Got command RPT from MCS: ref #674503
2016-04-21 23:13:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674503  77 57499 83601802 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:13:22 [DEBUG   ] Got command RPT from MCS: ref #674504
2016-04-21 23:13:22 [DEBUG   ] summary = ERROR
2016-04-21 23:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674504  13 57499 83602006 A  ERRORERROR'
2016-04-21 23:13:22 [DEBUG   ] Got command RPT from MCS: ref #674505
2016-04-21 23:13:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674505  77 57499 83602210 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:13:22 [DEBUG   ] Got command RPT from MCS: ref #674506
2016-04-21 23:13:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 23:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674506  12 57499 83602402 A  ERRORBŠÌÍ'
2016-04-21 23:13:26 [DEBUG   ] Finished updating board flags in 1.557 seconds
2016-04-21 23:13:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 23:13:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 23:14:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-21 23:14:26 [DEBUG   ] Finished updating board flags in 1.416 seconds
2016-04-21 23:14:29 [DEBUG   ] Got command RPT from MCS: ref #674510
2016-04-21 23:14:29 [DEBUG   ] summary = ERROR
2016-04-21 23:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674510  13 57499 83669690 A  ERRORERROR'
2016-04-21 23:14:29 [DEBUG   ] Got command RPT from MCS: ref #674511
2016-04-21 23:14:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674511  77 57499 83669690 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:14:38 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-21 23:14:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 23:15:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 23:15:26 [DEBUG   ] Finished updating board flags in 1.389 seconds
2016-04-21 23:15:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 23:15:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 23:16:18 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2016-04-21 23:16:26 [DEBUG   ] Finished updating board flags in 1.379 seconds
2016-04-21 23:16:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 23:16:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 23:17:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-21 23:17:27 [DEBUG   ] Finished updating board flags in 2.058 seconds
2016-04-21 23:17:38 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-21 23:17:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 23:18:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-21 23:18:21 [DEBUG   ] Got command RPT from MCS: ref #674531
2016-04-21 23:18:21 [DEBUG   ] summary = ERROR
2016-04-21 23:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674531  13 57499 83901690 A  ERRORERROR'
2016-04-21 23:18:21 [DEBUG   ] Got command RPT from MCS: ref #674532
2016-04-21 23:18:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674532  77 57499 83901882 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:18:22 [DEBUG   ] Got command RPT from MCS: ref #674533
2016-04-21 23:18:22 [DEBUG   ] summary = ERROR
2016-04-21 23:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674533  13 57499 83902086 A  ERRORERROR'
2016-04-21 23:18:22 [DEBUG   ] Got command RPT from MCS: ref #674534
2016-04-21 23:18:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674534  77 57499 83902290 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:18:22 [DEBUG   ] Got command RPT from MCS: ref #674535
2016-04-21 23:18:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 23:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674535  12 57499 83902494 A  ERRORBŠÌÍ'
2016-04-21 23:18:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 23:18:27 [DEBUG   ] Finished updating board flags in 1.979 seconds
2016-04-21 23:18:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 23:18:58 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-21 23:19:19 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2016-04-21 23:19:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-21 23:19:27 [DEBUG   ] Finished updating board flags in 1.811 seconds
2016-04-21 23:19:29 [DEBUG   ] Got command RPT from MCS: ref #674541
2016-04-21 23:19:29 [DEBUG   ] summary = ERROR
2016-04-21 23:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674541  13 57499 83969694 A  ERRORERROR'
2016-04-21 23:19:29 [DEBUG   ] Got command RPT from MCS: ref #674542
2016-04-21 23:19:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674542  77 57499 83969694 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:19:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 23:19:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 23:20:19 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-21 23:20:27 [DEBUG   ] Finished updating board flags in 1.790 seconds
2016-04-21 23:20:39 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 23:20:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 23:21:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 23:21:27 [DEBUG   ] Finished updating board flags in 1.602 seconds
2016-04-21 23:21:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 23:21:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 23:22:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 23:22:27 [DEBUG   ] Finished updating board flags in 1.597 seconds
2016-04-21 23:22:40 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2016-04-21 23:23:00 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2016-04-21 23:23:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 23:23:21 [DEBUG   ] Got command RPT from MCS: ref #674564
2016-04-21 23:23:21 [DEBUG   ] summary = ERROR
2016-04-21 23:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674564  13 57499 84201770 A  ERRORERROR'
2016-04-21 23:23:21 [DEBUG   ] Got command RPT from MCS: ref #674565
2016-04-21 23:23:21 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674565  77 57499 84201974 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:23:22 [DEBUG   ] Got command RPT from MCS: ref #674566
2016-04-21 23:23:22 [DEBUG   ] summary = ERROR
2016-04-21 23:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674566  13 57499 84202166 A  ERRORERROR'
2016-04-21 23:23:22 [DEBUG   ] Got command RPT from MCS: ref #674567
2016-04-21 23:23:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674567  77 57499 84202370 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:23:22 [DEBUG   ] Got command RPT from MCS: ref #674568
2016-04-21 23:23:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 23:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674568  12 57499 84202574 A  ERRORB‹ÌÍ'
2016-04-21 23:23:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-21 23:23:27 [DEBUG   ] Finished updating board flags in 1.408 seconds
2016-04-21 23:23:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 23:24:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 23:24:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 23:24:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-21 23:24:27 [DEBUG   ] Finished updating board flags in 1.409 seconds
2016-04-21 23:24:29 [DEBUG   ] Got command RPT from MCS: ref #674569
2016-04-21 23:24:29 [DEBUG   ] summary = ERROR
2016-04-21 23:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674569  13 57499 84269694 A  ERRORERROR'
2016-04-21 23:24:29 [DEBUG   ] Got command RPT from MCS: ref #674570
2016-04-21 23:24:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674570  77 57499 84269694 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:24:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 23:25:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 23:25:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 23:25:27 [DEBUG   ] Finished updating board flags in 1.392 seconds
2016-04-21 23:25:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 23:26:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 23:26:21 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2016-04-21 23:26:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 23:26:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 23:26:27 [DEBUG   ] Finished updating board flags in 1.354 seconds
2016-04-21 23:26:41 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2016-04-21 23:27:01 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 23:27:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-21 23:27:28 [DEBUG   ] Finished updating board flags in 2.056 seconds
2016-04-21 23:27:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 23:28:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-21 23:28:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 23:28:21 [DEBUG   ] Got command RPT from MCS: ref #674590
2016-04-21 23:28:21 [DEBUG   ] summary = ERROR
2016-04-21 23:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674590  13 57499 84501866 A  ERRORERROR'
2016-04-21 23:28:22 [DEBUG   ] Got command RPT from MCS: ref #674591
2016-04-21 23:28:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:28:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674591  77 57499 84502058 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:28:22 [DEBUG   ] Got command RPT from MCS: ref #674592
2016-04-21 23:28:22 [DEBUG   ] summary = ERROR
2016-04-21 23:28:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674592  13 57499 84502262 A  ERRORERROR'
2016-04-21 23:28:22 [DEBUG   ] Got command RPT from MCS: ref #674593
2016-04-21 23:28:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:28:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674593  77 57499 84502466 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:28:22 [DEBUG   ] Got command RPT from MCS: ref #674594
2016-04-21 23:28:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 23:28:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674594  12 57499 84502670 A  ERRORBŠÌÍ'
2016-04-21 23:28:28 [DEBUG   ] Finished updating board flags in 1.991 seconds
2016-04-21 23:28:41 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-21 23:29:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-21 23:29:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-21 23:29:28 [DEBUG   ] Finished updating board flags in 1.815 seconds
2016-04-21 23:29:29 [DEBUG   ] Got command RPT from MCS: ref #674603
2016-04-21 23:29:29 [DEBUG   ] summary = ERROR
2016-04-21 23:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674603  13 57499 84569690 A  ERRORERROR'
2016-04-21 23:29:29 [DEBUG   ] Got command RPT from MCS: ref #674604
2016-04-21 23:29:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674604  77 57499 84569690 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:29:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-21 23:30:02 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2016-04-21 23:30:22 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-21 23:30:28 [DEBUG   ] Finished updating board flags in 1.789 seconds
2016-04-21 23:30:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 23:31:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 23:31:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 23:31:28 [DEBUG   ] Finished updating board flags in 1.611 seconds
2016-04-21 23:31:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 23:32:02 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-21 23:32:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 23:32:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-21 23:32:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-21 23:32:28 [DEBUG   ] Finished updating board flags in 1.596 seconds
2016-04-21 23:32:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 23:33:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 23:33:21 [DEBUG   ] Got command RPT from MCS: ref #674623
2016-04-21 23:33:21 [DEBUG   ] summary = ERROR
2016-04-21 23:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674623  13 57499 84801938 A  ERRORERROR'
2016-04-21 23:33:22 [DEBUG   ] Got command RPT from MCS: ref #674624
2016-04-21 23:33:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674624  77 57499 84802142 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:33:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-21 23:33:22 [DEBUG   ] Got command RPT from MCS: ref #674625
2016-04-21 23:33:22 [DEBUG   ] summary = ERROR
2016-04-21 23:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674625  13 57499 84802346 A  ERRORERROR'
2016-04-21 23:33:22 [DEBUG   ] Got command RPT from MCS: ref #674626
2016-04-21 23:33:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674626  77 57499 84802550 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:33:22 [DEBUG   ] Got command RPT from MCS: ref #674627
2016-04-21 23:33:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 23:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674627  12 57499 84802742 A  ERRORBŠÌÍ'
2016-04-21 23:33:28 [DEBUG   ] Finished updating board flags in 1.460 seconds
2016-04-21 23:33:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 23:34:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 23:34:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-21 23:34:28 [DEBUG   ] Finished updating board flags in 1.426 seconds
2016-04-21 23:34:29 [DEBUG   ] Got command RPT from MCS: ref #674628
2016-04-21 23:34:29 [DEBUG   ] summary = ERROR
2016-04-21 23:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674628  13 57499 84869694 A  ERRORERROR'
2016-04-21 23:34:29 [DEBUG   ] Got command RPT from MCS: ref #674629
2016-04-21 23:34:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674629  77 57499 84869694 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:34:42 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-21 23:35:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 23:35:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-21 23:35:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 23:35:28 [DEBUG   ] Finished updating board flags in 1.424 seconds
2016-04-21 23:35:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 23:36:02 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-21 23:36:23 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2016-04-21 23:36:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 23:36:28 [DEBUG   ] Finished updating board flags in 1.425 seconds
2016-04-21 23:36:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 23:37:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 23:37:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 23:37:28 [DEBUG   ] Finished updating board flags in 1.428 seconds
2016-04-21 23:37:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 23:38:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 23:38:22 [DEBUG   ] Got command RPT from MCS: ref #674652
2016-04-21 23:38:22 [DEBUG   ] summary = ERROR
2016-04-21 23:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674652  13 57499 85102034 A  ERRORERROR'
2016-04-21 23:38:22 [DEBUG   ] Got command RPT from MCS: ref #674653
2016-04-21 23:38:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674653  77 57499 85102226 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:38:22 [DEBUG   ] Got command RPT from MCS: ref #674654
2016-04-21 23:38:22 [DEBUG   ] summary = ERROR
2016-04-21 23:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674654  13 57499 85102430 A  ERRORERROR'
2016-04-21 23:38:22 [DEBUG   ] Got command RPT from MCS: ref #674655
2016-04-21 23:38:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674655  77 57499 85102634 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:38:22 [DEBUG   ] Got command RPT from MCS: ref #674656
2016-04-21 23:38:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 23:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674656  12 57499 85102838 A  ERRORB‹ÌÍ'
2016-04-21 23:38:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 23:38:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 23:38:28 [DEBUG   ] Finished updating board flags in 1.427 seconds
2016-04-21 23:38:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 23:39:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 23:39:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 23:39:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 23:39:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 23:39:28 [DEBUG   ] Finished updating board flags in 1.471 seconds
2016-04-21 23:39:29 [DEBUG   ] Got command RPT from MCS: ref #674662
2016-04-21 23:39:29 [DEBUG   ] summary = ERROR
2016-04-21 23:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674662  13 57499 85169690 A  ERRORERROR'
2016-04-21 23:39:29 [DEBUG   ] Got command RPT from MCS: ref #674663
2016-04-21 23:39:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674663  77 57499 85169690 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:39:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 23:40:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 23:40:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 23:40:29 [DEBUG   ] Finished updating board flags in 2.223 seconds
2016-04-21 23:40:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 23:41:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-21 23:41:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 23:41:29 [DEBUG   ] Finished updating board flags in 2.254 seconds
2016-04-21 23:41:43 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-21 23:42:03 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-21 23:42:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-21 23:42:29 [DEBUG   ] Finished updating board flags in 2.088 seconds
2016-04-21 23:42:43 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-21 23:43:03 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2016-04-21 23:43:22 [DEBUG   ] Got command RPT from MCS: ref #674682
2016-04-21 23:43:22 [DEBUG   ] summary = ERROR
2016-04-21 23:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674682  13 57499 85402114 A  ERRORERROR'
2016-04-21 23:43:22 [DEBUG   ] Got command RPT from MCS: ref #674683
2016-04-21 23:43:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674683  77 57499 85402306 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:43:22 [DEBUG   ] Got command RPT from MCS: ref #674684
2016-04-21 23:43:22 [DEBUG   ] summary = ERROR
2016-04-21 23:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674684  13 57499 85402510 A  ERRORERROR'
2016-04-21 23:43:22 [DEBUG   ] Got command RPT from MCS: ref #674685
2016-04-21 23:43:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674685  77 57499 85402714 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:43:22 [DEBUG   ] Got command RPT from MCS: ref #674686
2016-04-21 23:43:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 23:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674686  12 57499 85402918 A  ERRORB‰ÌÍ'
2016-04-21 23:43:24 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2016-04-21 23:43:29 [DEBUG   ] Finished updating board flags in 2.021 seconds
2016-04-21 23:43:44 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-21 23:44:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 23:44:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 23:44:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 23:44:29 [DEBUG   ] Finished updating board flags in 1.991 seconds
2016-04-21 23:44:29 [DEBUG   ] Got command RPT from MCS: ref #674690
2016-04-21 23:44:29 [DEBUG   ] summary = ERROR
2016-04-21 23:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674690  13 57499 85469698 A  ERRORERROR'
2016-04-21 23:44:29 [DEBUG   ] Got command RPT from MCS: ref #674691
2016-04-21 23:44:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674691  77 57499 85469698 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:44:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 23:45:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 23:45:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 23:45:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 23:45:29 [DEBUG   ] Finished updating board flags in 1.827 seconds
2016-04-21 23:45:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 23:46:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 23:46:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 23:46:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 23:46:29 [DEBUG   ] Finished updating board flags in 1.782 seconds
2016-04-21 23:46:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 23:47:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 23:47:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 23:47:29 [DEBUG   ] Finished updating board flags in 1.700 seconds
2016-04-21 23:47:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 23:48:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 23:48:22 [DEBUG   ] Got command RPT from MCS: ref #674711
2016-04-21 23:48:22 [DEBUG   ] summary = ERROR
2016-04-21 23:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674711  13 57499 85702198 A  ERRORERROR'
2016-04-21 23:48:22 [DEBUG   ] Got command RPT from MCS: ref #674712
2016-04-21 23:48:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674712  77 57499 85702402 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:48:22 [DEBUG   ] Got command RPT from MCS: ref #674713
2016-04-21 23:48:22 [DEBUG   ] summary = ERROR
2016-04-21 23:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674713  13 57499 85702606 A  ERRORERROR'
2016-04-21 23:48:22 [DEBUG   ] Got command RPT from MCS: ref #674714
2016-04-21 23:48:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674714  77 57499 85702810 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:48:23 [DEBUG   ] Got command RPT from MCS: ref #674715
2016-04-21 23:48:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 23:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674715  12 57499 85703002 A  ERRORBŠÌÍ'
2016-04-21 23:48:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 23:48:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 23:48:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 23:48:29 [DEBUG   ] Finished updating board flags in 1.501 seconds
2016-04-21 23:48:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 23:49:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-21 23:49:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 23:49:29 [DEBUG   ] Got command RPT from MCS: ref #674721
2016-04-21 23:49:29 [DEBUG   ] summary = ERROR
2016-04-21 23:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674721  13 57499 85769694 A  ERRORERROR'
2016-04-21 23:49:29 [DEBUG   ] Got command RPT from MCS: ref #674722
2016-04-21 23:49:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674722  77 57499 85769694 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:49:29 [DEBUG   ] Finished updating board flags in 1.464 seconds
2016-04-21 23:49:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 23:50:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 23:50:24 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2016-04-21 23:50:29 [DEBUG   ] Finished updating board flags in 1.462 seconds
2016-04-21 23:50:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 23:51:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-21 23:51:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 23:51:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-21 23:51:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-21 23:51:29 [DEBUG   ] Finished updating board flags in 1.459 seconds
2016-04-21 23:51:44 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-21 23:52:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-21 23:52:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-21 23:52:29 [DEBUG   ] Finished updating board flags in 1.471 seconds
2016-04-21 23:52:45 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-21 23:53:05 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2016-04-21 23:53:22 [DEBUG   ] Got command RPT from MCS: ref #674744
2016-04-21 23:53:22 [DEBUG   ] summary = ERROR
2016-04-21 23:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674744  13 57499 86002294 A  ERRORERROR'
2016-04-21 23:53:22 [DEBUG   ] Got command RPT from MCS: ref #674745
2016-04-21 23:53:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674745  77 57499 86002498 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:53:22 [DEBUG   ] Got command RPT from MCS: ref #674746
2016-04-21 23:53:22 [DEBUG   ] summary = ERROR
2016-04-21 23:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674746  13 57499 86002690 A  ERRORERROR'
2016-04-21 23:53:22 [DEBUG   ] Got command RPT from MCS: ref #674747
2016-04-21 23:53:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674747  77 57499 86002894 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:53:23 [DEBUG   ] Got command RPT from MCS: ref #674748
2016-04-21 23:53:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 23:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674748  12 57499 86003098 A  ERRORBŠÌÍ'
2016-04-21 23:53:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 23:53:30 [DEBUG   ] Finished updating board flags in 2.170 seconds
2016-04-21 23:53:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 23:54:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 23:54:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 23:54:29 [DEBUG   ] Got command RPT from MCS: ref #674749
2016-04-21 23:54:29 [DEBUG   ] summary = ERROR
2016-04-21 23:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674749  13 57499 86069694 A  ERRORERROR'
2016-04-21 23:54:29 [DEBUG   ] Got command RPT from MCS: ref #674750
2016-04-21 23:54:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674750  77 57499 86069695 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:54:30 [DEBUG   ] Finished updating board flags in 1.986 seconds
2016-04-21 23:54:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-21 23:55:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 23:55:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-21 23:55:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 23:55:30 [DEBUG   ] Finished updating board flags in 1.873 seconds
2016-04-21 23:55:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-21 23:56:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-21 23:56:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 23:56:30 [DEBUG   ] Finished updating board flags in 1.717 seconds
2016-04-21 23:56:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 23:57:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 23:57:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-21 23:57:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 23:57:30 [DEBUG   ] Finished updating board flags in 1.638 seconds
2016-04-21 23:57:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 23:58:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-21 23:58:22 [DEBUG   ] Got command RPT from MCS: ref #674770
2016-04-21 23:58:22 [DEBUG   ] summary = ERROR
2016-04-21 23:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674770  13 57499 86302370 A  ERRORERROR'
2016-04-21 23:58:22 [DEBUG   ] Got command RPT from MCS: ref #674771
2016-04-21 23:58:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674771  77 57499 86302574 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:58:22 [DEBUG   ] Got command RPT from MCS: ref #674772
2016-04-21 23:58:22 [DEBUG   ] summary = ERROR
2016-04-21 23:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674772  13 57499 86302778 A  ERRORERROR'
2016-04-21 23:58:22 [DEBUG   ] Got command RPT from MCS: ref #674773
2016-04-21 23:58:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674773  77 57499 86302982 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:58:23 [DEBUG   ] Got command RPT from MCS: ref #674774
2016-04-21 23:58:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-21 23:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674774  12 57499 86303174 A  ERRORB‰ÌÍ'
2016-04-21 23:58:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-21 23:58:30 [DEBUG   ] Finished updating board flags in 1.610 seconds
2016-04-21 23:58:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-21 23:59:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 23:59:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-21 23:59:29 [DEBUG   ] Got command RPT from MCS: ref #674783
2016-04-21 23:59:29 [DEBUG   ] summary = ERROR
2016-04-21 23:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674783  13 57499 86369706 A  ERRORERROR'
2016-04-21 23:59:29 [DEBUG   ] Got command RPT from MCS: ref #674784
2016-04-21 23:59:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-21 23:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674784  77 57499 86369706 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-21 23:59:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-21 23:59:30 [DEBUG   ] Finished updating board flags in 1.559 seconds
2016-04-21 23:59:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 00:00:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-22 00:00:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:00:30 [DEBUG   ] Finished updating board flags in 1.420 seconds
2016-04-22 00:00:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:01:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 00:01:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 00:01:30 [DEBUG   ] Finished updating board flags in 1.442 seconds
2016-04-22 00:01:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 00:02:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 00:02:26 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2016-04-22 00:02:30 [DEBUG   ] Finished updating board flags in 1.433 seconds
2016-04-22 00:02:46 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-22 00:03:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 00:03:22 [DEBUG   ] Got command RPT from MCS: ref #674803
2016-04-22 00:03:22 [DEBUG   ] summary = ERROR
2016-04-22 00:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674803  13 57500   202454 A  ERRORERROR'
2016-04-22 00:03:22 [DEBUG   ] Got command RPT from MCS: ref #674804
2016-04-22 00:03:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674804  77 57500   202658 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:03:22 [DEBUG   ] Got command RPT from MCS: ref #674805
2016-04-22 00:03:22 [DEBUG   ] summary = ERROR
2016-04-22 00:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674805  13 57500   202862 A  ERRORERROR'
2016-04-22 00:03:23 [DEBUG   ] Got command RPT from MCS: ref #674806
2016-04-22 00:03:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674806  77 57500   203066 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:03:23 [DEBUG   ] Got command RPT from MCS: ref #674807
2016-04-22 00:03:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 00:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674807  12 57500   203258 A  ERRORBŠÌÍ'
2016-04-22 00:03:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 00:03:30 [DEBUG   ] Finished updating board flags in 1.444 seconds
2016-04-22 00:03:46 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2016-04-22 00:04:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 00:04:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 00:04:29 [DEBUG   ] Got command RPT from MCS: ref #674808
2016-04-22 00:04:29 [DEBUG   ] summary = ERROR
2016-04-22 00:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674808  13 57500   269702 A  ERRORERROR'
2016-04-22 00:04:29 [DEBUG   ] Got command RPT from MCS: ref #674809
2016-04-22 00:04:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674809  77 57500   269702 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:04:30 [DEBUG   ] Finished updating board flags in 1.433 seconds
2016-04-22 00:04:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 00:05:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-22 00:05:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 00:05:30 [DEBUG   ] Finished updating board flags in 1.442 seconds
2016-04-22 00:05:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 00:06:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 00:06:26 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-22 00:06:30 [DEBUG   ] Finished updating board flags in 1.454 seconds
2016-04-22 00:06:46 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2016-04-22 00:07:06 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-22 00:07:26 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2016-04-22 00:07:31 [DEBUG   ] Finished updating board flags in 2.198 seconds
2016-04-22 00:07:47 [DEBUG   ] Finished updating ant stats in 1.390 seconds
2016-04-22 00:08:07 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2016-04-22 00:08:22 [DEBUG   ] Got command RPT from MCS: ref #674832
2016-04-22 00:08:22 [DEBUG   ] summary = ERROR
2016-04-22 00:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674832  13 57500   502542 A  ERRORERROR'
2016-04-22 00:08:22 [DEBUG   ] Got command RPT from MCS: ref #674833
2016-04-22 00:08:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674833  77 57500   502746 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:08:22 [DEBUG   ] Got command RPT from MCS: ref #674834
2016-04-22 00:08:22 [DEBUG   ] summary = ERROR
2016-04-22 00:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674834  13 57500   502950 A  ERRORERROR'
2016-04-22 00:08:23 [DEBUG   ] Got command RPT from MCS: ref #674835
2016-04-22 00:08:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674835  77 57500   503142 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:08:23 [DEBUG   ] Got command RPT from MCS: ref #674836
2016-04-22 00:08:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 00:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674836  12 57500   503346 A  ERRORBŠÌÍ'
2016-04-22 00:08:27 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-22 00:08:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 00:08:31 [DEBUG   ] Finished updating board flags in 1.948 seconds
2016-04-22 00:08:47 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2016-04-22 00:09:07 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-22 00:09:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 00:09:29 [DEBUG   ] Got command RPT from MCS: ref #674842
2016-04-22 00:09:29 [DEBUG   ] summary = ERROR
2016-04-22 00:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674842  13 57500   569706 A  ERRORERROR'
2016-04-22 00:09:29 [DEBUG   ] Got command RPT from MCS: ref #674843
2016-04-22 00:09:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674843  77 57500   569706 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:09:31 [DEBUG   ] Finished updating board flags in 1.812 seconds
2016-04-22 00:09:47 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2016-04-22 00:10:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 00:10:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 00:10:31 [DEBUG   ] Finished updating board flags in 1.809 seconds
2016-04-22 00:10:48 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2016-04-22 00:11:08 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-22 00:11:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 00:11:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 00:11:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 00:11:31 [DEBUG   ] Finished updating board flags in 1.786 seconds
2016-04-22 00:11:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 00:12:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 00:12:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 00:12:31 [DEBUG   ] Finished updating board flags in 1.631 seconds
2016-04-22 00:12:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 00:13:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 00:13:22 [DEBUG   ] Got command RPT from MCS: ref #674862
2016-04-22 00:13:22 [DEBUG   ] summary = ERROR
2016-04-22 00:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674862  13 57500   802630 A  ERRORERROR'
2016-04-22 00:13:22 [DEBUG   ] Got command RPT from MCS: ref #674863
2016-04-22 00:13:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674863  77 57500   802822 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:13:23 [DEBUG   ] Got command RPT from MCS: ref #674864
2016-04-22 00:13:23 [DEBUG   ] summary = ERROR
2016-04-22 00:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674864  13 57500   803026 A  ERRORERROR'
2016-04-22 00:13:23 [DEBUG   ] Got command RPT from MCS: ref #674865
2016-04-22 00:13:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674865  77 57500   803230 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:13:23 [DEBUG   ] Got command RPT from MCS: ref #674866
2016-04-22 00:13:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 00:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674866  12 57500   803434 A  ERRORBŠÌÍ'
2016-04-22 00:13:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-22 00:13:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 00:13:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 00:13:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-22 00:13:31 [DEBUG   ] Finished updating board flags in 1.566 seconds
2016-04-22 00:13:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 00:14:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 00:14:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 00:14:29 [DEBUG   ] Got command RPT from MCS: ref #674870
2016-04-22 00:14:29 [DEBUG   ] summary = ERROR
2016-04-22 00:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674870  13 57500   869702 A  ERRORERROR'
2016-04-22 00:14:29 [DEBUG   ] Got command RPT from MCS: ref #674871
2016-04-22 00:14:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674871  77 57500   869702 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:14:31 [DEBUG   ] Finished updating board flags in 1.420 seconds
2016-04-22 00:14:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 00:15:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 00:15:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 00:15:31 [DEBUG   ] Finished updating board flags in 1.451 seconds
2016-04-22 00:15:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 00:16:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 00:16:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 00:16:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 00:16:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 00:16:31 [DEBUG   ] Finished updating board flags in 1.551 seconds
2016-04-22 00:16:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 00:17:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 00:17:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 00:17:32 [DEBUG   ] Finished updating board flags in 2.279 seconds
2016-04-22 00:17:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 00:18:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 00:18:22 [DEBUG   ] Got command RPT from MCS: ref #674891
2016-04-22 00:18:22 [DEBUG   ] summary = ERROR
2016-04-22 00:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674891  13 57500  1102718 A  ERRORERROR'
2016-04-22 00:18:22 [DEBUG   ] Got command RPT from MCS: ref #674892
2016-04-22 00:18:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674892  77 57500  1102922 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:18:23 [DEBUG   ] Got command RPT from MCS: ref #674893
2016-04-22 00:18:23 [DEBUG   ] summary = ERROR
2016-04-22 00:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674893  13 57500  1103114 A  ERRORERROR'
2016-04-22 00:18:23 [DEBUG   ] Got command RPT from MCS: ref #674894
2016-04-22 00:18:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674894  77 57500  1103322 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:18:23 [DEBUG   ] Got command RPT from MCS: ref #674895
2016-04-22 00:18:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 00:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674895  12 57500  1103514 A  ERRORB‹ÌÍ'
2016-04-22 00:18:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 00:18:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2016-04-22 00:18:32 [DEBUG   ] Finished updating board flags in 2.116 seconds
2016-04-22 00:18:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 00:19:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 00:19:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 00:19:29 [DEBUG   ] Got command RPT from MCS: ref #674901
2016-04-22 00:19:29 [DEBUG   ] summary = ERROR
2016-04-22 00:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674901  13 57500  1169702 A  ERRORERROR'
2016-04-22 00:19:29 [DEBUG   ] Got command RPT from MCS: ref #674902
2016-04-22 00:19:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674902  77 57500  1169702 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:19:32 [DEBUG   ] Finished updating board flags in 2.031 seconds
2016-04-22 00:19:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 00:20:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 00:20:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 00:20:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 00:20:32 [DEBUG   ] Finished updating board flags in 2.013 seconds
2016-04-22 00:20:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 00:21:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 00:21:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 00:21:32 [DEBUG   ] Finished updating board flags in 1.968 seconds
2016-04-22 00:21:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 00:22:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 00:22:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 00:22:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 00:22:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 00:22:32 [DEBUG   ] Finished updating board flags in 1.894 seconds
2016-04-22 00:22:48 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2016-04-22 00:23:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 00:23:22 [DEBUG   ] Got command RPT from MCS: ref #674924
2016-04-22 00:23:22 [DEBUG   ] summary = ERROR
2016-04-22 00:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674924  13 57500  1402798 A  ERRORERROR'
2016-04-22 00:23:22 [DEBUG   ] Got command RPT from MCS: ref #674925
2016-04-22 00:23:22 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674925  77 57500  1402990 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:23:23 [DEBUG   ] Got command RPT from MCS: ref #674926
2016-04-22 00:23:23 [DEBUG   ] summary = ERROR
2016-04-22 00:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674926  13 57500  1403194 A  ERRORERROR'
2016-04-22 00:23:23 [DEBUG   ] Got command RPT from MCS: ref #674927
2016-04-22 00:23:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674927  77 57500  1403398 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:23:23 [DEBUG   ] Got command RPT from MCS: ref #674928
2016-04-22 00:23:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 00:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674928  12 57500  1403602 A  ERRORB‰ÌÍ'
2016-04-22 00:23:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 00:23:32 [DEBUG   ] Finished updating board flags in 1.699 seconds
2016-04-22 00:23:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 00:24:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 00:24:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 00:24:29 [DEBUG   ] Got command RPT from MCS: ref #674929
2016-04-22 00:24:29 [DEBUG   ] summary = ERROR
2016-04-22 00:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674929  13 57500  1469702 A  ERRORERROR'
2016-04-22 00:24:29 [DEBUG   ] Got command RPT from MCS: ref #674930
2016-04-22 00:24:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674930  77 57500  1469702 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:24:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 00:24:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 00:24:32 [DEBUG   ] Finished updating board flags in 1.607 seconds
2016-04-22 00:24:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 00:25:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 00:25:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 00:25:32 [DEBUG   ] Finished updating board flags in 1.597 seconds
2016-04-22 00:25:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 00:26:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 00:26:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 00:26:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 00:26:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 00:26:32 [DEBUG   ] Finished updating board flags in 1.417 seconds
2016-04-22 00:26:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 00:27:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 00:27:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 00:27:32 [DEBUG   ] Finished updating board flags in 1.466 seconds
2016-04-22 00:27:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 00:28:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 00:28:22 [DEBUG   ] Got command RPT from MCS: ref #674950
2016-04-22 00:28:22 [DEBUG   ] summary = ERROR
2016-04-22 00:28:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674950  13 57500  1702874 A  ERRORERROR'
2016-04-22 00:28:23 [DEBUG   ] Got command RPT from MCS: ref #674951
2016-04-22 00:28:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674951  77 57500  1703078 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:28:23 [DEBUG   ] Got command RPT from MCS: ref #674952
2016-04-22 00:28:23 [DEBUG   ] summary = ERROR
2016-04-22 00:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674952  13 57500  1703270 A  ERRORERROR'
2016-04-22 00:28:23 [DEBUG   ] Got command RPT from MCS: ref #674953
2016-04-22 00:28:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674953  77 57500  1703474 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:28:23 [DEBUG   ] Got command RPT from MCS: ref #674954
2016-04-22 00:28:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 00:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674954  12 57500  1703678 A  ERRORBŠÌÍ'
2016-04-22 00:28:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 00:28:32 [DEBUG   ] Finished updating board flags in 1.495 seconds
2016-04-22 00:28:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 00:29:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 00:29:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 00:29:29 [DEBUG   ] Got command RPT from MCS: ref #674963
2016-04-22 00:29:29 [DEBUG   ] summary = ERROR
2016-04-22 00:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674963  13 57500  1769702 A  ERRORERROR'
2016-04-22 00:29:29 [DEBUG   ] Got command RPT from MCS: ref #674964
2016-04-22 00:29:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674964  77 57500  1769702 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:29:32 [DEBUG   ] Finished updating board flags in 1.573 seconds
2016-04-22 00:29:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 00:30:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 00:30:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 00:30:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 00:30:33 [DEBUG   ] Finished updating board flags in 2.179 seconds
2016-04-22 00:30:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-22 00:31:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:31:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:31:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 00:31:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 00:31:33 [DEBUG   ] Finished updating board flags in 2.012 seconds
2016-04-22 00:31:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 00:32:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:32:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:32:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 00:32:33 [DEBUG   ] Finished updating board flags in 1.873 seconds
2016-04-22 00:32:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:33:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 00:33:22 [DEBUG   ] Got command RPT from MCS: ref #674983
2016-04-22 00:33:22 [DEBUG   ] summary = ERROR
2016-04-22 00:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674983  13 57500  2002962 A  ERRORERROR'
2016-04-22 00:33:23 [DEBUG   ] Got command RPT from MCS: ref #674984
2016-04-22 00:33:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674984  77 57500  2003154 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:33:23 [DEBUG   ] Got command RPT from MCS: ref #674985
2016-04-22 00:33:23 [DEBUG   ] summary = ERROR
2016-04-22 00:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674985  13 57500  2003358 A  ERRORERROR'
2016-04-22 00:33:23 [DEBUG   ] Got command RPT from MCS: ref #674986
2016-04-22 00:33:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674986  77 57500  2003562 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:33:23 [DEBUG   ] Got command RPT from MCS: ref #674987
2016-04-22 00:33:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 00:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674987  12 57500  2003766 A  ERRORBŠÌÍ'
2016-04-22 00:33:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:33:33 [DEBUG   ] Finished updating board flags in 1.813 seconds
2016-04-22 00:33:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:34:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:34:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 00:34:29 [DEBUG   ] Got command RPT from MCS: ref #674988
2016-04-22 00:34:29 [DEBUG   ] summary = ERROR
2016-04-22 00:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674988  13 57500  2069702 A  ERRORERROR'
2016-04-22 00:34:29 [DEBUG   ] Got command RPT from MCS: ref #674989
2016-04-22 00:34:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   674989  77 57500  2069702 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:34:33 [DEBUG   ] Finished updating board flags in 1.815 seconds
2016-04-22 00:34:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:35:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:35:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 00:35:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 00:35:33 [DEBUG   ] Finished updating board flags in 1.771 seconds
2016-04-22 00:35:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 00:36:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:36:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:36:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 00:36:33 [DEBUG   ] Finished updating board flags in 1.729 seconds
2016-04-22 00:36:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:37:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 00:37:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 00:37:33 [DEBUG   ] Finished updating board flags in 1.468 seconds
2016-04-22 00:37:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:38:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:38:23 [DEBUG   ] Got command RPT from MCS: ref #675012
2016-04-22 00:38:23 [DEBUG   ] summary = ERROR
2016-04-22 00:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675012  13 57500  2303030 A  ERRORERROR'
2016-04-22 00:38:23 [DEBUG   ] Got command RPT from MCS: ref #675013
2016-04-22 00:38:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675013  77 57500  2303234 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:38:23 [DEBUG   ] Got command RPT from MCS: ref #675014
2016-04-22 00:38:23 [DEBUG   ] summary = ERROR
2016-04-22 00:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675014  13 57500  2303438 A  ERRORERROR'
2016-04-22 00:38:23 [DEBUG   ] Got command RPT from MCS: ref #675015
2016-04-22 00:38:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675015  77 57500  2303642 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:38:23 [DEBUG   ] Got command RPT from MCS: ref #675016
2016-04-22 00:38:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 00:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675016  12 57500  2303834 A  ERRORB‰ÌÍ'
2016-04-22 00:38:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 00:38:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 00:38:33 [DEBUG   ] Finished updating board flags in 1.491 seconds
2016-04-22 00:38:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 00:39:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:39:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:39:29 [DEBUG   ] Got command RPT from MCS: ref #675022
2016-04-22 00:39:29 [DEBUG   ] summary = ERROR
2016-04-22 00:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675022  13 57500  2369706 A  ERRORERROR'
2016-04-22 00:39:29 [DEBUG   ] Got command RPT from MCS: ref #675023
2016-04-22 00:39:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675023  77 57500  2369706 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:39:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 00:39:33 [DEBUG   ] Finished updating board flags in 1.500 seconds
2016-04-22 00:39:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 00:40:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:40:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:40:33 [DEBUG   ] Finished updating board flags in 1.508 seconds
2016-04-22 00:40:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:41:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 00:41:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:41:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 00:41:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-22 00:41:34 [DEBUG   ] Finished updating board flags in 2.195 seconds
2016-04-22 00:41:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 00:42:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:42:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 00:42:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 00:42:34 [DEBUG   ] Finished updating board flags in 2.025 seconds
2016-04-22 00:42:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 00:43:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:43:23 [DEBUG   ] Got command RPT from MCS: ref #675042
2016-04-22 00:43:23 [DEBUG   ] summary = ERROR
2016-04-22 00:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675042  13 57500  2603118 A  ERRORERROR'
2016-04-22 00:43:23 [DEBUG   ] Got command RPT from MCS: ref #675043
2016-04-22 00:43:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675043  77 57500  2603322 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:43:23 [DEBUG   ] Got command RPT from MCS: ref #675044
2016-04-22 00:43:23 [DEBUG   ] summary = ERROR
2016-04-22 00:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675044  13 57500  2603526 A  ERRORERROR'
2016-04-22 00:43:23 [DEBUG   ] Got command RPT from MCS: ref #675045
2016-04-22 00:43:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675045  77 57500  2603730 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:43:23 [DEBUG   ] Got command RPT from MCS: ref #675046
2016-04-22 00:43:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 00:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675046  12 57500  2603922 A  ERRORBŠÌÍ'
2016-04-22 00:43:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:43:34 [DEBUG   ] Finished updating board flags in 2.022 seconds
2016-04-22 00:43:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 00:44:08 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-22 00:44:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 00:44:29 [DEBUG   ] Got command RPT from MCS: ref #675050
2016-04-22 00:44:29 [DEBUG   ] summary = ERROR
2016-04-22 00:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675050  13 57500  2669706 A  ERRORERROR'
2016-04-22 00:44:29 [DEBUG   ] Got command RPT from MCS: ref #675051
2016-04-22 00:44:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675051  77 57500  2669706 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:44:34 [DEBUG   ] Finished updating board flags in 1.880 seconds
2016-04-22 00:44:49 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2016-04-22 00:45:09 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-22 00:45:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 00:45:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 00:45:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 00:45:34 [DEBUG   ] Finished updating board flags in 1.816 seconds
2016-04-22 00:45:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 00:46:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 00:46:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-22 00:46:34 [DEBUG   ] Finished updating board flags in 1.791 seconds
2016-04-22 00:46:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 00:47:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 00:47:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 00:47:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 00:47:34 [DEBUG   ] Finished updating board flags in 1.609 seconds
2016-04-22 00:47:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 00:48:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 00:48:23 [DEBUG   ] Got command RPT from MCS: ref #675071
2016-04-22 00:48:23 [DEBUG   ] summary = ERROR
2016-04-22 00:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675071  13 57500  2903210 A  ERRORERROR'
2016-04-22 00:48:23 [DEBUG   ] Got command RPT from MCS: ref #675072
2016-04-22 00:48:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675072  77 57500  2903414 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:48:23 [DEBUG   ] Got command RPT from MCS: ref #675073
2016-04-22 00:48:23 [DEBUG   ] summary = ERROR
2016-04-22 00:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675073  13 57500  2903606 A  ERRORERROR'
2016-04-22 00:48:23 [DEBUG   ] Got command RPT from MCS: ref #675074
2016-04-22 00:48:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675074  77 57500  2903810 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:48:24 [DEBUG   ] Got command RPT from MCS: ref #675075
2016-04-22 00:48:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 00:48:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675075  12 57500  2904014 A  ERRORBŠÌÍ'
2016-04-22 00:48:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 00:48:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 00:48:34 [DEBUG   ] Finished updating board flags in 1.586 seconds
2016-04-22 00:48:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 00:49:09 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-22 00:49:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 00:49:29 [DEBUG   ] Got command RPT from MCS: ref #675081
2016-04-22 00:49:29 [DEBUG   ] summary = ERROR
2016-04-22 00:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675081  13 57500  2969714 A  ERRORERROR'
2016-04-22 00:49:29 [DEBUG   ] Got command RPT from MCS: ref #675082
2016-04-22 00:49:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675082  77 57500  2969714 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:49:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 00:49:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 00:49:34 [DEBUG   ] Finished updating board flags in 1.415 seconds
2016-04-22 00:49:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:50:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 00:50:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 00:50:34 [DEBUG   ] Finished updating board flags in 1.410 seconds
2016-04-22 00:50:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:51:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:51:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 00:51:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 00:51:34 [DEBUG   ] Finished updating board flags in 1.419 seconds
2016-04-22 00:51:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:52:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:52:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:52:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 00:52:34 [DEBUG   ] Finished updating board flags in 1.430 seconds
2016-04-22 00:52:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 00:53:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 00:53:23 [DEBUG   ] Got command RPT from MCS: ref #675104
2016-04-22 00:53:23 [DEBUG   ] summary = ERROR
2016-04-22 00:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675104  13 57500  3203290 A  ERRORERROR'
2016-04-22 00:53:23 [DEBUG   ] Got command RPT from MCS: ref #675105
2016-04-22 00:53:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675105  77 57500  3203494 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:53:23 [DEBUG   ] Got command RPT from MCS: ref #675106
2016-04-22 00:53:23 [DEBUG   ] summary = ERROR
2016-04-22 00:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675106  13 57500  3203686 A  ERRORERROR'
2016-04-22 00:53:23 [DEBUG   ] Got command RPT from MCS: ref #675107
2016-04-22 00:53:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675107  77 57500  3203890 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:53:24 [DEBUG   ] Got command RPT from MCS: ref #675108
2016-04-22 00:53:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 00:53:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675108  12 57500  3204094 A  ERRORBŠÌÍ'
2016-04-22 00:53:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:53:34 [DEBUG   ] Finished updating board flags in 1.556 seconds
2016-04-22 00:53:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 00:54:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 00:54:29 [DEBUG   ] Got command RPT from MCS: ref #675109
2016-04-22 00:54:29 [DEBUG   ] summary = ERROR
2016-04-22 00:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675109  13 57500  3269706 A  ERRORERROR'
2016-04-22 00:54:29 [DEBUG   ] Got command RPT from MCS: ref #675110
2016-04-22 00:54:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675110  77 57500  3269706 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:54:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2016-04-22 00:54:35 [DEBUG   ] Finished updating board flags in 2.431 seconds
2016-04-22 00:54:50 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-22 00:55:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 00:55:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 00:55:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 00:55:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 00:55:35 [DEBUG   ] Finished updating board flags in 2.167 seconds
2016-04-22 00:55:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 00:56:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 00:56:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 00:56:35 [DEBUG   ] Finished updating board flags in 2.029 seconds
2016-04-22 00:56:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 00:57:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 00:57:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 00:57:35 [DEBUG   ] Finished updating board flags in 2.012 seconds
2016-04-22 00:57:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 00:58:10 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-22 00:58:23 [DEBUG   ] Got command RPT from MCS: ref #675130
2016-04-22 00:58:23 [DEBUG   ] summary = ERROR
2016-04-22 00:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675130  13 57500  3503382 A  ERRORERROR'
2016-04-22 00:58:23 [DEBUG   ] Got command RPT from MCS: ref #675131
2016-04-22 00:58:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675131  77 57500  3503574 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:58:23 [DEBUG   ] Got command RPT from MCS: ref #675132
2016-04-22 00:58:23 [DEBUG   ] summary = ERROR
2016-04-22 00:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675132  13 57500  3503778 A  ERRORERROR'
2016-04-22 00:58:23 [DEBUG   ] Got command RPT from MCS: ref #675133
2016-04-22 00:58:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675133  77 57500  3503982 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:58:24 [DEBUG   ] Got command RPT from MCS: ref #675134
2016-04-22 00:58:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 00:58:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675134  12 57500  3504186 A  ERRORBŠÌÍ'
2016-04-22 00:58:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 00:58:35 [DEBUG   ] Finished updating board flags in 1.960 seconds
2016-04-22 00:58:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 00:59:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 00:59:29 [DEBUG   ] Got command RPT from MCS: ref #675143
2016-04-22 00:59:29 [DEBUG   ] summary = ERROR
2016-04-22 00:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675143  13 57500  3569714 A  ERRORERROR'
2016-04-22 00:59:29 [DEBUG   ] Got command RPT from MCS: ref #675144
2016-04-22 00:59:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 00:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675144  77 57500  3569714 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 00:59:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 00:59:35 [DEBUG   ] Finished updating board flags in 1.877 seconds
2016-04-22 00:59:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 01:00:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 01:00:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 01:00:35 [DEBUG   ] Finished updating board flags in 1.727 seconds
2016-04-22 01:00:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 01:01:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 01:01:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2016-04-22 01:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2016-04-22 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2016-04-22 01:01:35 [DEBUG   ] Finished updating board flags in 1.630 seconds
2016-04-22 01:01:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 01:02:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 01:02:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2016-04-22 01:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2016-04-22 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2016-04-22 01:02:35 [DEBUG   ] Finished updating board flags in 1.617 seconds
2016-04-22 01:02:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 01:03:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 01:03:23 [DEBUG   ] Got command RPT from MCS: ref #675163
2016-04-22 01:03:23 [DEBUG   ] summary = ERROR
2016-04-22 01:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675163  13 57500  3803458 A  ERRORERROR'
2016-04-22 01:03:23 [DEBUG   ] Got command RPT from MCS: ref #675164
2016-04-22 01:03:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675164  77 57500  3803650 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:03:23 [DEBUG   ] Got command RPT from MCS: ref #675165
2016-04-22 01:03:23 [DEBUG   ] summary = ERROR
2016-04-22 01:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675165  13 57500  3803854 A  ERRORERROR'
2016-04-22 01:03:24 [DEBUG   ] Got command RPT from MCS: ref #675166
2016-04-22 01:03:24 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:03:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675166  77 57500  3804058 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:03:24 [DEBUG   ] Got command RPT from MCS: ref #675167
2016-04-22 01:03:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 01:03:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675167  12 57500  3804262 A  ERRORBŠÌÍ'
2016-04-22 01:03:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 01:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:03:35 [DEBUG   ] Finished updating board flags in 1.626 seconds
2016-04-22 01:03:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 01:04:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 01:04:11 [DEBUG   ] Got command TBW from MCS: ref #675169
2016-04-22 01:04:11 [DEBUG   ] tbw = exited with status True, code 0x00
2016-04-22 01:04:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   675169   8 57500  3851762 A  ERROR'
2016-04-22 01:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2016-04-22 01:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2016-04-22 01:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2016-04-22 01:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2016-04-22 01:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2016-04-22 01:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2016-04-22 01:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2016-04-22 01:04:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2016-04-22 01:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2016-04-22 01:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2016-04-22 01:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2016-04-22 01:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2016-04-22 01:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2016-04-22 01:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2016-04-22 01:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2016-04-22 01:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2016-04-22 01:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2016-04-22 01:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2016-04-22 01:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2016-04-22 01:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2016-04-22 01:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2016-04-22 01:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2016-04-22 01:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2016-04-22 01:04:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2016-04-22 01:04:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2016-04-22 01:04:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2016-04-22 01:04:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2016-04-22 01:04:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2016-04-22 01:04:15 [DEBUG   ] spawn_process: at 2016-04-22 01:04:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2016-04-22 01:04:15 [INFO    ] Finished spawning TBW
2016-04-22 01:04:29 [DEBUG   ] Got command RPT from MCS: ref #675171
2016-04-22 01:04:29 [DEBUG   ] summary = ERROR
2016-04-22 01:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675171  13 57500  3869714 A  ERRORERROR'
2016-04-22 01:04:29 [DEBUG   ] Got command RPT from MCS: ref #675172
2016-04-22 01:04:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675172  77 57500  3869714 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:04:35 [DEBUG   ] Finished updating board flags in 1.394 seconds
2016-04-22 01:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:05:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 01:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:05:35 [DEBUG   ] Finished updating board flags in 1.282 seconds
2016-04-22 01:06:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:06:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:06:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:06:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:06:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:06:35 [DEBUG   ] Finished updating board flags in 1.078 seconds
2016-04-22 01:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:07:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 01:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:07:36 [DEBUG   ] Finished updating board flags in 2.124 seconds
2016-04-22 01:07:54 [INFO    ] __waitForTBW - TBW finished in 218.939 s
2016-04-22 01:07:55 [INFO    ] Started antennas statistics background thread
2016-04-22 01:07:55 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1461287276']
2016-04-22 01:07:55 [DEBUG   ] spawn_process: at 2016-04-22 01:07:55 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1461287276']
2016-04-22 01:07:55 [INFO    ] Finished spawning TBN in 0.054 s
2016-04-22 01:07:55 [DEBUG   ] Finished updating ant stats in 1.134 seconds
2016-04-22 01:08:15 [DEBUG   ] Finished updating ant stats in 0.982 seconds
2016-04-22 01:08:23 [DEBUG   ] Got command RPT from MCS: ref #675203
2016-04-22 01:08:23 [DEBUG   ] summary = ERROR
2016-04-22 01:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675203  13 57500  4103542 A  ERRORERROR'
2016-04-22 01:08:23 [DEBUG   ] Got command RPT from MCS: ref #675204
2016-04-22 01:08:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675204  77 57500  4103746 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:08:23 [DEBUG   ] Got command RPT from MCS: ref #675205
2016-04-22 01:08:23 [DEBUG   ] summary = ERROR
2016-04-22 01:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675205  13 57500  4103938 A  ERRORERROR'
2016-04-22 01:08:24 [DEBUG   ] Got command RPT from MCS: ref #675206
2016-04-22 01:08:24 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:08:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675206  77 57500  4104142 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:08:24 [DEBUG   ] Got command RPT from MCS: ref #675207
2016-04-22 01:08:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 01:08:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675207  12 57500  4104346 A  ERRORB‹ÌÍ'
2016-04-22 01:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:08:35 [DEBUG   ] Finished updating ant stats in 0.860 seconds
2016-04-22 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:08:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-22 01:08:36 [DEBUG   ] Finished updating board flags in 2.215 seconds
2016-04-22 01:08:55 [DEBUG   ] Finished updating ant stats in 0.743 seconds
2016-04-22 01:09:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 01:09:29 [DEBUG   ] Got command RPT from MCS: ref #675216
2016-04-22 01:09:29 [DEBUG   ] summary = ERROR
2016-04-22 01:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675216  13 57500  4169714 A  ERRORERROR'
2016-04-22 01:09:29 [DEBUG   ] Got command RPT from MCS: ref #675217
2016-04-22 01:09:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675217  77 57500  4169714 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:09:35 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2016-04-22 01:09:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:09:36 [DEBUG   ] Finished updating board flags in 2.051 seconds
2016-04-22 01:09:55 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2016-04-22 01:10:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-22 01:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:10:35 [DEBUG   ] Finished updating ant stats in 0.445 seconds
2016-04-22 01:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:10:36 [DEBUG   ] Finished updating board flags in 2.010 seconds
2016-04-22 01:10:56 [DEBUG   ] Finished updating ant stats in 1.356 seconds
2016-04-22 01:11:16 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2016-04-22 01:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:11:36 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2016-04-22 01:11:36 [DEBUG   ] Finished updating board flags in 2.062 seconds
2016-04-22 01:11:56 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2016-04-22 01:12:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 01:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:12:36 [DEBUG   ] Finished updating ant stats in 0.841 seconds
2016-04-22 01:12:36 [DEBUG   ] Finished updating board flags in 1.993 seconds
2016-04-22 01:12:56 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2016-04-22 01:13:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 01:13:23 [DEBUG   ] Got command RPT from MCS: ref #675236
2016-04-22 01:13:23 [DEBUG   ] summary = ERROR
2016-04-22 01:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675236  13 57500  4403622 A  ERRORERROR'
2016-04-22 01:13:23 [DEBUG   ] Got command RPT from MCS: ref #675237
2016-04-22 01:13:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675237  77 57500  4403826 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:13:24 [DEBUG   ] Got command RPT from MCS: ref #675238
2016-04-22 01:13:24 [DEBUG   ] summary = ERROR
2016-04-22 01:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675238  13 57500  4404030 A  ERRORERROR'
2016-04-22 01:13:24 [DEBUG   ] Got command RPT from MCS: ref #675239
2016-04-22 01:13:24 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675239  77 57500  4404222 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:13:24 [DEBUG   ] Got command RPT from MCS: ref #675240
2016-04-22 01:13:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 01:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675240  12 57500  4404426 A  ERRORBŠÌÍ'
2016-04-22 01:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 01:13:36 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2016-04-22 01:13:36 [DEBUG   ] Finished updating board flags in 1.826 seconds
2016-04-22 01:13:56 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2016-04-22 01:14:17 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2016-04-22 01:14:29 [DEBUG   ] Got command RPT from MCS: ref #675244
2016-04-22 01:14:29 [DEBUG   ] summary = ERROR
2016-04-22 01:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675244  13 57500  4469710 A  ERRORERROR'
2016-04-22 01:14:29 [DEBUG   ] Got command RPT from MCS: ref #675245
2016-04-22 01:14:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675245  77 57500  4469710 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:14:36 [DEBUG   ] Finished updating ant stats in 0.440 seconds
2016-04-22 01:14:36 [DEBUG   ] Finished updating board flags in 1.769 seconds
2016-04-22 01:14:57 [DEBUG   ] Finished updating ant stats in 1.357 seconds
2016-04-22 01:15:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 01:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:15:36 [DEBUG   ] Finished updating board flags in 1.698 seconds
2016-04-22 01:15:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 01:15:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 01:16:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 01:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:16:36 [DEBUG   ] Finished updating board flags in 1.482 seconds
2016-04-22 01:16:37 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2016-04-22 01:16:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 01:17:17 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-22 01:17:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:17:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:17:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:17:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:17:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:17:36 [DEBUG   ] Finished updating board flags in 1.427 seconds
2016-04-22 01:17:37 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2016-04-22 01:17:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 01:18:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 01:18:23 [DEBUG   ] Got command RPT from MCS: ref #675265
2016-04-22 01:18:23 [DEBUG   ] summary = ERROR
2016-04-22 01:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675265  13 57500  4703718 A  ERRORERROR'
2016-04-22 01:18:23 [DEBUG   ] Got command RPT from MCS: ref #675266
2016-04-22 01:18:23 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675266  77 57500  4703922 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:18:24 [DEBUG   ] Got command RPT from MCS: ref #675267
2016-04-22 01:18:24 [DEBUG   ] summary = ERROR
2016-04-22 01:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675267  13 57500  4704126 A  ERRORERROR'
2016-04-22 01:18:24 [DEBUG   ] Got command RPT from MCS: ref #675268
2016-04-22 01:18:24 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675268  77 57500  4704318 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:18:24 [DEBUG   ] Got command RPT from MCS: ref #675269
2016-04-22 01:18:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 01:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675269  12 57500  4704522 A  ERRORB‹ÌÍ'
2016-04-22 01:18:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:18:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:18:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:18:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:18:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:18:36 [DEBUG   ] Finished updating board flags in 1.376 seconds
2016-04-22 01:18:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 01:18:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 01:19:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 01:19:29 [DEBUG   ] Got command RPT from MCS: ref #675275
2016-04-22 01:19:29 [DEBUG   ] summary = ERROR
2016-04-22 01:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675275  13 57500  4769722 A  ERRORERROR'
2016-04-22 01:19:29 [DEBUG   ] Got command RPT from MCS: ref #675276
2016-04-22 01:19:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675276  77 57500  4769722 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:19:37 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2016-04-22 01:19:37 [DEBUG   ] Finished updating board flags in 2.259 seconds
2016-04-22 01:19:57 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2016-04-22 01:20:18 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2016-04-22 01:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:20:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 01:20:38 [DEBUG   ] Finished updating board flags in 3.278 seconds
2016-04-22 01:20:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 01:21:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 01:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:21:37 [DEBUG   ] Finished updating board flags in 2.082 seconds
2016-04-22 01:21:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 01:21:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 01:22:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 01:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:22:37 [DEBUG   ] Finished updating board flags in 2.060 seconds
2016-04-22 01:22:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 01:22:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 01:23:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 01:23:23 [DEBUG   ] Got command RPT from MCS: ref #675298
2016-04-22 01:23:23 [DEBUG   ] summary = ERROR
2016-04-22 01:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675298  13 57500  5003802 A  ERRORERROR'
2016-04-22 01:23:24 [DEBUG   ] Got command RPT from MCS: ref #675299
2016-04-22 01:23:24 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675299  77 57500  5004006 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:23:24 [DEBUG   ] Got command RPT from MCS: ref #675300
2016-04-22 01:23:24 [DEBUG   ] summary = ERROR
2016-04-22 01:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675300  13 57500  5004210 A  ERRORERROR'
2016-04-22 01:23:24 [DEBUG   ] Got command RPT from MCS: ref #675301
2016-04-22 01:23:24 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675301  77 57500  5004402 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:23:24 [DEBUG   ] Got command RPT from MCS: ref #675302
2016-04-22 01:23:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 01:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675302  12 57500  5004606 A  ERRORBŠÌÍ'
2016-04-22 01:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:23:37 [DEBUG   ] Finished updating board flags in 2.018 seconds
2016-04-22 01:23:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-22 01:23:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 01:24:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 01:24:29 [DEBUG   ] Got command RPT from MCS: ref #675303
2016-04-22 01:24:29 [DEBUG   ] summary = ERROR
2016-04-22 01:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675303  13 57500  5069714 A  ERRORERROR'
2016-04-22 01:24:29 [DEBUG   ] Got command RPT from MCS: ref #675304
2016-04-22 01:24:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675304  77 57500  5069714 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:24:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 01:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:24:37 [DEBUG   ] Finished updating board flags in 1.944 seconds
2016-04-22 01:24:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 01:24:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 01:25:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 01:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:25:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 01:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:25:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 01:25:37 [DEBUG   ] Finished updating board flags in 1.867 seconds
2016-04-22 01:25:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 01:25:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 01:26:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 01:26:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:26:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:26:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:26:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:26:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-22 01:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 01:26:37 [DEBUG   ] Finished updating board flags in 1.726 seconds
2016-04-22 01:26:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 01:26:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 01:27:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 01:27:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:27:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:27:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:27:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:27:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:27:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 01:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:27:37 [DEBUG   ] Finished updating board flags in 1.622 seconds
2016-04-22 01:27:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 01:27:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 01:28:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 01:28:23 [DEBUG   ] Got command RPT from MCS: ref #675324
2016-04-22 01:28:23 [DEBUG   ] summary = ERROR
2016-04-22 01:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675324  13 57500  5303894 A  ERRORERROR'
2016-04-22 01:28:24 [DEBUG   ] Got command RPT from MCS: ref #675325
2016-04-22 01:28:24 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675325  77 57500  5304098 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:28:24 [DEBUG   ] Got command RPT from MCS: ref #675326
2016-04-22 01:28:24 [DEBUG   ] summary = ERROR
2016-04-22 01:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675326  13 57500  5304290 A  ERRORERROR'
2016-04-22 01:28:24 [DEBUG   ] Got command RPT from MCS: ref #675327
2016-04-22 01:28:24 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675327  77 57500  5304494 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:28:24 [DEBUG   ] Got command RPT from MCS: ref #675328
2016-04-22 01:28:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 01:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675328  12 57500  5304698 A  ERRORBŠÌÍ'
2016-04-22 01:28:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:28:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:28:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:28:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:28:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:28:37 [DEBUG   ] Finished updating board flags in 1.633 seconds
2016-04-22 01:28:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 01:28:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 01:29:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 01:29:29 [DEBUG   ] Got command RPT from MCS: ref #675337
2016-04-22 01:29:29 [DEBUG   ] summary = ERROR
2016-04-22 01:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675337  13 57500  5369722 A  ERRORERROR'
2016-04-22 01:29:29 [DEBUG   ] Got command RPT from MCS: ref #675338
2016-04-22 01:29:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675338  77 57500  5369722 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:29:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:29:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:29:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:29:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:29:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:29:37 [DEBUG   ] Finished updating board flags in 1.671 seconds
2016-04-22 01:29:38 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-22 01:29:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 01:30:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 01:30:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:30:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:30:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:30:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:30:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:30:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 01:30:37 [DEBUG   ] Finished updating board flags in 1.553 seconds
2016-04-22 01:30:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 01:30:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 01:31:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 01:31:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:31:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:31:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:31:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:31:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:31:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 01:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:31:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-22 01:31:37 [DEBUG   ] Finished updating board flags in 1.620 seconds
2016-04-22 01:31:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 01:31:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 01:32:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 01:32:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:32:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:32:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:32:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:32:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:32:37 [DEBUG   ] Finished updating board flags in 1.613 seconds
2016-04-22 01:32:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 01:32:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 01:33:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 01:33:23 [DEBUG   ] Got command RPT from MCS: ref #675357
2016-04-22 01:33:23 [DEBUG   ] summary = ERROR
2016-04-22 01:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675357  13 57500  5603982 A  ERRORERROR'
2016-04-22 01:33:24 [DEBUG   ] Got command RPT from MCS: ref #675358
2016-04-22 01:33:24 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675358  77 57500  5604186 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:33:24 [DEBUG   ] Got command RPT from MCS: ref #675359
2016-04-22 01:33:24 [DEBUG   ] summary = ERROR
2016-04-22 01:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675359  13 57500  5604390 A  ERRORERROR'
2016-04-22 01:33:24 [DEBUG   ] Got command RPT from MCS: ref #675360
2016-04-22 01:33:24 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675360  77 57500  5604582 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:33:24 [DEBUG   ] Got command RPT from MCS: ref #675361
2016-04-22 01:33:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 01:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675361  12 57500  5604786 A  ERRORBŠÌÍ'
2016-04-22 01:33:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:33:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:33:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:33:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:33:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:33:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 01:33:38 [DEBUG   ] Finished updating board flags in 1.629 seconds
2016-04-22 01:33:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 01:33:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 01:34:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 01:34:29 [DEBUG   ] Got command RPT from MCS: ref #675362
2016-04-22 01:34:29 [DEBUG   ] summary = ERROR
2016-04-22 01:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675362  13 57500  5669718 A  ERRORERROR'
2016-04-22 01:34:29 [DEBUG   ] Got command RPT from MCS: ref #675363
2016-04-22 01:34:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675363  77 57500  5669718 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:34:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:34:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:34:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:34:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:34:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:34:38 [DEBUG   ] Finished updating board flags in 1.664 seconds
2016-04-22 01:34:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 01:34:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 01:35:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 01:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:35:38 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2016-04-22 01:35:38 [DEBUG   ] Finished updating board flags in 2.321 seconds
2016-04-22 01:35:58 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2016-04-22 01:36:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 01:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:36:38 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2016-04-22 01:36:38 [DEBUG   ] Finished updating board flags in 2.101 seconds
2016-04-22 01:36:58 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2016-04-22 01:37:19 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 01:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:37:38 [DEBUG   ] Finished updating board flags in 2.051 seconds
2016-04-22 01:37:39 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-22 01:37:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 01:38:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 01:38:24 [DEBUG   ] Got command RPT from MCS: ref #675386
2016-04-22 01:38:24 [DEBUG   ] summary = ERROR
2016-04-22 01:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675386  13 57500  5904074 A  ERRORERROR'
2016-04-22 01:38:24 [DEBUG   ] Got command RPT from MCS: ref #675387
2016-04-22 01:38:24 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675387  77 57500  5904266 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:38:24 [DEBUG   ] Got command RPT from MCS: ref #675388
2016-04-22 01:38:24 [DEBUG   ] summary = ERROR
2016-04-22 01:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675388  13 57500  5904470 A  ERRORERROR'
2016-04-22 01:38:24 [DEBUG   ] Got command RPT from MCS: ref #675389
2016-04-22 01:38:24 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675389  77 57500  5904674 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:38:24 [DEBUG   ] Got command RPT from MCS: ref #675390
2016-04-22 01:38:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 01:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675390  12 57500  5904866 A  ERRORBŠÌÍ'
2016-04-22 01:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:38:38 [DEBUG   ] Finished updating board flags in 1.953 seconds
2016-04-22 01:38:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 01:38:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 01:39:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 01:39:29 [DEBUG   ] Got command RPT from MCS: ref #675396
2016-04-22 01:39:29 [DEBUG   ] summary = ERROR
2016-04-22 01:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675396  13 57500  5969718 A  ERRORERROR'
2016-04-22 01:39:29 [DEBUG   ] Got command RPT from MCS: ref #675397
2016-04-22 01:39:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675397  77 57500  5969718 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:39:38 [DEBUG   ] Finished updating board flags in 1.827 seconds
2016-04-22 01:39:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 01:39:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 01:40:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 01:40:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:40:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:40:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:40:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:40:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:40:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 01:40:38 [DEBUG   ] Finished updating board flags in 1.756 seconds
2016-04-22 01:40:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 01:40:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 01:41:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 01:41:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:41:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:41:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:41:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:41:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:41:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 01:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:41:38 [DEBUG   ] Finished updating board flags in 1.634 seconds
2016-04-22 01:41:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 01:41:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 01:42:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 01:42:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:42:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:42:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:42:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:42:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:42:38 [DEBUG   ] Finished updating board flags in 1.677 seconds
2016-04-22 01:42:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 01:42:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 01:43:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-22 01:43:24 [DEBUG   ] Got command RPT from MCS: ref #675416
2016-04-22 01:43:24 [DEBUG   ] summary = ERROR
2016-04-22 01:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675416  13 57500  6204150 A  ERRORERROR'
2016-04-22 01:43:24 [DEBUG   ] Got command RPT from MCS: ref #675417
2016-04-22 01:43:24 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675417  77 57500  6204354 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:43:24 [DEBUG   ] Got command RPT from MCS: ref #675418
2016-04-22 01:43:24 [DEBUG   ] summary = ERROR
2016-04-22 01:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675418  13 57500  6204558 A  ERRORERROR'
2016-04-22 01:43:24 [DEBUG   ] Got command RPT from MCS: ref #675419
2016-04-22 01:43:24 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675419  77 57500  6204750 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:43:24 [DEBUG   ] Got command RPT from MCS: ref #675420
2016-04-22 01:43:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 01:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675420  12 57500  6204954 A  ERRORBŠÌÍ'
2016-04-22 01:43:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:43:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:43:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:43:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:43:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:43:38 [DEBUG   ] Finished updating board flags in 1.504 seconds
2016-04-22 01:43:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 01:43:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 01:44:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 01:44:29 [DEBUG   ] Got command RPT from MCS: ref #675424
2016-04-22 01:44:29 [DEBUG   ] summary = ERROR
2016-04-22 01:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675424  13 57500  6269726 A  ERRORERROR'
2016-04-22 01:44:29 [DEBUG   ] Got command RPT from MCS: ref #675425
2016-04-22 01:44:29 [DEBUG   ] info = T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 01:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675425  77 57500  6269726 A  ERRORT_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 01:44:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:44:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:44:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:44:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:44:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:44:38 [DEBUG   ] Finished updating board flags in 1.528 seconds
2016-04-22 01:44:39 [DEBUG   ] Finished updating ant stats in 0.990 seconds
2016-04-22 01:44:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 01:45:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 01:45:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 01:45:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 01:45:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 01:45:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 01:45:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 01:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 01:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 01:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 01:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 01:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 01:45:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 01:45:38 [DEBUG   ] Finished updating board flags in 1.530 seconds
2016-04-22 01:45:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 01:45:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 01:46:00 [DEBUG   ] Got command INI from MCS: ref #675441
2016-04-22 01:46:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2016-04-22 01:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   675441   8 57500  6360334 ABOOTING'
2016-04-22 01:46:24 [INFO    ] -------------------
2016-04-22 01:46:24 [INFO    ]  LWA board status
2016-04-22 01:46:24 [INFO    ] -------------------
2016-04-22 01:46:24 [INFO    ] DP 1: 2 lwa27
2016-04-22 01:46:24 [INFO    ] DP 1: 3 lwa24
2016-04-22 01:46:24 [INFO    ] DP 1: 4 lwa23
2016-04-22 01:46:24 [INFO    ] DP 1: 5 lwa18
2016-04-22 01:46:24 [INFO    ] DP 1: 6 lwa10
2016-04-22 01:46:24 [INFO    ] DP 1: 7 lwa32
2016-04-22 01:46:24 [INFO    ] DP 1: 8 lwa11
2016-04-22 01:46:24 [INFO    ] DP 1: 9 lwa30
2016-04-22 01:46:24 [INFO    ] DP 1: 10 lwa12
2016-04-22 01:46:24 [INFO    ] DP 1: 11 lwa8
2016-04-22 01:46:24 [INFO    ] DP 1: 12 lwa13
2016-04-22 01:46:24 [INFO    ] DP 1: 13 lwa26
2016-04-22 01:46:24 [INFO    ] DP 1: 14 lwa14
2016-04-22 01:46:24 [INFO    ] DP 1: 16 lwa22
2016-04-22 01:46:24 [INFO    ] DP 1: 17 lwa20
2016-04-22 01:46:24 [INFO    ] DP 1: 18 lwa1
2016-04-22 01:46:24 [INFO    ] DP 1: 19 lwa5
2016-04-22 01:46:24 [INFO    ] DP 1: 20 lwa25
2016-04-22 01:46:24 [INFO    ] DP 1: 21 lwa35
2016-04-22 01:46:24 [INFO    ] DP 1: 22 lwa19
2016-04-22 01:46:24 [INFO    ] DP 1: 23 lwa21
2016-04-22 01:46:24 [INFO    ] DP 1: 24 lwa6
2016-04-22 01:46:24 [INFO    ] DP 1: 25 lwa7
2016-04-22 01:46:24 [INFO    ] DP 1: 26 lwa33
2016-04-22 01:46:24 [INFO    ] DP 1: 27 lwa15
2016-04-22 01:46:24 [INFO    ] DP 1: 28 lwa28
2016-04-22 01:46:24 [INFO    ] DP 2: 1 lwa16
2016-04-22 01:46:24 [INFO    ] DP 2: 15 lwa34
2016-04-22 01:46:24 [INFO    ] Total of 28 boards
2016-04-22 01:46:24 [INFO    ] Total of 260 stands
2016-04-22 01:46:24 [INFO    ] -------------------
2016-04-22 01:46:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24843
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24844
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24845
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24846
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24847
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24848
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24849
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24850
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24851
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24852
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24853
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24854
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24855
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24856
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24857
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24858
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24859
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24860
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24861
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24862
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24863
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24864
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24865
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24866
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24867
2016-04-22 01:46:31 [DEBUG   ] 2016-04-22 01:46:31 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24868
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24843 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24844 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24845 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24846 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24847 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24848 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24849 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24850 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24851 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24852 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24853 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24854 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24855 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24856 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24857 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24858 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24859 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24860 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24861 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24862 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24863 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24864 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24865 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24866 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24867 exited with status 0
2016-04-22 01:46:43 [DEBUG   ] 2016-04-22 01:46:43 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24868 exited with status 0
2016-04-22 01:46:43 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2016-04-22 01:46:43 [DEBUG   ] spawn_process: at 2016-04-22 01:46:43 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] spawn_process: at 2016-04-22 01:46:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2016-04-22 01:46:44 [DEBUG   ] 2016-04-22 01:46:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 24895
2016-04-22 01:46:44 [DEBUG   ] 2016-04-22 01:46:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 24896
2016-04-22 01:46:49 [DEBUG   ] 2016-04-22 01:46:49 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 24895 exited with status 0
2016-04-22 01:46:49 [DEBUG   ] 2016-04-22 01:46:49 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 24896 exited with status 0
2016-04-22 01:46:49 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2016-04-22 01:46:49 [DEBUG   ] spawn_process: at 2016-04-22 01:46:49 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2016-04-22 01:46:49 [DEBUG   ] spawn_process: at 2016-04-22 01:46:49 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2016-04-22 01:46:49 [INFO    ] Setting Beam 1 xbars
2016-04-22 01:46:49 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2016-04-22 01:46:49 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2016-04-22 01:46:49 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2016-04-22 01:46:49 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2016-04-22 01:46:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2016-04-22 01:46:50 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2016-04-22 01:46:50 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2016-04-22 01:46:50 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2016-04-22 01:46:50 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2016-04-22 01:46:50 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2016-04-22 01:46:50 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2016-04-22 01:46:50 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2016-04-22 01:46:50 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2016-04-22 01:46:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2016-04-22 01:46:51 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2016-04-22 01:46:51 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2016-04-22 01:46:51 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2016-04-22 01:46:51 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2016-04-22 01:46:51 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2016-04-22 01:46:51 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2016-04-22 01:46:51 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2016-04-22 01:46:51 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2016-04-22 01:46:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2016-04-22 01:46:52 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2016-04-22 01:46:52 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2016-04-22 01:46:52 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2016-04-22 01:46:52 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2016-04-22 01:46:52 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2016-04-22 01:46:52 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2016-04-22 01:46:52 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2016-04-22 01:46:52 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2016-04-22 01:46:53 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2016-04-22 01:46:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2016-04-22 01:46:53 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2016-04-22 01:46:53 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2016-04-22 01:46:53 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2016-04-22 01:46:53 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2016-04-22 01:46:53 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2016-04-22 01:46:53 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2016-04-22 01:46:53 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2016-04-22 01:46:53 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2016-04-22 01:46:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2016-04-22 01:46:54 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2016-04-22 01:46:54 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2016-04-22 01:46:54 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2016-04-22 01:46:54 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2016-04-22 01:46:54 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2016-04-22 01:46:54 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2016-04-22 01:46:54 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2016-04-22 01:46:54 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2016-04-22 01:46:55 [INFO    ] Setting Beam 2 xbars
2016-04-22 01:46:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2016-04-22 01:46:55 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2016-04-22 01:46:55 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2016-04-22 01:46:55 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2016-04-22 01:46:55 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2016-04-22 01:46:55 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2016-04-22 01:46:55 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2016-04-22 01:46:55 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2016-04-22 01:46:55 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2016-04-22 01:46:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2016-04-22 01:46:56 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2016-04-22 01:46:56 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2016-04-22 01:46:56 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2016-04-22 01:46:56 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2016-04-22 01:46:56 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2016-04-22 01:46:56 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2016-04-22 01:46:56 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2016-04-22 01:46:56 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2016-04-22 01:46:57 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2016-04-22 01:46:57 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2016-04-22 01:46:57 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2016-04-22 01:46:57 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2016-04-22 01:46:57 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2016-04-22 01:46:57 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2016-04-22 01:46:57 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2016-04-22 01:46:57 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2016-04-22 01:46:57 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2016-04-22 01:46:57 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2016-04-22 01:46:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2016-04-22 01:46:58 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2016-04-22 01:46:58 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2016-04-22 01:46:58 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2016-04-22 01:46:58 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2016-04-22 01:46:58 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2016-04-22 01:46:58 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2016-04-22 01:46:58 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2016-04-22 01:46:58 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2016-04-22 01:46:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2016-04-22 01:46:59 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2016-04-22 01:46:59 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2016-04-22 01:46:59 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2016-04-22 01:46:59 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2016-04-22 01:46:59 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2016-04-22 01:46:59 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2016-04-22 01:46:59 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2016-04-22 01:46:59 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2016-04-22 01:47:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2016-04-22 01:47:00 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2016-04-22 01:47:00 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2016-04-22 01:47:00 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2016-04-22 01:47:00 [INFO    ] Setting Beam 3 xbars
2016-04-22 01:47:00 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2016-04-22 01:47:00 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2016-04-22 01:47:00 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2016-04-22 01:47:00 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2016-04-22 01:47:00 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2016-04-22 01:47:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2016-04-22 01:47:01 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2016-04-22 01:47:01 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2016-04-22 01:47:01 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2016-04-22 01:47:01 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2016-04-22 01:47:01 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2016-04-22 01:47:01 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2016-04-22 01:47:01 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2016-04-22 01:47:01 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2016-04-22 01:47:01 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2016-04-22 01:47:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2016-04-22 01:47:02 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2016-04-22 01:47:02 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2016-04-22 01:47:02 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2016-04-22 01:47:02 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2016-04-22 01:47:02 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2016-04-22 01:47:02 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2016-04-22 01:47:02 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2016-04-22 01:47:02 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2016-04-22 01:47:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2016-04-22 01:47:03 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2016-04-22 01:47:03 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2016-04-22 01:47:03 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2016-04-22 01:47:03 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2016-04-22 01:47:03 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2016-04-22 01:47:03 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2016-04-22 01:47:03 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2016-04-22 01:47:03 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2016-04-22 01:47:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2016-04-22 01:47:04 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2016-04-22 01:47:04 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2016-04-22 01:47:04 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2016-04-22 01:47:04 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2016-04-22 01:47:04 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2016-04-22 01:47:04 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2016-04-22 01:47:04 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2016-04-22 01:47:04 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2016-04-22 01:47:05 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2016-04-22 01:47:05 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2016-04-22 01:47:05 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2016-04-22 01:47:05 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2016-04-22 01:47:05 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2016-04-22 01:47:05 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2016-04-22 01:47:05 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2016-04-22 01:47:05 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2016-04-22 01:47:05 [INFO    ] Setting Beam 4 xbars
2016-04-22 01:47:05 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2016-04-22 01:47:05 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2016-04-22 01:47:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2016-04-22 01:47:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2016-04-22 01:47:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2016-04-22 01:47:06 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2016-04-22 01:47:06 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2016-04-22 01:47:06 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2016-04-22 01:47:06 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2016-04-22 01:47:06 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2016-04-22 01:47:06 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2016-04-22 01:47:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2016-04-22 01:47:07 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2016-04-22 01:47:07 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2016-04-22 01:47:07 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2016-04-22 01:47:07 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2016-04-22 01:47:07 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2016-04-22 01:47:07 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2016-04-22 01:47:07 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2016-04-22 01:47:07 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2016-04-22 01:47:08 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2016-04-22 01:47:08 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2016-04-22 01:47:08 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2016-04-22 01:47:08 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2016-04-22 01:47:08 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2016-04-22 01:47:08 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2016-04-22 01:47:08 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2016-04-22 01:47:08 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2016-04-22 01:47:08 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2016-04-22 01:47:09 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2016-04-22 01:47:09 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2016-04-22 01:47:09 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2016-04-22 01:47:09 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2016-04-22 01:47:09 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2016-04-22 01:47:09 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2016-04-22 01:47:09 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2016-04-22 01:47:09 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2016-04-22 01:47:09 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2016-04-22 01:47:09 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2016-04-22 01:47:10 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2016-04-22 01:47:10 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2016-04-22 01:47:10 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2016-04-22 01:47:10 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2016-04-22 01:47:10 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2016-04-22 01:47:10 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2016-04-22 01:47:10 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2016-04-22 01:47:10 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2016-04-22 01:47:10 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2016-04-22 01:47:11 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2016-04-22 01:47:11 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2016-04-22 01:47:11 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2016-04-22 01:47:11 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2016-04-22 01:47:11 [INFO    ] All xbars set
2016-04-22 01:47:11 [INFO    ] Setting adder chain routing for all beams
2016-04-22 01:47:16 [INFO    ] Setting beam ids
2016-04-22 01:47:26 [INFO    ] Starting beam delay calibration
2016-04-22 01:47:38 [INFO    ] Beam 1 latency is 5733
2016-04-22 01:47:38 [INFO    ] Beam 2 latency is 5743
2016-04-22 01:47:38 [INFO    ] Beam 3 latency is 5735
2016-04-22 01:47:38 [INFO    ] Beam 4 latency is 5712
2016-04-22 01:47:38 [INFO    ] Stop calibration
2016-04-22 01:47:46 [INFO    ] Beam delay calibration successful
2016-04-22 01:47:46 [INFO    ] Calibration passed
2016-04-22 01:47:46 [DEBUG   ] spawn_process: at 2016-04-22 01:47:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2016-04-22 01:47:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2016-04-22 01:47:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2016-04-22 01:47:46 [DEBUG   ] spawn_process: at 2016-04-22 01:47:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2016-04-22 01:47:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2016-04-22 01:47:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2016-04-22 01:47:46 [DEBUG   ] spawn_process: at 2016-04-22 01:47:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2016-04-22 01:47:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2016-04-22 01:47:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2016-04-22 01:47:46 [DEBUG   ] spawn_process: at 2016-04-22 01:47:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2016-04-22 01:47:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2016-04-22 01:47:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2016-04-22 01:47:46 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2016-04-22 01:47:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 269 ms (1461289667.272 s) with PID 26464 and time 1461289668
2016-04-22 01:47:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2016-04-22 01:47:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 359 ms (1461289667.362 s) with PID 26467 and time 1461289668
2016-04-22 01:47:48 [DEBUG   ] Finished updating ant stats in 0.885 seconds
2016-04-22 01:47:48 [INFO    ] Started antennas statistics background thread
2016-04-22 01:47:48 [INFO    ] Started board flags background thread
2016-04-22 01:47:48 [INFO    ] Started BAM background thread
2016-04-22 01:47:48 [INFO    ] Finished the INI process (ref. #675441) in 108.153 s
2016-04-22 01:47:49 [DEBUG   ] Finished updating board flags in 1.064 seconds
2016-04-22 01:48:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 01:48:24 [DEBUG   ] Got command RPT from MCS: ref #675484
2016-04-22 01:48:24 [DEBUG   ] summary = NORMAL
2016-04-22 01:48:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675484  14 57500  6504250 A NORMALNORMAL'
2016-04-22 01:48:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 01:48:30 [DEBUG   ] Got command RPT from MCS: ref #675490
2016-04-22 01:48:30 [DEBUG   ] summary = NORMAL
2016-04-22 01:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675490  14 57500  6510334 A NORMALNORMAL'
2016-04-22 01:48:30 [DEBUG   ] Got command RPT from MCS: ref #675491
2016-04-22 01:48:30 [DEBUG   ] info = System calibrated and operating normally
2016-04-22 01:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675491  48 57500  6510334 A NORMALSystem calibrated and operating normally'
2016-04-22 01:48:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 01:48:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 01:48:49 [DEBUG   ] Finished updating board flags in 1.012 seconds
2016-04-22 01:49:08 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2016-04-22 01:49:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 01:49:29 [DEBUG   ] Got command RPT from MCS: ref #675492
2016-04-22 01:49:29 [DEBUG   ] summary = NORMAL
2016-04-22 01:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675492  14 57500  6569726 A NORMALNORMAL'
2016-04-22 01:49:29 [DEBUG   ] Got command RPT from MCS: ref #675493
2016-04-22 01:49:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-22 01:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675493  48 57500  6569726 A NORMALSystem calibrated and operating normally'
2016-04-22 01:49:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 01:49:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 01:49:49 [DEBUG   ] Finished updating board flags in 0.988 seconds
2016-04-22 01:50:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 01:50:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 01:50:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 01:50:50 [DEBUG   ] Finished updating board flags in 1.859 seconds
2016-04-22 01:51:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 01:51:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 01:51:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 01:51:49 [DEBUG   ] Finished updating board flags in 1.204 seconds
2016-04-22 01:52:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 01:52:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 01:52:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 01:52:49 [DEBUG   ] Finished updating board flags in 1.238 seconds
2016-04-22 01:53:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 01:53:24 [DEBUG   ] Got command RPT from MCS: ref #675515
2016-04-22 01:53:24 [DEBUG   ] summary = NORMAL
2016-04-22 01:53:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675515  14 57500  6804358 A NORMALNORMAL'
2016-04-22 01:53:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 01:53:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 01:53:49 [DEBUG   ] Finished updating board flags in 1.223 seconds
2016-04-22 01:54:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 01:54:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 01:54:29 [DEBUG   ] Got command RPT from MCS: ref #675516
2016-04-22 01:54:29 [DEBUG   ] summary = NORMAL
2016-04-22 01:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675516  14 57500  6869730 A NORMALNORMAL'
2016-04-22 01:54:29 [DEBUG   ] Got command RPT from MCS: ref #675517
2016-04-22 01:54:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-22 01:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675517  48 57500  6869730 A NORMALSystem calibrated and operating normally'
2016-04-22 01:54:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 01:54:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2016-04-22 01:54:49 [DEBUG   ] Finished updating board flags in 1.127 seconds
2016-04-22 01:55:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 01:55:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 01:55:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 01:55:50 [DEBUG   ] Finished updating board flags in 1.596 seconds
2016-04-22 01:56:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 01:56:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 01:56:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 01:56:50 [DEBUG   ] Finished updating board flags in 1.433 seconds
2016-04-22 01:57:08 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-22 01:57:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 01:57:48 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 01:57:50 [DEBUG   ] Finished updating board flags in 1.337 seconds
2016-04-22 01:58:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 01:58:24 [DEBUG   ] Got command RPT from MCS: ref #675537
2016-04-22 01:58:24 [DEBUG   ] summary = NORMAL
2016-04-22 01:58:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675537  14 57500  7104446 A NORMALNORMAL'
2016-04-22 01:58:28 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 01:58:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 01:58:50 [DEBUG   ] Finished updating board flags in 1.216 seconds
2016-04-22 01:58:58 [DEBUG   ] Got command DRX from MCS: ref #675553
2016-04-22 01:58:58 [INFO    ] sending drx command to lwa16
2016-04-22 01:58:58 [DEBUG   ] run_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 32000000.0 7 9 63']
2016-04-22 01:58:58 [DEBUG   ] drx = exited with status True, code 0x00
2016-04-22 01:58:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   675553   8 57500  7138014 A NORMAL'
2016-04-22 01:58:58 [DEBUG   ] Got command DRX from MCS: ref #675554
2016-04-22 01:58:58 [INFO    ] sending drx command to lwa16
2016-04-22 01:58:58 [DEBUG   ] run_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 32000000.0 7 9 63']
2016-04-22 01:58:58 [DEBUG   ] drx = exited with status True, code 0x00
2016-04-22 01:58:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   675554   8 57500  7138018 A NORMAL'
2016-04-22 01:58:58 [DEBUG   ] Got command DRX from MCS: ref #675552
2016-04-22 01:58:58 [INFO    ] sending drx command to lwa34
2016-04-22 01:58:58 [DEBUG   ] run_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 32000000.0 7 9 63']
2016-04-22 01:58:58 [DEBUG   ] drx = exited with status True, code 0x00
2016-04-22 01:58:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   675552   8 57500  7138022 A NORMAL'
2016-04-22 01:58:58 [DEBUG   ] Got command DRX from MCS: ref #675556
2016-04-22 01:58:58 [INFO    ] sending drx command to lwa16
2016-04-22 01:58:58 [DEBUG   ] run_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 46000000.0 7 9 63']
2016-04-22 01:58:58 [DEBUG   ] drx = exited with status True, code 0x00
2016-04-22 01:58:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   675556   8 57500  7138026 A NORMAL'
2016-04-22 01:58:58 [DEBUG   ] Got command DRX from MCS: ref #675557
2016-04-22 01:58:58 [INFO    ] sending drx command to lwa16
2016-04-22 01:58:58 [DEBUG   ] run_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 46000000.0 7 9 63']
2016-04-22 01:58:58 [DEBUG   ] drx = exited with status True, code 0x00
2016-04-22 01:58:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   675557   8 57500  7138030 A NORMAL'
2016-04-22 01:58:58 [DEBUG   ] Got command DRX from MCS: ref #675555
2016-04-22 01:58:58 [INFO    ] sending drx command to lwa34
2016-04-22 01:58:58 [DEBUG   ] run_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 46000000.0 7 9 63']
2016-04-22 01:58:58 [DEBUG   ] drx = exited with status True, code 0x00
2016-04-22 01:58:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   675555   8 57500  7138034 A NORMAL'
2016-04-22 01:58:58 [INFO    ] Finished starting DRX
2016-04-22 01:58:58 [INFO    ] Finished starting DRX
2016-04-22 01:58:58 [INFO    ] Finished starting DRX
2016-04-22 01:58:58 [INFO    ] Finished starting DRX
2016-04-22 01:58:58 [INFO    ] Finished starting DRX
2016-04-22 01:58:58 [INFO    ] Finished starting DRX
2016-04-22 01:58:58 [DEBUG   ] Got command BAM from MCS: ref #675559
2016-04-22 01:58:58 [INFO    ] Finished processing BAM request
2016-04-22 01:58:58 [DEBUG   ] bam = exited with status True, code 0x00
2016-04-22 01:58:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675559   8 57500  7138158 A NORMAL'
2016-04-22 01:58:58 [DEBUG   ] Got command BAM from MCS: ref #675560
2016-04-22 01:58:58 [INFO    ] Finished processing BAM request
2016-04-22 01:58:58 [DEBUG   ] bam = exited with status True, code 0x00
2016-04-22 01:58:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675560   8 57500  7138246 A NORMAL'
2016-04-22 01:58:58 [DEBUG   ] Got command BAM from MCS: ref #675558
2016-04-22 01:58:58 [INFO    ] Finished processing BAM request
2016-04-22 01:58:58 [DEBUG   ] bam = exited with status True, code 0x00
2016-04-22 01:58:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   675558   8 57500  7138358 A NORMAL'
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2016-04-22 01:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2016-04-22 01:58:58 [DEBUG   ] spawn_process: at 2016-04-22 01:58:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2016-04-22 01:59:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 01:59:28 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 01:59:29 [DEBUG   ] Got command RPT from MCS: ref #675564
2016-04-22 01:59:29 [DEBUG   ] summary = NORMAL
2016-04-22 01:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675564  14 57500  7169726 A NORMALNORMAL'
2016-04-22 01:59:29 [DEBUG   ] Got command RPT from MCS: ref #675565
2016-04-22 01:59:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-22 01:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675565  48 57500  7169726 A NORMALSystem calibrated and operating normally'
2016-04-22 01:59:48 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 01:59:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-22 01:59:50 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 01:59:50 [DEBUG   ] Finished updating board flags in 1.218 seconds
2016-04-22 02:00:08 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 02:00:28 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 02:00:48 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 02:00:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 02:00:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 02:00:50 [DEBUG   ] Finished updating board flags in 1.215 seconds
2016-04-22 02:01:00 [DEBUG   ] Got command TBN from MCS: ref #675581
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '1', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '2', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] tbn = exited with status True, code 0x00
2016-04-22 02:01:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   675581   8 57500  7260350 A NORMAL'
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '3', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '4', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '5', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '6', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '7', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '8', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '9', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '10', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '11', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '12', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '13', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '14', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '15', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '16', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '17', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '18', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '19', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '20', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '21', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '22', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '23', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '24', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '25', '1461290461']
2016-04-22 02:01:00 [DEBUG   ] spawn_process: at 2016-04-22 02:01:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '18', '0', '26', '1461290461']
2016-04-22 02:01:00 [INFO    ] Finished spawning TBN in 0.050 s
2016-04-22 02:01:08 [DEBUG   ] Finished updating ant stats in 0.469 seconds
2016-04-22 02:01:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 02:01:48 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 02:01:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2016-04-22 02:01:50 [DEBUG   ] Finished updating board flags in 1.523 seconds
2016-04-22 02:02:08 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 02:02:28 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 02:02:49 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2016-04-22 02:02:50 [DEBUG   ] Finished updating board flags in 1.521 seconds
2016-04-22 02:03:09 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-22 02:03:24 [DEBUG   ] Got command RPT from MCS: ref #675585
2016-04-22 02:03:24 [DEBUG   ] summary = NORMAL
2016-04-22 02:03:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675585  14 57500  7404538 A NORMALNORMAL'
2016-04-22 02:03:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 02:03:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 02:03:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 02:03:51 [DEBUG   ] Finished updating board flags in 2.196 seconds
2016-04-22 02:04:09 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-22 02:04:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 02:04:29 [DEBUG   ] Got command RPT from MCS: ref #675586
2016-04-22 02:04:29 [DEBUG   ] summary = NORMAL
2016-04-22 02:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675586  14 57500  7469726 A NORMALNORMAL'
2016-04-22 02:04:29 [DEBUG   ] Got command RPT from MCS: ref #675587
2016-04-22 02:04:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-22 02:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675587  48 57500  7469726 A NORMALSystem calibrated and operating normally'
2016-04-22 02:04:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 02:04:51 [DEBUG   ] Finished updating board flags in 1.956 seconds
2016-04-22 02:05:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 02:05:29 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-22 02:05:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 02:05:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 02:05:51 [DEBUG   ] Finished updating board flags in 1.797 seconds
2016-04-22 02:06:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 02:06:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 02:06:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2016-04-22 02:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2016-04-22 02:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2016-04-22 02:06:51 [DEBUG   ] Finished updating board flags in 1.640 seconds
2016-04-22 02:07:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 02:07:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 02:07:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2016-04-22 02:07:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2016-04-22 02:07:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 02:07:51 [DEBUG   ] Finished updating board flags in 1.601 seconds
2016-04-22 02:08:09 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2016-04-22 02:08:24 [DEBUG   ] Got command RPT from MCS: ref #675610
2016-04-22 02:08:24 [DEBUG   ] summary = NORMAL
2016-04-22 02:08:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675610  14 57500  7704614 A NORMALNORMAL'
2016-04-22 02:08:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 02:08:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999783
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999783
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999783
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999783
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999783
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2016-04-22 02:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999783
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2016-04-22 02:08:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 02:08:51 [DEBUG   ] Finished updating board flags in 1.533 seconds
2016-04-22 02:09:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 02:09:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 02:09:29 [DEBUG   ] Got command RPT from MCS: ref #675616
2016-04-22 02:09:29 [DEBUG   ] summary = NORMAL
2016-04-22 02:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675616  14 57500  7769730 A NORMALNORMAL'
2016-04-22 02:09:29 [DEBUG   ] Got command RPT from MCS: ref #675617
2016-04-22 02:09:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-22 02:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675617  48 57500  7769730 A NORMALSystem calibrated and operating normally'
2016-04-22 02:09:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999921
2016-04-22 02:09:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2016-04-22 02:09:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 02:09:51 [DEBUG   ] Finished updating board flags in 1.419 seconds
2016-04-22 02:10:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 02:10:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 02:10:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2016-04-22 02:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2016-04-22 02:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2016-04-22 02:10:51 [DEBUG   ] Finished updating board flags in 1.510 seconds
2016-04-22 02:11:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 02:11:29 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 02:11:50 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 02:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2016-04-22 02:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2016-04-22 02:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2016-04-22 02:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2016-04-22 02:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2016-04-22 02:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2016-04-22 02:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2016-04-22 02:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2016-04-22 02:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2016-04-22 02:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2016-04-22 02:11:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 02:11:51 [DEBUG   ] Finished updating board flags in 1.480 seconds
2016-04-22 02:12:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 02:12:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 02:12:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-22 02:12:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2016-04-22 02:12:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2016-04-22 02:12:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2016-04-22 02:12:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2016-04-22 02:12:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2016-04-22 02:12:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 02:12:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2016-04-22 02:12:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2016-04-22 02:12:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2016-04-22 02:12:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2016-04-22 02:12:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2016-04-22 02:12:52 [DEBUG   ] Finished updating board flags in 2.237 seconds
2016-04-22 02:13:10 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-22 02:13:24 [DEBUG   ] Got command RPT from MCS: ref #675636
2016-04-22 02:13:24 [DEBUG   ] summary = NORMAL
2016-04-22 02:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675636  14 57500  8004702 A NORMALNORMAL'
2016-04-22 02:13:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 02:13:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 02:13:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2016-04-22 02:13:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2016-04-22 02:13:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2016-04-22 02:13:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2016-04-22 02:13:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2016-04-22 02:13:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 02:13:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2016-04-22 02:13:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2016-04-22 02:13:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2016-04-22 02:13:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2016-04-22 02:13:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2016-04-22 02:13:52 [DEBUG   ] Finished updating board flags in 2.155 seconds
2016-04-22 02:14:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 02:14:29 [DEBUG   ] Got command RPT from MCS: ref #675640
2016-04-22 02:14:29 [DEBUG   ] summary = NORMAL
2016-04-22 02:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675640  14 57500  8069734 A NORMALNORMAL'
2016-04-22 02:14:29 [DEBUG   ] Got command RPT from MCS: ref #675641
2016-04-22 02:14:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-22 02:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675641  48 57500  8069734 A NORMALSystem calibrated and operating normally'
2016-04-22 02:14:30 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-22 02:14:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 02:14:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2016-04-22 02:14:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2016-04-22 02:14:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2016-04-22 02:14:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2016-04-22 02:14:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2016-04-22 02:14:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2016-04-22 02:14:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2016-04-22 02:14:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2016-04-22 02:14:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2016-04-22 02:14:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2016-04-22 02:14:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 02:14:52 [DEBUG   ] Finished updating board flags in 2.015 seconds
2016-04-22 02:15:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 02:15:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-22 02:15:50 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-22 02:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2016-04-22 02:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2016-04-22 02:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2016-04-22 02:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2016-04-22 02:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2016-04-22 02:15:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2016-04-22 02:15:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2016-04-22 02:15:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2016-04-22 02:15:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2016-04-22 02:15:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2016-04-22 02:15:52 [DEBUG   ] Finished updating board flags in 1.987 seconds
2016-04-22 02:16:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 02:16:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 02:16:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 02:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2016-04-22 02:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2016-04-22 02:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2016-04-22 02:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2016-04-22 02:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2016-04-22 02:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2016-04-22 02:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2016-04-22 02:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2016-04-22 02:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2016-04-22 02:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2016-04-22 02:16:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 02:16:52 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 02:16:52 [DEBUG   ] Finished updating board flags in 1.813 seconds
2016-04-22 02:17:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 02:17:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 02:17:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2016-04-22 02:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2016-04-22 02:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2016-04-22 02:17:52 [DEBUG   ] Finished updating board flags in 1.887 seconds
2016-04-22 02:18:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 02:18:24 [DEBUG   ] Got command RPT from MCS: ref #675661
2016-04-22 02:18:24 [DEBUG   ] summary = NORMAL
2016-04-22 02:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675661  14 57500  8304814 A NORMALNORMAL'
2016-04-22 02:18:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 02:18:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2016-04-22 02:18:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2016-04-22 02:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2016-04-22 02:18:52 [DEBUG   ] Finished updating board flags in 1.814 seconds
2016-04-22 02:19:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 02:19:29 [DEBUG   ] Got command RPT from MCS: ref #675667
2016-04-22 02:19:29 [DEBUG   ] summary = NORMAL
2016-04-22 02:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675667  14 57500  8369726 A NORMALNORMAL'
2016-04-22 02:19:29 [DEBUG   ] Got command RPT from MCS: ref #675668
2016-04-22 02:19:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-22 02:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675668  48 57500  8369728 A NORMALSystem calibrated and operating normally'
2016-04-22 02:19:30 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2016-04-22 02:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:19:51 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 02:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:19:52 [DEBUG   ] Finished updating board flags in 1.697 seconds
2016-04-22 02:20:11 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 02:20:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 02:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:20:51 [DEBUG   ] Finished updating ant stats in 1.247 seconds
2016-04-22 02:20:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 02:20:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2016-04-22 02:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:20:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 02:20:52 [DEBUG   ] Finished updating board flags in 1.613 seconds
2016-04-22 02:21:11 [DEBUG   ] Finished updating ant stats in 1.157 seconds
2016-04-22 02:21:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 02:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:21:51 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2016-04-22 02:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:21:52 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 02:21:52 [DEBUG   ] Finished updating board flags in 1.580 seconds
2016-04-22 02:22:11 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2016-04-22 02:22:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 02:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:22:51 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2016-04-22 02:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:22:52 [DEBUG   ] Finished updating board flags in 1.417 seconds
2016-04-22 02:23:11 [DEBUG   ] Finished updating ant stats in 0.753 seconds
2016-04-22 02:23:24 [DEBUG   ] Got command RPT from MCS: ref #675690
2016-04-22 02:23:24 [DEBUG   ] summary = NORMAL
2016-04-22 02:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675690  14 57500  8604898 A NORMALNORMAL'
2016-04-22 02:23:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 02:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:23:51 [DEBUG   ] Finished updating ant stats in 0.650 seconds
2016-04-22 02:23:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 02:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:23:52 [DEBUG   ] Finished updating board flags in 1.408 seconds
2016-04-22 02:24:11 [DEBUG   ] Finished updating ant stats in 0.553 seconds
2016-04-22 02:24:29 [DEBUG   ] Got command RPT from MCS: ref #675691
2016-04-22 02:24:29 [DEBUG   ] summary = NORMAL
2016-04-22 02:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675691  14 57500  8669738 A NORMALNORMAL'
2016-04-22 02:24:29 [DEBUG   ] Got command RPT from MCS: ref #675692
2016-04-22 02:24:29 [DEBUG   ] info = System calibrated and operating normally
2016-04-22 02:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675692  48 57500  8669738 A NORMALSystem calibrated and operating normally'
2016-04-22 02:24:32 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2016-04-22 02:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:24:52 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 02:24:52 [DEBUG   ] Finished updating board flags in 1.389 seconds
2016-04-22 02:25:12 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-22 02:25:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 02:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:25:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 02:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:25:52 [DEBUG   ] Finished updating ant stats in 1.246 seconds
2016-04-22 02:25:52 [DEBUG   ] Finished updating board flags in 1.426 seconds
2016-04-22 02:26:12 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2016-04-22 02:26:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 02:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:26:52 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2016-04-22 02:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:26:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 02:26:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2016-04-22 02:26:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 02:26:53 [CRITICAL] MGT underflow detected on beam(s) 1
2016-04-22 02:26:53 [DEBUG   ] Finished updating board flags in 2.188 seconds
2016-04-22 02:27:12 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2016-04-22 02:27:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 02:27:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:27:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:27:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:27:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:27:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:27:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 02:27:52 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2016-04-22 02:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:27:53 [DEBUG   ] Finished updating board flags in 2.007 seconds
2016-04-22 02:28:12 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2016-04-22 02:28:24 [DEBUG   ] Got command RPT from MCS: ref #675712
2016-04-22 02:28:25 [DEBUG   ] summary = ERROR
2016-04-22 02:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675712  13 57500  8905011 A  ERRORERROR'
2016-04-22 02:28:25 [DEBUG   ] Got command RPT from MCS: ref #675713
2016-04-22 02:28:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 02:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675713  77 57500  8905166 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 02:28:25 [DEBUG   ] Got command RPT from MCS: ref #675714
2016-04-22 02:28:25 [DEBUG   ] summary = ERROR
2016-04-22 02:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675714  13 57500  8905370 A  ERRORERROR'
2016-04-22 02:28:25 [DEBUG   ] Got command RPT from MCS: ref #675715
2016-04-22 02:28:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 02:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675715  77 57500  8905574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 02:28:25 [DEBUG   ] Got command RPT from MCS: ref #675716
2016-04-22 02:28:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 02:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675716  12 57500  8905778 A  ERRORB”™š'
2016-04-22 02:28:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 02:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:28:52 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2016-04-22 02:28:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:28:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:28:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:28:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:28:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:28:53 [DEBUG   ] Finished updating board flags in 1.998 seconds
2016-04-22 02:29:12 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2016-04-22 02:29:29 [DEBUG   ] Got command RPT from MCS: ref #675725
2016-04-22 02:29:29 [DEBUG   ] summary = ERROR
2016-04-22 02:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675725  13 57500  8969734 A  ERRORERROR'
2016-04-22 02:29:29 [DEBUG   ] Got command RPT from MCS: ref #675726
2016-04-22 02:29:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 02:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675726  77 57500  8969734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 02:29:32 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 02:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:29:53 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2016-04-22 02:29:53 [DEBUG   ] Finished updating board flags in 1.807 seconds
2016-04-22 02:30:13 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 02:30:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 02:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:30:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2016-04-22 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:30:53 [DEBUG   ] Finished updating ant stats in 1.247 seconds
2016-04-22 02:30:53 [DEBUG   ] Finished updating board flags in 1.845 seconds
2016-04-22 02:31:13 [DEBUG   ] Finished updating ant stats in 1.160 seconds
2016-04-22 02:31:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 02:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:31:53 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2016-04-22 02:31:53 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 02:31:53 [DEBUG   ] Finished updating board flags in 1.795 seconds
2016-04-22 02:32:13 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2016-04-22 02:32:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 02:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:32:53 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2016-04-22 02:32:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 02:32:53 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 02:32:53 [DEBUG   ] Finished updating board flags in 1.632 seconds
2016-04-22 02:33:13 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2016-04-22 02:33:25 [DEBUG   ] Got command RPT from MCS: ref #675745
2016-04-22 02:33:25 [DEBUG   ] summary = ERROR
2016-04-22 02:33:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675745  13 57500  9205046 A  ERRORERROR'
2016-04-22 02:33:25 [DEBUG   ] Got command RPT from MCS: ref #675746
2016-04-22 02:33:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 02:33:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675746  77 57500  9205250 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 02:33:25 [DEBUG   ] Got command RPT from MCS: ref #675747
2016-04-22 02:33:25 [DEBUG   ] summary = ERROR
2016-04-22 02:33:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675747  13 57500  9205454 A  ERRORERROR'
2016-04-22 02:33:25 [DEBUG   ] Got command RPT from MCS: ref #675748
2016-04-22 02:33:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 02:33:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675748  77 57500  9205667 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 02:33:25 [DEBUG   ] Got command RPT from MCS: ref #675749
2016-04-22 02:33:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 02:33:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675749  12 57500  9205858 A  ERRORB•™š'
2016-04-22 02:33:33 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-22 02:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:33:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2016-04-22 02:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:33:53 [DEBUG   ] Finished updating board flags in 1.576 seconds
2016-04-22 02:33:54 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2016-04-22 02:34:14 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2016-04-22 02:34:29 [DEBUG   ] Got command RPT from MCS: ref #675750
2016-04-22 02:34:29 [DEBUG   ] summary = ERROR
2016-04-22 02:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675750  13 57500  9269742 A  ERRORERROR'
2016-04-22 02:34:29 [DEBUG   ] Got command RPT from MCS: ref #675751
2016-04-22 02:34:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 02:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675751  77 57500  9269742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 02:34:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 02:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:34:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2016-04-22 02:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:34:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2016-04-22 02:34:53 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 02:34:53 [DEBUG   ] Finished updating board flags in 1.548 seconds
2016-04-22 02:34:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 02:35:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 02:35:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 02:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:35:54 [DEBUG   ] Finished updating board flags in 1.571 seconds
2016-04-22 02:35:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 02:36:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 02:36:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-22 02:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:36:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:36:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:36:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:36:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:36:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:36:54 [DEBUG   ] Finished updating ant stats in 1.054 seconds
2016-04-22 02:36:54 [DEBUG   ] Finished updating board flags in 2.146 seconds
2016-04-22 02:37:14 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2016-04-22 02:37:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 02:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:37:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:37:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:37:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:37:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:37:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:37:54 [DEBUG   ] Finished updating ant stats in 0.843 seconds
2016-04-22 02:37:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 02:37:54 [DEBUG   ] Finished updating board flags in 1.962 seconds
2016-04-22 02:38:14 [DEBUG   ] Finished updating ant stats in 0.761 seconds
2016-04-22 02:38:25 [DEBUG   ] Got command RPT from MCS: ref #675774
2016-04-22 02:38:25 [DEBUG   ] summary = ERROR
2016-04-22 02:38:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675774  13 57500  9505158 A  ERRORERROR'
2016-04-22 02:38:25 [DEBUG   ] Got command RPT from MCS: ref #675775
2016-04-22 02:38:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 02:38:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675775  77 57500  9505363 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 02:38:25 [DEBUG   ] Got command RPT from MCS: ref #675776
2016-04-22 02:38:25 [DEBUG   ] summary = ERROR
2016-04-22 02:38:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675776  13 57500  9505566 A  ERRORERROR'
2016-04-22 02:38:25 [DEBUG   ] Got command RPT from MCS: ref #675777
2016-04-22 02:38:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 02:38:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675777  77 57500  9505758 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 02:38:25 [DEBUG   ] Got command RPT from MCS: ref #675778
2016-04-22 02:38:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 02:38:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675778  12 57500  9505962 A  ERRORB”™š'
2016-04-22 02:38:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 02:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:38:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:38:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:38:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:38:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:38:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:38:54 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2016-04-22 02:38:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2016-04-22 02:38:54 [CRITICAL] MGT underflow detected on beam(s) 1
2016-04-22 02:38:54 [DEBUG   ] Finished updating board flags in 1.801 seconds
2016-04-22 02:39:14 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2016-04-22 02:39:29 [DEBUG   ] Got command RPT from MCS: ref #675784
2016-04-22 02:39:29 [DEBUG   ] summary = ERROR
2016-04-22 02:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675784  13 57500  9569734 A  ERRORERROR'
2016-04-22 02:39:29 [DEBUG   ] Got command RPT from MCS: ref #675785
2016-04-22 02:39:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 02:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675785  77 57500  9569734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 02:39:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 02:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:39:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:39:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:39:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:39:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:39:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:39:54 [DEBUG   ] Finished updating ant stats in 0.445 seconds
2016-04-22 02:39:54 [DEBUG   ] Finished updating board flags in 1.808 seconds
2016-04-22 02:40:15 [DEBUG   ] Finished updating ant stats in 1.358 seconds
2016-04-22 02:40:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 02:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:40:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 02:40:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:40:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:40:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:40:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:40:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:40:54 [DEBUG   ] Finished updating board flags in 1.755 seconds
2016-04-22 02:40:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 02:41:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 02:41:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 02:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:41:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:41:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:41:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:41:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:41:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:41:54 [DEBUG   ] Finished updating board flags in 1.663 seconds
2016-04-22 02:41:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 02:42:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 02:42:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 02:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:42:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:42:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:42:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:42:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:42:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:42:54 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 02:42:54 [DEBUG   ] Finished updating board flags in 1.621 seconds
2016-04-22 02:42:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 02:43:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 02:43:25 [DEBUG   ] Got command RPT from MCS: ref #675804
2016-04-22 02:43:25 [DEBUG   ] summary = ERROR
2016-04-22 02:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675804  13 57500  9805242 A  ERRORERROR'
2016-04-22 02:43:25 [DEBUG   ] Got command RPT from MCS: ref #675805
2016-04-22 02:43:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 02:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675805  77 57500  9805446 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 02:43:25 [DEBUG   ] Got command RPT from MCS: ref #675806
2016-04-22 02:43:25 [DEBUG   ] summary = ERROR
2016-04-22 02:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675806  13 57500  9805675 A  ERRORERROR'
2016-04-22 02:43:25 [DEBUG   ] Got command RPT from MCS: ref #675807
2016-04-22 02:43:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 02:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675807  77 57500  9805854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 02:43:26 [DEBUG   ] Got command RPT from MCS: ref #675808
2016-04-22 02:43:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 02:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675808  12 57500  9806046 A  ERRORB•™š'
2016-04-22 02:43:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 02:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:43:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 02:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:43:54 [DEBUG   ] Finished updating board flags in 1.614 seconds
2016-04-22 02:43:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 02:44:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 02:44:29 [DEBUG   ] Got command RPT from MCS: ref #675812
2016-04-22 02:44:29 [DEBUG   ] summary = ERROR
2016-04-22 02:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675812  13 57500  9869810 A  ERRORERROR'
2016-04-22 02:44:29 [DEBUG   ] Got command RPT from MCS: ref #675813
2016-04-22 02:44:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 02:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675813  77 57500  9869810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 02:44:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 02:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:44:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 02:44:53 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 02:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:44:54 [DEBUG   ] Finished updating board flags in 1.532 seconds
2016-04-22 02:44:55 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-22 02:45:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 02:45:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 02:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:45:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 02:45:54 [DEBUG   ] Finished updating board flags in 1.528 seconds
2016-04-22 02:45:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 02:46:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 02:46:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 02:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:46:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 02:46:54 [DEBUG   ] Finished updating board flags in 1.542 seconds
2016-04-22 02:46:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 02:47:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 02:47:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 02:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:47:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:47:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:47:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:47:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:47:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:47:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 02:47:55 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2016-04-22 02:47:55 [DEBUG   ] Finished updating board flags in 2.166 seconds
2016-04-22 02:48:15 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2016-04-22 02:48:25 [DEBUG   ] Got command RPT from MCS: ref #675833
2016-04-22 02:48:25 [DEBUG   ] summary = ERROR
2016-04-22 02:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675833  13 57500 10105334 A  ERRORERROR'
2016-04-22 02:48:25 [DEBUG   ] Got command RPT from MCS: ref #675834
2016-04-22 02:48:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 02:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675834  77 57500 10105526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 02:48:25 [DEBUG   ] Got command RPT from MCS: ref #675835
2016-04-22 02:48:25 [DEBUG   ] summary = ERROR
2016-04-22 02:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675835  13 57500 10105730 A  ERRORERROR'
2016-04-22 02:48:25 [DEBUG   ] Got command RPT from MCS: ref #675836
2016-04-22 02:48:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 02:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675836  77 57500 10105934 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 02:48:26 [DEBUG   ] Got command RPT from MCS: ref #675837
2016-04-22 02:48:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 02:48:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675837  12 57500 10106138 A  ERRORB”™š'
2016-04-22 02:48:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 02:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:48:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 02:48:54 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 02:48:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:48:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:48:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:48:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:48:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:48:55 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2016-04-22 02:48:55 [DEBUG   ] Finished updating board flags in 2.014 seconds
2016-04-22 02:49:15 [DEBUG   ] Finished updating ant stats in 0.753 seconds
2016-04-22 02:49:29 [DEBUG   ] Got command RPT from MCS: ref #675843
2016-04-22 02:49:29 [DEBUG   ] summary = ERROR
2016-04-22 02:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675843  13 57500 10169806 A  ERRORERROR'
2016-04-22 02:49:29 [DEBUG   ] Got command RPT from MCS: ref #675844
2016-04-22 02:49:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 02:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675844  77 57500 10169806 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 02:49:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 02:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:49:55 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2016-04-22 02:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2016-04-22 02:49:55 [CRITICAL] MGT underflow detected on beam(s) 1
2016-04-22 02:49:55 [DEBUG   ] Finished updating board flags in 1.962 seconds
2016-04-22 02:50:15 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2016-04-22 02:50:36 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2016-04-22 02:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:50:55 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 02:50:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 02:50:55 [DEBUG   ] Finished updating board flags in 1.849 seconds
2016-04-22 02:50:56 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 02:51:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 02:51:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 02:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:51:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 02:51:55 [DEBUG   ] Finished updating board flags in 1.759 seconds
2016-04-22 02:51:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 02:52:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 02:52:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 02:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:52:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2016-04-22 02:52:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 02:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:52:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 02:52:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 02:52:55 [DEBUG   ] Finished updating board flags in 1.622 seconds
2016-04-22 02:52:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-22 02:53:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 02:53:25 [DEBUG   ] Got command RPT from MCS: ref #675866
2016-04-22 02:53:25 [DEBUG   ] summary = ERROR
2016-04-22 02:53:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675866  13 57500 10405422 A  ERRORERROR'
2016-04-22 02:53:25 [DEBUG   ] Got command RPT from MCS: ref #675867
2016-04-22 02:53:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 02:53:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675867  77 57500 10405614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 02:53:25 [DEBUG   ] Got command RPT from MCS: ref #675868
2016-04-22 02:53:25 [DEBUG   ] summary = ERROR
2016-04-22 02:53:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675868  13 57500 10405818 A  ERRORERROR'
2016-04-22 02:53:26 [DEBUG   ] Got command RPT from MCS: ref #675869
2016-04-22 02:53:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 02:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675869  77 57500 10406022 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 02:53:26 [DEBUG   ] Got command RPT from MCS: ref #675870
2016-04-22 02:53:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 02:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675870  12 57500 10406226 A  ERRORB”™š'
2016-04-22 02:53:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 02:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:53:55 [DEBUG   ] Finished updating board flags in 1.569 seconds
2016-04-22 02:53:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 02:54:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 02:54:29 [DEBUG   ] Got command RPT from MCS: ref #675871
2016-04-22 02:54:29 [DEBUG   ] summary = ERROR
2016-04-22 02:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675871  13 57500 10469806 A  ERRORERROR'
2016-04-22 02:54:29 [DEBUG   ] Got command RPT from MCS: ref #675872
2016-04-22 02:54:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 02:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675872  77 57500 10469806 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 02:54:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 02:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:54:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 02:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:54:55 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 02:54:55 [DEBUG   ] Finished updating board flags in 1.429 seconds
2016-04-22 02:54:56 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-22 02:55:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 02:55:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 02:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:55:56 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 02:55:56 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2016-04-22 02:55:56 [DEBUG   ] Finished updating board flags in 2.257 seconds
2016-04-22 02:56:16 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2016-04-22 02:56:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 02:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:56:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 02:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:56:56 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2016-04-22 02:56:56 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 02:56:56 [DEBUG   ] Finished updating board flags in 2.223 seconds
2016-04-22 02:57:16 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2016-04-22 02:57:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 02:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:57:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2016-04-22 02:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:57:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2016-04-22 02:57:56 [DEBUG   ] Finished updating board flags in 2.166 seconds
2016-04-22 02:57:57 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2016-04-22 02:58:17 [DEBUG   ] Finished updating ant stats in 1.211 seconds
2016-04-22 02:58:25 [DEBUG   ] Got command RPT from MCS: ref #675892
2016-04-22 02:58:25 [DEBUG   ] summary = ERROR
2016-04-22 02:58:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675892  13 57500 10705510 A  ERRORERROR'
2016-04-22 02:58:25 [DEBUG   ] Got command RPT from MCS: ref #675893
2016-04-22 02:58:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 02:58:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675893  77 57500 10705714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 02:58:25 [DEBUG   ] Got command RPT from MCS: ref #675894
2016-04-22 02:58:25 [DEBUG   ] summary = ERROR
2016-04-22 02:58:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675894  13 57500 10705906 A  ERRORERROR'
2016-04-22 02:58:26 [DEBUG   ] Got command RPT from MCS: ref #675895
2016-04-22 02:58:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 02:58:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675895  77 57500 10706110 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 02:58:26 [DEBUG   ] Got command RPT from MCS: ref #675896
2016-04-22 02:58:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 02:58:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675896  12 57500 10706314 A  ERRORB•™š'
2016-04-22 02:58:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 02:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:58:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 02:58:56 [DEBUG   ] Finished updating board flags in 2.016 seconds
2016-04-22 02:58:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 02:59:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 02:59:29 [DEBUG   ] Got command RPT from MCS: ref #675905
2016-04-22 02:59:29 [DEBUG   ] summary = ERROR
2016-04-22 02:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675905  13 57500 10769810 A  ERRORERROR'
2016-04-22 02:59:29 [DEBUG   ] Got command RPT from MCS: ref #675906
2016-04-22 02:59:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 02:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675906  77 57500 10769810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 02:59:37 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-22 02:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 02:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 02:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 02:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 02:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 02:59:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 02:59:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 02:59:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 02:59:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 02:59:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 02:59:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 02:59:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 02:59:56 [DEBUG   ] Finished updating board flags in 2.036 seconds
2016-04-22 02:59:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 03:00:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 03:00:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 03:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:00:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:00:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:00:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:00:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:00:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:00:56 [DEBUG   ] Finished updating board flags in 1.961 seconds
2016-04-22 03:00:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 03:01:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 03:01:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 03:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:01:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 03:01:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:01:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:01:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:01:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:01:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:01:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:01:56 [DEBUG   ] Finished updating board flags in 1.831 seconds
2016-04-22 03:01:57 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-22 03:02:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 03:02:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 03:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:02:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:02:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:02:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:02:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:02:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:02:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:02:56 [DEBUG   ] Finished updating board flags in 1.725 seconds
2016-04-22 03:02:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 03:03:17 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2016-04-22 03:03:25 [DEBUG   ] Got command RPT from MCS: ref #675925
2016-04-22 03:03:25 [DEBUG   ] summary = ERROR
2016-04-22 03:03:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675925  13 57500 11005594 A  ERRORERROR'
2016-04-22 03:03:25 [DEBUG   ] Got command RPT from MCS: ref #675926
2016-04-22 03:03:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:03:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675926  77 57500 11005798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:03:26 [DEBUG   ] Got command RPT from MCS: ref #675927
2016-04-22 03:03:26 [DEBUG   ] summary = ERROR
2016-04-22 03:03:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675927  13 57500 11006002 A  ERRORERROR'
2016-04-22 03:03:26 [DEBUG   ] Got command RPT from MCS: ref #675928
2016-04-22 03:03:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:03:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675928  77 57500 11006206 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:03:26 [DEBUG   ] Got command RPT from MCS: ref #675929
2016-04-22 03:03:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 03:03:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675929  12 57500 11006398 A  ERRORB–™š'
2016-04-22 03:03:38 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2016-04-22 03:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:03:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:03:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:03:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:03:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:03:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:03:56 [DEBUG   ] Finished updating board flags in 1.602 seconds
2016-04-22 03:03:58 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-22 03:04:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 03:04:29 [DEBUG   ] Got command RPT from MCS: ref #675930
2016-04-22 03:04:29 [DEBUG   ] summary = ERROR
2016-04-22 03:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675930  13 57500 11069810 A  ERRORERROR'
2016-04-22 03:04:29 [DEBUG   ] Got command RPT from MCS: ref #675931
2016-04-22 03:04:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675931  77 57500 11069810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:04:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:04:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2016-04-22 03:04:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:04:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:04:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:04:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:04:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:04:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2016-04-22 03:04:56 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:04:56 [DEBUG   ] Finished updating board flags in 1.610 seconds
2016-04-22 03:04:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 03:05:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:05:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 03:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:05:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:05:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:05:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:05:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:05:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:05:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:05:56 [DEBUG   ] Finished updating board flags in 1.617 seconds
2016-04-22 03:05:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 03:06:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 03:06:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 03:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:06:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2016-04-22 03:06:56 [DEBUG   ] Finished updating board flags in 1.644 seconds
2016-04-22 03:06:58 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 03:07:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:07:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 03:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:07:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:07:56 [DEBUG   ] Finished updating board flags in 1.555 seconds
2016-04-22 03:07:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-22 03:08:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 03:08:25 [DEBUG   ] Got command RPT from MCS: ref #675954
2016-04-22 03:08:25 [DEBUG   ] summary = ERROR
2016-04-22 03:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675954  13 57500 11305694 A  ERRORERROR'
2016-04-22 03:08:25 [DEBUG   ] Got command RPT from MCS: ref #675955
2016-04-22 03:08:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675955  77 57500 11305886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:08:26 [DEBUG   ] Got command RPT from MCS: ref #675956
2016-04-22 03:08:26 [DEBUG   ] summary = ERROR
2016-04-22 03:08:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675956  13 57500 11306090 A  ERRORERROR'
2016-04-22 03:08:26 [DEBUG   ] Got command RPT from MCS: ref #675957
2016-04-22 03:08:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:08:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675957  77 57500 11306294 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:08:26 [DEBUG   ] Got command RPT from MCS: ref #675958
2016-04-22 03:08:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 03:08:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675958  12 57500 11306498 A  ERRORB”™š'
2016-04-22 03:08:38 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2016-04-22 03:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:08:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 03:08:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:08:56 [DEBUG   ] Finished updating board flags in 1.484 seconds
2016-04-22 03:08:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 03:09:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 03:09:29 [DEBUG   ] Got command RPT from MCS: ref #675964
2016-04-22 03:09:29 [DEBUG   ] summary = ERROR
2016-04-22 03:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675964  13 57500 11369810 A  ERRORERROR'
2016-04-22 03:09:29 [DEBUG   ] Got command RPT from MCS: ref #675965
2016-04-22 03:09:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675965  77 57500 11369810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:09:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 03:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:09:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 03:09:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 03:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:09:56 [DEBUG   ] Finished updating board flags in 1.505 seconds
2016-04-22 03:09:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 03:10:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 03:10:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 03:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:10:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 03:10:58 [DEBUG   ] Finished updating board flags in 2.954 seconds
2016-04-22 03:11:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-22 03:11:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 03:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:11:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 03:11:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:11:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:11:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:11:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:11:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:11:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 03:11:57 [DEBUG   ] Finished updating board flags in 2.039 seconds
2016-04-22 03:11:58 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-22 03:12:18 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 03:12:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 03:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:12:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:12:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:12:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:12:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:12:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:12:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2016-04-22 03:12:57 [DEBUG   ] Finished updating board flags in 2.021 seconds
2016-04-22 03:12:59 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 03:13:19 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-22 03:13:25 [DEBUG   ] Got command RPT from MCS: ref #675984
2016-04-22 03:13:25 [DEBUG   ] summary = ERROR
2016-04-22 03:13:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675984  13 57500 11605782 A  ERRORERROR'
2016-04-22 03:13:25 [DEBUG   ] Got command RPT from MCS: ref #675985
2016-04-22 03:13:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:13:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675985  77 57500 11605974 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:13:26 [DEBUG   ] Got command RPT from MCS: ref #675986
2016-04-22 03:13:26 [DEBUG   ] summary = ERROR
2016-04-22 03:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675986  13 57500 11606178 A  ERRORERROR'
2016-04-22 03:13:26 [DEBUG   ] Got command RPT from MCS: ref #675987
2016-04-22 03:13:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675987  77 57500 11606382 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:13:26 [DEBUG   ] Got command RPT from MCS: ref #675988
2016-04-22 03:13:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 03:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675988  12 57500 11606586 A  ERRORB”™š'
2016-04-22 03:13:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:13:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2016-04-22 03:13:57 [DEBUG   ] Finished updating board flags in 1.981 seconds
2016-04-22 03:13:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 03:14:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:14:29 [DEBUG   ] Got command RPT from MCS: ref #675992
2016-04-22 03:14:29 [DEBUG   ] summary = ERROR
2016-04-22 03:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675992  13 57500 11669818 A  ERRORERROR'
2016-04-22 03:14:29 [DEBUG   ] Got command RPT from MCS: ref #675993
2016-04-22 03:14:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   675993  77 57500 11669818 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:14:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 03:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:14:57 [DEBUG   ] Finished updating board flags in 1.812 seconds
2016-04-22 03:14:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:15:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:15:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:15:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 03:15:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:15:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:15:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:15:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:15:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:15:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:15:57 [DEBUG   ] Finished updating board flags in 1.848 seconds
2016-04-22 03:15:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 03:16:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:16:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 03:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:16:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:16:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:16:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:16:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:16:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:16:57 [DEBUG   ] Finished updating board flags in 1.765 seconds
2016-04-22 03:16:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:17:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:17:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:17:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2016-04-22 03:17:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:17:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:17:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:17:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:17:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:17:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 03:17:57 [DEBUG   ] Finished updating board flags in 1.653 seconds
2016-04-22 03:17:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 03:18:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:18:25 [DEBUG   ] Got command RPT from MCS: ref #676013
2016-04-22 03:18:25 [DEBUG   ] summary = ERROR
2016-04-22 03:18:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676013  13 57500 11905850 A  ERRORERROR'
2016-04-22 03:18:26 [DEBUG   ] Got command RPT from MCS: ref #676014
2016-04-22 03:18:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676014  77 57500 11906054 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:18:26 [DEBUG   ] Got command RPT from MCS: ref #676015
2016-04-22 03:18:26 [DEBUG   ] summary = ERROR
2016-04-22 03:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676015  13 57500 11906263 A  ERRORERROR'
2016-04-22 03:18:26 [DEBUG   ] Got command RPT from MCS: ref #676016
2016-04-22 03:18:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676016  77 57500 11906454 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:18:26 [DEBUG   ] Got command RPT from MCS: ref #676017
2016-04-22 03:18:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 03:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676017  12 57500 11906658 A  ERRORB”™š'
2016-04-22 03:18:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:18:57 [DEBUG   ] Finished updating board flags in 1.554 seconds
2016-04-22 03:18:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:19:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 03:19:29 [DEBUG   ] Got command RPT from MCS: ref #676023
2016-04-22 03:19:29 [DEBUG   ] summary = ERROR
2016-04-22 03:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676023  13 57500 11969818 A  ERRORERROR'
2016-04-22 03:19:29 [DEBUG   ] Got command RPT from MCS: ref #676024
2016-04-22 03:19:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676024  77 57500 11969818 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:19:39 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-22 03:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:19:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 03:19:57 [DEBUG   ] Finished updating board flags in 1.549 seconds
2016-04-22 03:19:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 03:20:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 03:20:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 03:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:20:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:20:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:20:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:20:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:20:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:20:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:20:58 [DEBUG   ] Finished updating board flags in 2.194 seconds
2016-04-22 03:20:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 03:21:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 03:21:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 03:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:21:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 03:21:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2016-04-22 03:21:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2016-04-22 03:21:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:21:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:21:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:21:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:21:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:21:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 03:21:58 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:21:58 [DEBUG   ] Finished updating board flags in 2.013 seconds
2016-04-22 03:21:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 03:22:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 03:22:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 03:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:22:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:22:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:22:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:22:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:22:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:22:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 03:22:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 03:22:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:22:59 [DEBUG   ] Finished updating board flags in 2.751 seconds
2016-04-22 03:23:19 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 03:23:25 [DEBUG   ] Got command RPT from MCS: ref #676046
2016-04-22 03:23:25 [DEBUG   ] summary = ERROR
2016-04-22 03:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676046  13 57500 12205954 A  ERRORERROR'
2016-04-22 03:23:26 [DEBUG   ] Got command RPT from MCS: ref #676047
2016-04-22 03:23:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676047  77 57500 12206146 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:23:26 [DEBUG   ] Got command RPT from MCS: ref #676048
2016-04-22 03:23:26 [DEBUG   ] summary = ERROR
2016-04-22 03:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676048  13 57500 12206350 A  ERRORERROR'
2016-04-22 03:23:26 [DEBUG   ] Got command RPT from MCS: ref #676049
2016-04-22 03:23:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676049  77 57500 12206554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:23:26 [DEBUG   ] Got command RPT from MCS: ref #676050
2016-04-22 03:23:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 03:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676050  12 57500 12206746 A  ERRORB•™š'
2016-04-22 03:23:39 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-22 03:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:23:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:23:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:23:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:23:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:23:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:23:58 [DEBUG   ] Finished updating board flags in 1.775 seconds
2016-04-22 03:23:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 03:24:20 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2016-04-22 03:24:29 [DEBUG   ] Got command RPT from MCS: ref #676051
2016-04-22 03:24:29 [DEBUG   ] summary = ERROR
2016-04-22 03:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676051  13 57500 12269822 A  ERRORERROR'
2016-04-22 03:24:29 [DEBUG   ] Got command RPT from MCS: ref #676052
2016-04-22 03:24:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676052  77 57500 12269822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:24:40 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-22 03:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:24:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2016-04-22 03:24:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:24:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:24:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:24:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:24:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:24:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:24:58 [DEBUG   ] Finished updating board flags in 1.613 seconds
2016-04-22 03:25:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:25:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:25:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 03:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:25:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 03:25:58 [DEBUG   ] Finished updating board flags in 1.592 seconds
2016-04-22 03:26:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 03:26:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:26:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:26:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 03:26:58 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:26:58 [DEBUG   ] Finished updating board flags in 1.414 seconds
2016-04-22 03:27:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:27:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 03:27:40 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-22 03:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:27:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 03:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:27:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:27:58 [DEBUG   ] Finished updating board flags in 1.397 seconds
2016-04-22 03:28:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 03:28:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 03:28:26 [DEBUG   ] Got command RPT from MCS: ref #676072
2016-04-22 03:28:26 [DEBUG   ] summary = ERROR
2016-04-22 03:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676072  13 57500 12506034 A  ERRORERROR'
2016-04-22 03:28:26 [DEBUG   ] Got command RPT from MCS: ref #676073
2016-04-22 03:28:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676073  77 57500 12506238 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:28:26 [DEBUG   ] Got command RPT from MCS: ref #676074
2016-04-22 03:28:26 [DEBUG   ] summary = ERROR
2016-04-22 03:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676074  13 57500 12506430 A  ERRORERROR'
2016-04-22 03:28:26 [DEBUG   ] Got command RPT from MCS: ref #676075
2016-04-22 03:28:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676075  77 57500 12506634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:28:26 [DEBUG   ] Got command RPT from MCS: ref #676076
2016-04-22 03:28:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 03:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676076  12 57500 12506838 A  ERRORB•™š'
2016-04-22 03:28:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 03:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:28:59 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:28:59 [DEBUG   ] Finished updating board flags in 2.230 seconds
2016-04-22 03:29:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 03:29:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 03:29:29 [DEBUG   ] Got command RPT from MCS: ref #676085
2016-04-22 03:29:29 [DEBUG   ] summary = ERROR
2016-04-22 03:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676085  13 57500 12569818 A  ERRORERROR'
2016-04-22 03:29:29 [DEBUG   ] Got command RPT from MCS: ref #676086
2016-04-22 03:29:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676086  77 57500 12569818 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:29:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 03:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:29:59 [DEBUG   ] Finished updating board flags in 2.267 seconds
2016-04-22 03:30:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 03:30:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 03:30:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 03:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:30:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 03:30:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2016-04-22 03:30:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:30:59 [DEBUG   ] Finished updating board flags in 2.168 seconds
2016-04-22 03:31:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 03:31:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 03:31:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 03:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:31:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 03:31:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:31:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:31:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:31:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:31:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:31:59 [DEBUG   ] Finished updating board flags in 2.025 seconds
2016-04-22 03:32:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 03:32:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 03:32:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 03:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:32:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 03:32:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:32:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:32:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:32:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:32:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:32:59 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:32:59 [DEBUG   ] Finished updating board flags in 1.947 seconds
2016-04-22 03:33:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 03:33:20 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-22 03:33:26 [DEBUG   ] Got command RPT from MCS: ref #676105
2016-04-22 03:33:26 [DEBUG   ] summary = ERROR
2016-04-22 03:33:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676105  13 57500 12806106 A  ERRORERROR'
2016-04-22 03:33:26 [DEBUG   ] Got command RPT from MCS: ref #676106
2016-04-22 03:33:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:33:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676106  77 57500 12806310 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:33:26 [DEBUG   ] Got command RPT from MCS: ref #676107
2016-04-22 03:33:26 [DEBUG   ] summary = ERROR
2016-04-22 03:33:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676107  13 57500 12806514 A  ERRORERROR'
2016-04-22 03:33:26 [DEBUG   ] Got command RPT from MCS: ref #676108
2016-04-22 03:33:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:33:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676108  77 57500 12806718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:33:26 [DEBUG   ] Got command RPT from MCS: ref #676109
2016-04-22 03:33:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 03:33:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676109  12 57500 12806910 A  ERRORB•™š'
2016-04-22 03:33:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 03:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:33:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:33:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:33:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:33:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:33:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:33:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:33:59 [DEBUG   ] Finished updating board flags in 1.835 seconds
2016-04-22 03:34:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 03:34:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 03:34:29 [DEBUG   ] Got command RPT from MCS: ref #676110
2016-04-22 03:34:29 [DEBUG   ] summary = ERROR
2016-04-22 03:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676110  13 57500 12869822 A  ERRORERROR'
2016-04-22 03:34:29 [DEBUG   ] Got command RPT from MCS: ref #676111
2016-04-22 03:34:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676111  77 57500 12869822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:34:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 03:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:34:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:34:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:34:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:34:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:34:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:34:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 03:34:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:34:59 [DEBUG   ] Finished updating board flags in 1.784 seconds
2016-04-22 03:35:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 03:35:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 03:35:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 03:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:35:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 03:35:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:35:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:35:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:35:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:35:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:35:59 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:35:59 [DEBUG   ] Finished updating board flags in 1.631 seconds
2016-04-22 03:36:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 03:36:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 03:36:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 03:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:36:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 03:36:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:36:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:36:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:36:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:36:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:36:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 03:36:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:36:59 [DEBUG   ] Finished updating board flags in 1.656 seconds
2016-04-22 03:37:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 03:37:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 03:37:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 03:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:37:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 03:37:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:37:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:37:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:37:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:37:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:37:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 03:38:00 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2016-04-22 03:38:00 [DEBUG   ] Finished updating board flags in 2.249 seconds
2016-04-22 03:38:20 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-22 03:38:26 [DEBUG   ] Got command RPT from MCS: ref #676134
2016-04-22 03:38:26 [DEBUG   ] summary = ERROR
2016-04-22 03:38:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676134  13 57500 13106206 A  ERRORERROR'
2016-04-22 03:38:26 [DEBUG   ] Got command RPT from MCS: ref #676135
2016-04-22 03:38:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:38:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676135  77 57500 13106410 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:38:26 [DEBUG   ] Got command RPT from MCS: ref #676136
2016-04-22 03:38:26 [DEBUG   ] summary = ERROR
2016-04-22 03:38:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676136  13 57500 13106614 A  ERRORERROR'
2016-04-22 03:38:26 [DEBUG   ] Got command RPT from MCS: ref #676137
2016-04-22 03:38:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:38:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676137  77 57500 13106818 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:38:27 [DEBUG   ] Got command RPT from MCS: ref #676138
2016-04-22 03:38:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 03:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676138  12 57500 13107010 A  ERRORB•™š'
2016-04-22 03:38:41 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2016-04-22 03:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:38:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:38:59 [DEBUG   ] Finished updating board flags in 1.487 seconds
2016-04-22 03:39:01 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-22 03:39:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:39:29 [DEBUG   ] Got command RPT from MCS: ref #676144
2016-04-22 03:39:29 [DEBUG   ] summary = ERROR
2016-04-22 03:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676144  13 57500 13169818 A  ERRORERROR'
2016-04-22 03:39:29 [DEBUG   ] Got command RPT from MCS: ref #676145
2016-04-22 03:39:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676145  77 57500 13169819 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:39:41 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-22 03:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:39:59 [DEBUG   ] Finished updating board flags in 1.489 seconds
2016-04-22 03:40:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 03:40:21 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2016-04-22 03:40:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 03:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:40:59 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 03:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:40:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 03:40:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2016-04-22 03:40:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:40:59 [DEBUG   ] Finished updating board flags in 1.495 seconds
2016-04-22 03:41:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-22 03:41:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 03:41:41 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2016-04-22 03:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:41:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2016-04-22 03:42:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:42:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:42:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:42:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:42:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:42:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 03:42:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:42:00 [DEBUG   ] Finished updating board flags in 2.189 seconds
2016-04-22 03:42:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-22 03:42:22 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2016-04-22 03:42:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 03:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:43:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:43:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:43:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:43:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:43:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:43:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-22 03:43:00 [DEBUG   ] Finished updating board flags in 2.010 seconds
2016-04-22 03:43:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:43:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:43:26 [DEBUG   ] Got command RPT from MCS: ref #676164
2016-04-22 03:43:26 [DEBUG   ] summary = ERROR
2016-04-22 03:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676164  13 57500 13406298 A  ERRORERROR'
2016-04-22 03:43:26 [DEBUG   ] Got command RPT from MCS: ref #676165
2016-04-22 03:43:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676165  77 57500 13406706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:43:27 [DEBUG   ] Got command RPT from MCS: ref #676166
2016-04-22 03:43:27 [DEBUG   ] summary = ERROR
2016-04-22 03:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676166  13 57500 13407102 A  ERRORERROR'
2016-04-22 03:43:27 [DEBUG   ] Got command RPT from MCS: ref #676167
2016-04-22 03:43:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676167  77 57500 13407306 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:43:27 [DEBUG   ] Got command RPT from MCS: ref #676168
2016-04-22 03:43:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 03:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676168  12 57500 13407498 A  ERRORB”™š'
2016-04-22 03:43:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 03:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:43:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 03:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:44:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2016-04-22 03:44:00 [DEBUG   ] Finished updating board flags in 1.965 seconds
2016-04-22 03:44:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:44:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:44:29 [DEBUG   ] Got command RPT from MCS: ref #676172
2016-04-22 03:44:29 [DEBUG   ] summary = ERROR
2016-04-22 03:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676172  13 57500 13469822 A  ERRORERROR'
2016-04-22 03:44:29 [DEBUG   ] Got command RPT from MCS: ref #676173
2016-04-22 03:44:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676173  77 57500 13469822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:44:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 03:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:45:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:45:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:45:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:45:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:45:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:45:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:45:00 [DEBUG   ] Finished updating board flags in 1.817 seconds
2016-04-22 03:45:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 03:45:22 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2016-04-22 03:45:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 03:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:46:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:46:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:46:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:46:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:46:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:46:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 03:46:00 [DEBUG   ] Finished updating board flags in 1.783 seconds
2016-04-22 03:46:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 03:46:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-22 03:46:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 03:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:47:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:47:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:47:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:47:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:47:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:47:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:47:00 [DEBUG   ] Finished updating board flags in 1.618 seconds
2016-04-22 03:47:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 03:47:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 03:47:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 03:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:47:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 03:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:48:00 [DEBUG   ] Finished updating board flags in 1.674 seconds
2016-04-22 03:48:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 03:48:22 [DEBUG   ] Finished updating ant stats in 0.607 seconds
2016-04-22 03:48:26 [DEBUG   ] Got command RPT from MCS: ref #676193
2016-04-22 03:48:26 [DEBUG   ] summary = ERROR
2016-04-22 03:48:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676193  13 57500 13706390 A  ERRORERROR'
2016-04-22 03:48:26 [DEBUG   ] Got command RPT from MCS: ref #676194
2016-04-22 03:48:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:48:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676194  77 57500 13706594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:48:26 [DEBUG   ] Got command RPT from MCS: ref #676195
2016-04-22 03:48:26 [DEBUG   ] summary = ERROR
2016-04-22 03:48:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676195  13 57500 13706798 A  ERRORERROR'
2016-04-22 03:48:27 [DEBUG   ] Got command RPT from MCS: ref #676196
2016-04-22 03:48:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676196  77 57500 13707002 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:48:27 [DEBUG   ] Got command RPT from MCS: ref #676197
2016-04-22 03:48:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 03:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676197  12 57500 13707194 A  ERRORB•™š'
2016-04-22 03:48:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 03:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:49:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 03:49:00 [DEBUG   ] Finished updating board flags in 1.511 seconds
2016-04-22 03:49:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 03:49:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 03:49:29 [DEBUG   ] Got command RPT from MCS: ref #676203
2016-04-22 03:49:29 [DEBUG   ] summary = ERROR
2016-04-22 03:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676203  13 57500 13769822 A  ERRORERROR'
2016-04-22 03:49:29 [DEBUG   ] Got command RPT from MCS: ref #676204
2016-04-22 03:49:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676204  77 57500 13769822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:49:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 03:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:50:00 [DEBUG   ] Finished updating board flags in 1.487 seconds
2016-04-22 03:50:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 03:50:22 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-22 03:50:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 03:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 03:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 03:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 03:51:00 [DEBUG   ] Finished updating board flags in 1.496 seconds
2016-04-22 03:51:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 03:51:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 03:51:43 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2016-04-22 03:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2016-04-22 03:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:52:00 [DEBUG   ] Finished updating board flags in 1.504 seconds
2016-04-22 03:52:03 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-22 03:52:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 03:52:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 03:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:53:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 03:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:53:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 03:53:01 [DEBUG   ] Finished updating board flags in 2.164 seconds
2016-04-22 03:53:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:53:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:53:26 [DEBUG   ] Got command RPT from MCS: ref #676226
2016-04-22 03:53:26 [DEBUG   ] summary = ERROR
2016-04-22 03:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676226  13 57500 14006486 A  ERRORERROR'
2016-04-22 03:53:26 [DEBUG   ] Got command RPT from MCS: ref #676227
2016-04-22 03:53:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676227  77 57500 14006690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:53:26 [DEBUG   ] Got command RPT from MCS: ref #676228
2016-04-22 03:53:26 [DEBUG   ] summary = ERROR
2016-04-22 03:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676228  13 57500 14006894 A  ERRORERROR'
2016-04-22 03:53:27 [DEBUG   ] Got command RPT from MCS: ref #676229
2016-04-22 03:53:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676229  77 57500 14007098 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:53:27 [DEBUG   ] Got command RPT from MCS: ref #676230
2016-04-22 03:53:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 03:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676230  12 57500 14007290 A  ERRORB”™š'
2016-04-22 03:53:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 03:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:54:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 03:54:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 03:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:54:01 [DEBUG   ] Finished updating board flags in 1.960 seconds
2016-04-22 03:54:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:54:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 03:54:29 [DEBUG   ] Got command RPT from MCS: ref #676231
2016-04-22 03:54:29 [DEBUG   ] summary = ERROR
2016-04-22 03:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676231  13 57500 14069826 A  ERRORERROR'
2016-04-22 03:54:29 [DEBUG   ] Got command RPT from MCS: ref #676232
2016-04-22 03:54:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676232  77 57500 14069826 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:54:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 03:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:55:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 03:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:55:01 [DEBUG   ] Finished updating board flags in 1.838 seconds
2016-04-22 03:55:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-22 03:55:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 03:55:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 03:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:56:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2016-04-22 03:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:56:01 [DEBUG   ] Finished updating board flags in 1.779 seconds
2016-04-22 03:56:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 03:56:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 03:56:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 03:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:57:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:57:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:57:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:57:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:57:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:57:01 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 03:57:01 [DEBUG   ] Finished updating board flags in 1.627 seconds
2016-04-22 03:57:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 03:57:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 03:57:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 03:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:58:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2016-04-22 03:58:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:58:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:58:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:58:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:58:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:58:01 [DEBUG   ] Finished updating board flags in 1.615 seconds
2016-04-22 03:58:03 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2016-04-22 03:58:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 03:58:26 [DEBUG   ] Got command RPT from MCS: ref #676252
2016-04-22 03:58:26 [DEBUG   ] summary = ERROR
2016-04-22 03:58:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676252  13 57500 14306570 A  ERRORERROR'
2016-04-22 03:58:26 [DEBUG   ] Got command RPT from MCS: ref #676253
2016-04-22 03:58:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:58:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676253  77 57500 14306774 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:58:26 [DEBUG   ] Got command RPT from MCS: ref #676254
2016-04-22 03:58:26 [DEBUG   ] summary = ERROR
2016-04-22 03:58:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676254  13 57500 14306978 A  ERRORERROR'
2016-04-22 03:58:27 [DEBUG   ] Got command RPT from MCS: ref #676255
2016-04-22 03:58:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:58:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676255  77 57500 14307170 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:58:27 [DEBUG   ] Got command RPT from MCS: ref #676256
2016-04-22 03:58:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 03:58:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676256  12 57500 14307374 A  ERRORB”™š'
2016-04-22 03:58:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 03:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 03:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 03:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 03:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 03:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 03:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 03:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 03:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 03:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 03:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 03:59:01 [DEBUG   ] Finished updating board flags in 1.550 seconds
2016-04-22 03:59:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 03:59:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 03:59:29 [DEBUG   ] Got command RPT from MCS: ref #676265
2016-04-22 03:59:29 [DEBUG   ] summary = ERROR
2016-04-22 03:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676265  13 57500 14369822 A  ERRORERROR'
2016-04-22 03:59:29 [DEBUG   ] Got command RPT from MCS: ref #676266
2016-04-22 03:59:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 03:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676266  77 57500 14369822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 03:59:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 04:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:00:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 04:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:00:01 [DEBUG   ] Finished updating board flags in 1.503 seconds
2016-04-22 04:00:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 04:00:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 04:00:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 04:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:01:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:01:01 [DEBUG   ] Finished updating board flags in 1.528 seconds
2016-04-22 04:01:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 04:01:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 04:01:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 04:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:02:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 04:02:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 04:02:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:02:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:02:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:02:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:02:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:02:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:02:02 [DEBUG   ] Finished updating board flags in 2.253 seconds
2016-04-22 04:02:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 04:02:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 04:02:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 04:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:03:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:03:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:03:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:03:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:03:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:03:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2016-04-22 04:03:02 [DEBUG   ] Finished updating board flags in 2.147 seconds
2016-04-22 04:03:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 04:03:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 04:03:26 [DEBUG   ] Got command RPT from MCS: ref #676285
2016-04-22 04:03:26 [DEBUG   ] summary = ERROR
2016-04-22 04:03:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676285  13 57500 14606682 A  ERRORERROR'
2016-04-22 04:03:26 [DEBUG   ] Got command RPT from MCS: ref #676286
2016-04-22 04:03:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:03:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676286  77 57500 14606874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:03:27 [DEBUG   ] Got command RPT from MCS: ref #676287
2016-04-22 04:03:27 [DEBUG   ] summary = ERROR
2016-04-22 04:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676287  13 57500 14607078 A  ERRORERROR'
2016-04-22 04:03:27 [DEBUG   ] Got command RPT from MCS: ref #676288
2016-04-22 04:03:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676288  77 57500 14607282 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:03:27 [DEBUG   ] Got command RPT from MCS: ref #676289
2016-04-22 04:03:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 04:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676289  12 57500 14607486 A  ERRORB•™š'
2016-04-22 04:03:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 04:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:04:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:04:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:04:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:04:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:04:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:04:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 04:04:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:04:02 [DEBUG   ] Finished updating board flags in 2.034 seconds
2016-04-22 04:04:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 04:04:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 04:04:29 [DEBUG   ] Got command RPT from MCS: ref #676290
2016-04-22 04:04:29 [DEBUG   ] summary = ERROR
2016-04-22 04:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676290  13 57500 14669834 A  ERRORERROR'
2016-04-22 04:04:29 [DEBUG   ] Got command RPT from MCS: ref #676291
2016-04-22 04:04:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676291  77 57500 14669834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:04:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 04:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:05:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:05:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:05:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:05:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:05:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:05:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:05:02 [DEBUG   ] Finished updating board flags in 1.961 seconds
2016-04-22 04:05:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 04:05:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 04:05:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 04:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:06:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:06:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:06:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:06:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:06:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-22 04:06:02 [DEBUG   ] Finished updating board flags in 1.823 seconds
2016-04-22 04:06:03 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 04:06:24 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2016-04-22 04:06:44 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-22 04:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:07:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 04:07:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:07:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:07:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:07:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:07:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:07:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 04:07:02 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:07:02 [DEBUG   ] Finished updating board flags in 1.809 seconds
2016-04-22 04:07:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 04:07:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 04:07:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 04:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:08:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:08:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:08:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:08:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:08:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:08:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:08:02 [DEBUG   ] Finished updating board flags in 1.828 seconds
2016-04-22 04:08:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 04:08:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 04:08:26 [DEBUG   ] Got command RPT from MCS: ref #676314
2016-04-22 04:08:26 [DEBUG   ] summary = ERROR
2016-04-22 04:08:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676314  13 57500 14906770 A  ERRORERROR'
2016-04-22 04:08:26 [DEBUG   ] Got command RPT from MCS: ref #676315
2016-04-22 04:08:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:08:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676315  77 57500 14906974 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:08:27 [DEBUG   ] Got command RPT from MCS: ref #676316
2016-04-22 04:08:27 [DEBUG   ] summary = ERROR
2016-04-22 04:08:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676316  13 57500 14907178 A  ERRORERROR'
2016-04-22 04:08:27 [DEBUG   ] Got command RPT from MCS: ref #676317
2016-04-22 04:08:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:08:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676317  77 57500 14907370 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:08:27 [DEBUG   ] Got command RPT from MCS: ref #676318
2016-04-22 04:08:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 04:08:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676318  12 57500 14907574 A  ERRORB”™š'
2016-04-22 04:08:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 04:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:09:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:09:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:09:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:09:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:09:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:09:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 04:09:02 [DEBUG   ] Finished updating board flags in 1.734 seconds
2016-04-22 04:09:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 04:09:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 04:09:29 [DEBUG   ] Got command RPT from MCS: ref #676324
2016-04-22 04:09:29 [DEBUG   ] summary = ERROR
2016-04-22 04:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676324  13 57500 14969830 A  ERRORERROR'
2016-04-22 04:09:29 [DEBUG   ] Got command RPT from MCS: ref #676325
2016-04-22 04:09:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676325  77 57500 14969830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:09:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 04:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:10:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 04:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:10:02 [DEBUG   ] Finished updating board flags in 1.622 seconds
2016-04-22 04:10:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 04:10:24 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-22 04:10:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 04:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:11:02 [DEBUG   ] Finished updating board flags in 1.612 seconds
2016-04-22 04:11:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-22 04:11:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 04:11:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 04:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:12:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:12:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:12:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:12:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:12:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:12:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 04:12:02 [DEBUG   ] Finished updating board flags in 1.569 seconds
2016-04-22 04:12:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 04:12:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 04:12:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 04:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:13:02 [DEBUG   ] Finished updating board flags in 1.421 seconds
2016-04-22 04:13:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 04:13:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 04:13:26 [DEBUG   ] Got command RPT from MCS: ref #676344
2016-04-22 04:13:26 [DEBUG   ] summary = ERROR
2016-04-22 04:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676344  13 57500 15206854 A  ERRORERROR'
2016-04-22 04:13:27 [DEBUG   ] Got command RPT from MCS: ref #676345
2016-04-22 04:13:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676345  77 57500 15207058 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:13:27 [DEBUG   ] Got command RPT from MCS: ref #676346
2016-04-22 04:13:27 [DEBUG   ] summary = ERROR
2016-04-22 04:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676346  13 57500 15207250 A  ERRORERROR'
2016-04-22 04:13:27 [DEBUG   ] Got command RPT from MCS: ref #676347
2016-04-22 04:13:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676347  77 57500 15207454 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:13:27 [DEBUG   ] Got command RPT from MCS: ref #676348
2016-04-22 04:13:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 04:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676348  12 57500 15207658 A  ERRORB”™š'
2016-04-22 04:13:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 04:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:14:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2016-04-22 04:14:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:14:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:14:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:14:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:14:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:14:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:14:02 [DEBUG   ] Finished updating board flags in 1.495 seconds
2016-04-22 04:14:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 04:14:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 04:14:29 [DEBUG   ] Got command RPT from MCS: ref #676352
2016-04-22 04:14:29 [DEBUG   ] summary = ERROR
2016-04-22 04:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676352  13 57500 15269834 A  ERRORERROR'
2016-04-22 04:14:29 [DEBUG   ] Got command RPT from MCS: ref #676353
2016-04-22 04:14:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676353  77 57500 15269834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:14:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 04:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:15:02 [DEBUG   ] Finished updating board flags in 1.558 seconds
2016-04-22 04:15:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 04:15:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 04:15:45 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2016-04-22 04:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:16:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:16:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:16:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:16:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:16:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:16:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2016-04-22 04:16:03 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:16:03 [DEBUG   ] Finished updating board flags in 2.236 seconds
2016-04-22 04:16:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 04:16:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 04:16:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 04:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:17:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 04:17:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:17:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:17:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:17:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:17:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:17:03 [DEBUG   ] Finished updating board flags in 2.101 seconds
2016-04-22 04:17:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 04:17:25 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-22 04:17:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 04:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:18:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 04:18:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:18:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:18:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:18:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:18:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:18:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:18:03 [DEBUG   ] Finished updating board flags in 2.013 seconds
2016-04-22 04:18:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 04:18:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 04:18:26 [DEBUG   ] Got command RPT from MCS: ref #676373
2016-04-22 04:18:26 [DEBUG   ] summary = ERROR
2016-04-22 04:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676373  13 57500 15506938 A  ERRORERROR'
2016-04-22 04:18:27 [DEBUG   ] Got command RPT from MCS: ref #676374
2016-04-22 04:18:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676374  77 57500 15507334 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:18:27 [DEBUG   ] Got command RPT from MCS: ref #676375
2016-04-22 04:18:27 [DEBUG   ] summary = ERROR
2016-04-22 04:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676375  13 57500 15507538 A  ERRORERROR'
2016-04-22 04:18:27 [DEBUG   ] Got command RPT from MCS: ref #676376
2016-04-22 04:18:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676376  77 57500 15507730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:18:27 [DEBUG   ] Got command RPT from MCS: ref #676377
2016-04-22 04:18:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 04:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676377  12 57500 15507934 A  ERRORB”™š'
2016-04-22 04:18:45 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2016-04-22 04:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:19:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2016-04-22 04:19:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:19:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:19:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:19:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:19:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:19:03 [DEBUG   ] Finished updating board flags in 1.986 seconds
2016-04-22 04:19:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:19:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:19:29 [DEBUG   ] Got command RPT from MCS: ref #676383
2016-04-22 04:19:29 [DEBUG   ] summary = ERROR
2016-04-22 04:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676383  13 57500 15569830 A  ERRORERROR'
2016-04-22 04:19:29 [DEBUG   ] Got command RPT from MCS: ref #676384
2016-04-22 04:19:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676384  77 57500 15569830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:19:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 04:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:20:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 04:20:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:20:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:20:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:20:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:20:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:20:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:20:03 [DEBUG   ] Finished updating board flags in 1.824 seconds
2016-04-22 04:20:05 [DEBUG   ] Finished updating ant stats in 0.792 seconds
2016-04-22 04:20:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 04:20:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 04:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:21:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 04:21:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:21:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:21:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:21:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:21:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:21:03 [DEBUG   ] Finished updating board flags in 1.783 seconds
2016-04-22 04:21:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 04:21:25 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-22 04:21:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 04:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:22:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:22:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:22:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:22:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:22:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:22:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 04:22:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:22:03 [DEBUG   ] Finished updating board flags in 1.604 seconds
2016-04-22 04:22:06 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 04:22:26 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 04:22:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 04:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:23:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:23:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:23:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:23:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:23:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:23:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:23:03 [DEBUG   ] Finished updating board flags in 1.598 seconds
2016-04-22 04:23:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 04:23:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-22 04:23:27 [DEBUG   ] Got command RPT from MCS: ref #676406
2016-04-22 04:23:27 [DEBUG   ] summary = ERROR
2016-04-22 04:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676406  13 57500 15807046 A  ERRORERROR'
2016-04-22 04:23:27 [DEBUG   ] Got command RPT from MCS: ref #676407
2016-04-22 04:23:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676407  77 57500 15807250 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:23:27 [DEBUG   ] Got command RPT from MCS: ref #676408
2016-04-22 04:23:27 [DEBUG   ] summary = ERROR
2016-04-22 04:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676408  13 57500 15807442 A  ERRORERROR'
2016-04-22 04:23:27 [DEBUG   ] Got command RPT from MCS: ref #676409
2016-04-22 04:23:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676409  77 57500 15807646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:23:27 [DEBUG   ] Got command RPT from MCS: ref #676410
2016-04-22 04:23:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 04:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676410  12 57500 15807850 A  ERRORB•™š'
2016-04-22 04:23:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 04:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:24:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2016-04-22 04:24:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:24:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:24:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:24:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:24:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:24:03 [DEBUG   ] Finished updating board flags in 1.413 seconds
2016-04-22 04:24:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 04:24:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 04:24:29 [DEBUG   ] Got command RPT from MCS: ref #676411
2016-04-22 04:24:29 [DEBUG   ] summary = ERROR
2016-04-22 04:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676411  13 57500 15869830 A  ERRORERROR'
2016-04-22 04:24:29 [DEBUG   ] Got command RPT from MCS: ref #676412
2016-04-22 04:24:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676412  77 57500 15869830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:24:46 [DEBUG   ] Finished updating ant stats in 0.983 seconds
2016-04-22 04:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:25:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 04:25:03 [DEBUG   ] Finished updating board flags in 1.407 seconds
2016-04-22 04:25:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 04:25:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:25:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 04:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 04:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:26:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2016-04-22 04:26:03 [CRITICAL] MGT underflow detected on beam(s) 1
2016-04-22 04:26:03 [DEBUG   ] Finished updating board flags in 1.388 seconds
2016-04-22 04:26:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 04:26:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 04:26:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:27:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 04:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:27:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 04:27:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:27:03 [DEBUG   ] Finished updating board flags in 1.377 seconds
2016-04-22 04:27:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 04:27:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:27:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 04:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:28:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 04:28:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:28:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:28:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:28:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:28:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:28:04 [DEBUG   ] Finished updating board flags in 2.048 seconds
2016-04-22 04:28:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:28:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 04:28:27 [DEBUG   ] Got command RPT from MCS: ref #676432
2016-04-22 04:28:27 [DEBUG   ] summary = ERROR
2016-04-22 04:28:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676432  13 57500 16107138 A  ERRORERROR'
2016-04-22 04:28:27 [DEBUG   ] Got command RPT from MCS: ref #676433
2016-04-22 04:28:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:28:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676433  77 57500 16107342 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:28:27 [DEBUG   ] Got command RPT from MCS: ref #676434
2016-04-22 04:28:27 [DEBUG   ] summary = ERROR
2016-04-22 04:28:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676434  13 57500 16107546 A  ERRORERROR'
2016-04-22 04:28:27 [DEBUG   ] Got command RPT from MCS: ref #676435
2016-04-22 04:28:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:28:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676435  77 57500 16107738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:28:27 [DEBUG   ] Got command RPT from MCS: ref #676436
2016-04-22 04:28:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 04:28:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676436  12 57500 16107942 A  ERRORB”™š'
2016-04-22 04:28:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:29:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:29:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:29:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:29:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:29:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:29:04 [DEBUG   ] Finished updating board flags in 2.075 seconds
2016-04-22 04:29:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 04:29:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:29:29 [DEBUG   ] Got command RPT from MCS: ref #676445
2016-04-22 04:29:29 [DEBUG   ] summary = ERROR
2016-04-22 04:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676445  13 57500 16169834 A  ERRORERROR'
2016-04-22 04:29:29 [DEBUG   ] Got command RPT from MCS: ref #676446
2016-04-22 04:29:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676446  77 57500 16169834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:29:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:30:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:30:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:30:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:30:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:30:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:30:04 [DEBUG   ] Finished updating board flags in 2.032 seconds
2016-04-22 04:30:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:30:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 04:30:46 [DEBUG   ] Finished updating ant stats in 0.546 seconds
2016-04-22 04:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:31:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:31:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:31:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:31:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:31:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:31:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:31:04 [DEBUG   ] Finished updating board flags in 1.882 seconds
2016-04-22 04:31:07 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 04:31:27 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-22 04:31:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 04:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 04:32:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:32:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:32:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:32:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:32:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:32:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:32:04 [DEBUG   ] Finished updating board flags in 1.815 seconds
2016-04-22 04:32:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 04:32:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 04:32:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 04:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:33:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-22 04:33:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2016-04-22 04:33:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:33:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:33:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:33:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:33:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:33:04 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:33:04 [DEBUG   ] Finished updating board flags in 1.824 seconds
2016-04-22 04:33:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 04:33:27 [DEBUG   ] Got command RPT from MCS: ref #676465
2016-04-22 04:33:27 [DEBUG   ] summary = ERROR
2016-04-22 04:33:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676465  13 57500 16407246 A  ERRORERROR'
2016-04-22 04:33:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-22 04:33:27 [DEBUG   ] Got command RPT from MCS: ref #676466
2016-04-22 04:33:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:33:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676466  77 57500 16407450 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:33:27 [DEBUG   ] Got command RPT from MCS: ref #676467
2016-04-22 04:33:27 [DEBUG   ] summary = ERROR
2016-04-22 04:33:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676467  13 57500 16407654 A  ERRORERROR'
2016-04-22 04:33:27 [DEBUG   ] Got command RPT from MCS: ref #676468
2016-04-22 04:33:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:33:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676468  77 57500 16407846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:33:28 [DEBUG   ] Got command RPT from MCS: ref #676469
2016-04-22 04:33:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 04:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676469  12 57500 16408050 A  ERRORB•™š'
2016-04-22 04:33:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 04:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:34:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 04:34:03 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 04:34:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:34:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:34:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:34:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:34:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:34:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 04:34:04 [DEBUG   ] Finished updating board flags in 1.793 seconds
2016-04-22 04:34:07 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-22 04:34:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:34:29 [DEBUG   ] Got command RPT from MCS: ref #676470
2016-04-22 04:34:29 [DEBUG   ] summary = ERROR
2016-04-22 04:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676470  13 57500 16469834 A  ERRORERROR'
2016-04-22 04:34:29 [DEBUG   ] Got command RPT from MCS: ref #676471
2016-04-22 04:34:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676471  77 57500 16469834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:34:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:35:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:35:04 [DEBUG   ] Finished updating board flags in 1.589 seconds
2016-04-22 04:35:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:35:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:35:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:36:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2016-04-22 04:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 04:36:04 [DEBUG   ] Finished updating board flags in 1.393 seconds
2016-04-22 04:36:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 04:36:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:36:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:37:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:37:05 [DEBUG   ] Finished updating board flags in 1.580 seconds
2016-04-22 04:37:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:37:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 04:37:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 04:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:38:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:38:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:38:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:38:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:38:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:38:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 04:38:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 04:38:05 [DEBUG   ] Finished updating board flags in 2.142 seconds
2016-04-22 04:38:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:38:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:38:27 [DEBUG   ] Got command RPT from MCS: ref #676494
2016-04-22 04:38:27 [DEBUG   ] summary = ERROR
2016-04-22 04:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676494  13 57500 16707350 A  ERRORERROR'
2016-04-22 04:38:27 [DEBUG   ] Got command RPT from MCS: ref #676495
2016-04-22 04:38:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676495  77 57500 16707554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:38:27 [DEBUG   ] Got command RPT from MCS: ref #676496
2016-04-22 04:38:27 [DEBUG   ] summary = ERROR
2016-04-22 04:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676496  13 57500 16707758 A  ERRORERROR'
2016-04-22 04:38:27 [DEBUG   ] Got command RPT from MCS: ref #676497
2016-04-22 04:38:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676497  77 57500 16707950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:38:28 [DEBUG   ] Got command RPT from MCS: ref #676498
2016-04-22 04:38:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 04:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676498  12 57500 16708154 A  ERRORB”™š'
2016-04-22 04:38:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:39:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 04:39:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:39:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:39:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:39:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:39:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:39:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:39:05 [DEBUG   ] Finished updating board flags in 1.898 seconds
2016-04-22 04:39:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 04:39:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:39:29 [DEBUG   ] Got command RPT from MCS: ref #676504
2016-04-22 04:39:29 [DEBUG   ] summary = ERROR
2016-04-22 04:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676504  13 57500 16769838 A  ERRORERROR'
2016-04-22 04:39:29 [DEBUG   ] Got command RPT from MCS: ref #676505
2016-04-22 04:39:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676505  77 57500 16769838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:39:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:40:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:40:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:40:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:40:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:40:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:40:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 04:40:05 [DEBUG   ] Finished updating board flags in 1.792 seconds
2016-04-22 04:40:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 04:40:27 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2016-04-22 04:40:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 04:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:41:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:41:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:41:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:41:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:41:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:41:05 [DEBUG   ] Finished updating board flags in 1.613 seconds
2016-04-22 04:41:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 04:41:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 04:41:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 04:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:42:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 04:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:42:05 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:42:05 [DEBUG   ] Finished updating board flags in 1.582 seconds
2016-04-22 04:42:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 04:42:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 04:42:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 04:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:43:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 04:43:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:43:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:43:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:43:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:43:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:43:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 04:43:05 [DEBUG   ] Finished updating board flags in 1.427 seconds
2016-04-22 04:43:07 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-22 04:43:27 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-22 04:43:27 [DEBUG   ] Got command RPT from MCS: ref #676524
2016-04-22 04:43:27 [DEBUG   ] summary = ERROR
2016-04-22 04:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676524  13 57500 17007442 A  ERRORERROR'
2016-04-22 04:43:27 [DEBUG   ] Got command RPT from MCS: ref #676525
2016-04-22 04:43:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676525  77 57500 17007646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:43:27 [DEBUG   ] Got command RPT from MCS: ref #676526
2016-04-22 04:43:27 [DEBUG   ] summary = ERROR
2016-04-22 04:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676526  13 57500 17007838 A  ERRORERROR'
2016-04-22 04:43:28 [DEBUG   ] Got command RPT from MCS: ref #676527
2016-04-22 04:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676527  77 57500 17008042 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:43:28 [DEBUG   ] Got command RPT from MCS: ref #676528
2016-04-22 04:43:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 04:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676528  12 57500 17008246 A  ERRORB•™š'
2016-04-22 04:43:48 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2016-04-22 04:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:44:05 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 04:44:05 [DEBUG   ] Finished updating board flags in 1.377 seconds
2016-04-22 04:44:08 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-22 04:44:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 04:44:29 [DEBUG   ] Got command RPT from MCS: ref #676532
2016-04-22 04:44:29 [DEBUG   ] summary = ERROR
2016-04-22 04:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676532  13 57500 17069842 A  ERRORERROR'
2016-04-22 04:44:29 [DEBUG   ] Got command RPT from MCS: ref #676533
2016-04-22 04:44:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676533  77 57500 17069842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:44:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 04:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:45:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 04:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:45:05 [DEBUG   ] Finished updating board flags in 1.385 seconds
2016-04-22 04:45:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 04:45:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 04:45:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 04:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:46:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:46:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:46:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:46:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:46:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:46:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 04:46:06 [DEBUG   ] Finished updating board flags in 2.131 seconds
2016-04-22 04:46:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 04:46:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 04:46:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 04:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:47:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:47:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:47:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:47:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:47:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:47:06 [DEBUG   ] Finished updating board flags in 1.896 seconds
2016-04-22 04:47:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 04:47:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 04:47:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 04:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:48:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 04:48:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:48:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:48:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:48:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:48:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:48:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:48:06 [DEBUG   ] Finished updating board flags in 1.842 seconds
2016-04-22 04:48:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 04:48:27 [DEBUG   ] Got command RPT from MCS: ref #676553
2016-04-22 04:48:27 [DEBUG   ] summary = ERROR
2016-04-22 04:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676553  13 57500 17307534 A  ERRORERROR'
2016-04-22 04:48:27 [DEBUG   ] Got command RPT from MCS: ref #676554
2016-04-22 04:48:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676554  77 57500 17307738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:48:27 [DEBUG   ] Got command RPT from MCS: ref #676555
2016-04-22 04:48:27 [DEBUG   ] summary = ERROR
2016-04-22 04:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676555  13 57500 17307942 A  ERRORERROR'
2016-04-22 04:48:28 [DEBUG   ] Got command RPT from MCS: ref #676556
2016-04-22 04:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676556  77 57500 17308146 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:48:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 04:48:28 [DEBUG   ] Got command RPT from MCS: ref #676557
2016-04-22 04:48:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 04:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676557  12 57500 17308338 A  ERRORB”™š'
2016-04-22 04:48:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 04:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:49:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:49:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:49:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:49:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:49:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:49:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 04:49:06 [DEBUG   ] Finished updating board flags in 1.765 seconds
2016-04-22 04:49:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 04:49:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 04:49:29 [DEBUG   ] Got command RPT from MCS: ref #676563
2016-04-22 04:49:29 [DEBUG   ] summary = ERROR
2016-04-22 04:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676563  13 57500 17369938 A  ERRORERROR'
2016-04-22 04:49:29 [DEBUG   ] Got command RPT from MCS: ref #676564
2016-04-22 04:49:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676564  77 57500 17369938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:49:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 04:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:50:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:50:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:50:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:50:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:50:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:50:06 [DEBUG   ] Finished updating board flags in 1.619 seconds
2016-04-22 04:50:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 04:50:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 04:50:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 04:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:51:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:51:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:51:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:51:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:51:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:51:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 04:51:06 [DEBUG   ] Finished updating board flags in 1.630 seconds
2016-04-22 04:51:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-22 04:51:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 04:51:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 04:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:52:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 04:52:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:52:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:52:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:52:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:52:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:52:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-22 04:52:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2016-04-22 04:52:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:52:06 [DEBUG   ] Finished updating board flags in 1.557 seconds
2016-04-22 04:52:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 04:52:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 04:52:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 04:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:53:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 04:53:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:53:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:53:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:53:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:53:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:53:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 04:53:06 [DEBUG   ] Finished updating board flags in 1.525 seconds
2016-04-22 04:53:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 04:53:27 [DEBUG   ] Got command RPT from MCS: ref #676586
2016-04-22 04:53:27 [DEBUG   ] summary = ERROR
2016-04-22 04:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676586  13 57500 17607622 A  ERRORERROR'
2016-04-22 04:53:27 [DEBUG   ] Got command RPT from MCS: ref #676587
2016-04-22 04:53:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676587  77 57500 17607826 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:53:28 [DEBUG   ] Got command RPT from MCS: ref #676588
2016-04-22 04:53:28 [DEBUG   ] summary = ERROR
2016-04-22 04:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676588  13 57500 17608018 A  ERRORERROR'
2016-04-22 04:53:28 [DEBUG   ] Got command RPT from MCS: ref #676589
2016-04-22 04:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676589  77 57500 17608222 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:53:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 04:53:28 [DEBUG   ] Got command RPT from MCS: ref #676590
2016-04-22 04:53:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 04:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676590  12 57500 17608426 A  ERRORB”™š'
2016-04-22 04:53:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:54:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2016-04-22 04:54:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:54:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:54:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:54:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:54:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:54:06 [DEBUG   ] Finished updating board flags in 1.535 seconds
2016-04-22 04:54:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 04:54:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 04:54:29 [DEBUG   ] Got command RPT from MCS: ref #676591
2016-04-22 04:54:29 [DEBUG   ] summary = ERROR
2016-04-22 04:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676591  13 57500 17669938 A  ERRORERROR'
2016-04-22 04:54:29 [DEBUG   ] Got command RPT from MCS: ref #676592
2016-04-22 04:54:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676592  77 57500 17669938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:54:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 04:55:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:55:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:55:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:55:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:55:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:55:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-22 04:55:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 04:55:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2016-04-22 04:55:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:55:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:55:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:55:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:55:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:55:07 [DEBUG   ] Finished updating board flags in 2.258 seconds
2016-04-22 04:55:08 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2016-04-22 04:55:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 04:55:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 04:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:56:07 [DEBUG   ] Finished updating board flags in 2.097 seconds
2016-04-22 04:56:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 04:56:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 04:56:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 04:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:57:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 04:57:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 04:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:57:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 04:57:07 [DEBUG   ] Finished updating board flags in 2.018 seconds
2016-04-22 04:57:09 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2016-04-22 04:57:29 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-22 04:57:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 04:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:58:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:58:07 [DEBUG   ] Finished updating board flags in 1.971 seconds
2016-04-22 04:58:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 04:58:27 [DEBUG   ] Got command RPT from MCS: ref #676612
2016-04-22 04:58:27 [DEBUG   ] summary = ERROR
2016-04-22 04:58:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676612  13 57500 17907702 A  ERRORERROR'
2016-04-22 04:58:27 [DEBUG   ] Got command RPT from MCS: ref #676613
2016-04-22 04:58:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:58:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676613  77 57500 17907894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:58:28 [DEBUG   ] Got command RPT from MCS: ref #676614
2016-04-22 04:58:28 [DEBUG   ] summary = ERROR
2016-04-22 04:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676614  13 57500 17908098 A  ERRORERROR'
2016-04-22 04:58:28 [DEBUG   ] Got command RPT from MCS: ref #676615
2016-04-22 04:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676615  77 57500 17908306 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:58:28 [DEBUG   ] Got command RPT from MCS: ref #676616
2016-04-22 04:58:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 04:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676616  12 57500 17908498 A  ERRORB•™š'
2016-04-22 04:58:29 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-22 04:58:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 04:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 04:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 04:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 04:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 04:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 04:59:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 04:59:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 04:59:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 04:59:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 04:59:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 04:59:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 04:59:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 04:59:07 [DEBUG   ] Finished updating board flags in 1.820 seconds
2016-04-22 04:59:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 04:59:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 04:59:29 [DEBUG   ] Got command RPT from MCS: ref #676625
2016-04-22 04:59:29 [DEBUG   ] summary = ERROR
2016-04-22 04:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676625  13 57500 17969942 A  ERRORERROR'
2016-04-22 04:59:29 [DEBUG   ] Got command RPT from MCS: ref #676626
2016-04-22 04:59:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 04:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676626  77 57500 17969942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 04:59:49 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2016-04-22 05:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:00:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:00:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:00:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:00:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:00:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:00:07 [DEBUG   ] Finished updating board flags in 1.793 seconds
2016-04-22 05:00:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 05:00:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 05:00:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 05:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:01:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:01:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:01:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:01:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:01:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:01:07 [DEBUG   ] Finished updating board flags in 1.610 seconds
2016-04-22 05:01:09 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-22 05:01:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:01:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:02:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2016-04-22 05:02:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 05:02:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:02:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:02:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:02:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:02:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:02:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:02:07 [DEBUG   ] Finished updating board flags in 1.595 seconds
2016-04-22 05:02:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 05:02:29 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-22 05:02:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-22 05:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:03:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:03:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:03:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:03:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:03:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:03:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 05:03:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-22 05:03:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:03:07 [DEBUG   ] Finished updating board flags in 1.396 seconds
2016-04-22 05:03:10 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 05:03:27 [DEBUG   ] Got command RPT from MCS: ref #676645
2016-04-22 05:03:27 [DEBUG   ] summary = ERROR
2016-04-22 05:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676645  13 57500 18207802 A  ERRORERROR'
2016-04-22 05:03:28 [DEBUG   ] Got command RPT from MCS: ref #676646
2016-04-22 05:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676646  77 57500 18208006 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:03:28 [DEBUG   ] Got command RPT from MCS: ref #676647
2016-04-22 05:03:28 [DEBUG   ] summary = ERROR
2016-04-22 05:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676647  13 57500 18208210 A  ERRORERROR'
2016-04-22 05:03:28 [DEBUG   ] Got command RPT from MCS: ref #676648
2016-04-22 05:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676648  77 57500 18208402 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:03:28 [DEBUG   ] Got command RPT from MCS: ref #676649
2016-04-22 05:03:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 05:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676649  12 57500 18208606 A  ERRORB”™š'
2016-04-22 05:03:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 05:03:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 05:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:04:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:04:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:04:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:04:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:04:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:04:07 [DEBUG   ] Finished updating board flags in 1.360 seconds
2016-04-22 05:04:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 05:04:29 [DEBUG   ] Got command RPT from MCS: ref #676650
2016-04-22 05:04:29 [DEBUG   ] summary = ERROR
2016-04-22 05:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676650  13 57500 18269942 A  ERRORERROR'
2016-04-22 05:04:29 [DEBUG   ] Got command RPT from MCS: ref #676651
2016-04-22 05:04:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676651  77 57500 18269942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:04:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 05:04:50 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 05:05:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:05:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:05:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:05:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:05:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:05:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:05:08 [DEBUG   ] Finished updating board flags in 2.106 seconds
2016-04-22 05:05:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 05:05:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 05:05:50 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 05:06:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:06:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:06:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:06:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:06:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:06:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 05:06:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:06:08 [DEBUG   ] Finished updating board flags in 1.939 seconds
2016-04-22 05:06:10 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 05:06:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 05:06:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 05:07:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:07:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:07:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:07:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:07:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:07:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 05:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:07:08 [DEBUG   ] Finished updating board flags in 1.824 seconds
2016-04-22 05:07:10 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2016-04-22 05:07:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 05:07:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 05:08:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:08:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:08:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:08:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:08:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:08:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:08:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:08:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:08:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:08:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:08:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 05:08:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:08:08 [DEBUG   ] Finished updating board flags in 1.786 seconds
2016-04-22 05:08:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 05:08:27 [DEBUG   ] Got command RPT from MCS: ref #676674
2016-04-22 05:08:27 [DEBUG   ] summary = ERROR
2016-04-22 05:08:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676674  13 57500 18507898 A  ERRORERROR'
2016-04-22 05:08:28 [DEBUG   ] Got command RPT from MCS: ref #676675
2016-04-22 05:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676675  77 57500 18508090 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:08:28 [DEBUG   ] Got command RPT from MCS: ref #676676
2016-04-22 05:08:28 [DEBUG   ] summary = ERROR
2016-04-22 05:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676676  13 57500 18508294 A  ERRORERROR'
2016-04-22 05:08:28 [DEBUG   ] Got command RPT from MCS: ref #676677
2016-04-22 05:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676677  77 57500 18508498 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:08:28 [DEBUG   ] Got command RPT from MCS: ref #676678
2016-04-22 05:08:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 05:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676678  12 57500 18508702 A  ERRORB“™š'
2016-04-22 05:08:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 05:08:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 05:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:09:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 05:09:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:09:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:09:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:09:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:09:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:09:08 [DEBUG   ] Finished updating board flags in 1.627 seconds
2016-04-22 05:09:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 05:09:29 [DEBUG   ] Got command RPT from MCS: ref #676684
2016-04-22 05:09:29 [DEBUG   ] summary = ERROR
2016-04-22 05:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676684  13 57500 18569942 A  ERRORERROR'
2016-04-22 05:09:29 [DEBUG   ] Got command RPT from MCS: ref #676685
2016-04-22 05:09:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676685  77 57500 18569942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:09:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 05:09:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 05:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:10:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 05:10:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 05:10:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:10:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:10:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:10:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:10:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:10:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 05:10:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:10:08 [DEBUG   ] Finished updating board flags in 1.613 seconds
2016-04-22 05:10:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 05:10:30 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2016-04-22 05:10:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 05:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:11:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:11:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:11:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:11:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:11:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:11:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 05:11:08 [DEBUG   ] Finished updating board flags in 1.614 seconds
2016-04-22 05:11:10 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-22 05:11:30 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2016-04-22 05:11:51 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-22 05:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:12:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:12:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:12:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:12:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:12:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:12:08 [DEBUG   ] Finished updating board flags in 1.542 seconds
2016-04-22 05:12:11 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2016-04-22 05:12:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 05:12:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 05:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:13:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 05:13:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:13:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:13:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:13:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:13:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:13:08 [DEBUG   ] Finished updating board flags in 1.453 seconds
2016-04-22 05:13:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 05:13:27 [DEBUG   ] Got command RPT from MCS: ref #676704
2016-04-22 05:13:27 [DEBUG   ] summary = ERROR
2016-04-22 05:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676704  13 57500 18807978 A  ERRORERROR'
2016-04-22 05:13:28 [DEBUG   ] Got command RPT from MCS: ref #676705
2016-04-22 05:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676705  77 57500 18808182 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:13:28 [DEBUG   ] Got command RPT from MCS: ref #676706
2016-04-22 05:13:28 [DEBUG   ] summary = ERROR
2016-04-22 05:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676706  13 57500 18808374 A  ERRORERROR'
2016-04-22 05:13:28 [DEBUG   ] Got command RPT from MCS: ref #676707
2016-04-22 05:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676707  77 57500 18808578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:13:28 [DEBUG   ] Got command RPT from MCS: ref #676708
2016-04-22 05:13:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 05:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676708  12 57500 18808782 A  ERRORB“™š'
2016-04-22 05:13:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 05:13:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 05:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:14:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:14:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:14:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:14:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:14:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:14:08 [DEBUG   ] Finished updating board flags in 1.472 seconds
2016-04-22 05:14:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 05:14:29 [DEBUG   ] Got command RPT from MCS: ref #676712
2016-04-22 05:14:29 [DEBUG   ] summary = ERROR
2016-04-22 05:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676712  13 57500 18869942 A  ERRORERROR'
2016-04-22 05:14:29 [DEBUG   ] Got command RPT from MCS: ref #676713
2016-04-22 05:14:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676713  77 57500 18869942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:14:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 05:14:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 05:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:15:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 05:15:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:15:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:15:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:15:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:15:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:15:08 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:15:08 [DEBUG   ] Finished updating board flags in 1.551 seconds
2016-04-22 05:15:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 05:15:31 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-22 05:15:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 05:16:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:16:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:16:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:16:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:16:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:16:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:16:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:16:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:16:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:16:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:16:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:16:09 [DEBUG   ] Finished updating board flags in 2.212 seconds
2016-04-22 05:16:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 05:16:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 05:16:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 05:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:17:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:17:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:17:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:17:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:17:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:17:09 [DEBUG   ] Finished updating board flags in 2.131 seconds
2016-04-22 05:17:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 05:17:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 05:17:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 05:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:18:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:18:09 [DEBUG   ] Finished updating board flags in 2.030 seconds
2016-04-22 05:18:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 05:18:28 [DEBUG   ] Got command RPT from MCS: ref #676733
2016-04-22 05:18:28 [DEBUG   ] summary = ERROR
2016-04-22 05:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676733  13 57500 19108062 A  ERRORERROR'
2016-04-22 05:18:28 [DEBUG   ] Got command RPT from MCS: ref #676734
2016-04-22 05:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676734  77 57500 19108266 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:18:28 [DEBUG   ] Got command RPT from MCS: ref #676735
2016-04-22 05:18:28 [DEBUG   ] summary = ERROR
2016-04-22 05:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676735  13 57500 19108470 A  ERRORERROR'
2016-04-22 05:18:28 [DEBUG   ] Got command RPT from MCS: ref #676736
2016-04-22 05:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676736  77 57500 19108662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:18:28 [DEBUG   ] Got command RPT from MCS: ref #676737
2016-04-22 05:18:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 05:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676737  12 57500 19108866 A  ERRORB”™š'
2016-04-22 05:18:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 05:18:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 05:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:19:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2016-04-22 05:19:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:19:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:19:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:19:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:19:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:19:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 05:19:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 05:19:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2016-04-22 05:19:09 [DEBUG   ] Finished updating board flags in 2.002 seconds
2016-04-22 05:19:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 05:19:29 [DEBUG   ] Got command RPT from MCS: ref #676743
2016-04-22 05:19:29 [DEBUG   ] summary = ERROR
2016-04-22 05:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676743  13 57500 19169938 A  ERRORERROR'
2016-04-22 05:19:29 [DEBUG   ] Got command RPT from MCS: ref #676744
2016-04-22 05:19:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676744  77 57500 19169938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:19:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 05:19:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 05:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:20:09 [DEBUG   ] Finished updating board flags in 2.044 seconds
2016-04-22 05:20:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 05:20:31 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-22 05:20:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:21:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:21:09 [DEBUG   ] Finished updating board flags in 1.921 seconds
2016-04-22 05:21:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:21:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 05:21:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:22:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:22:09 [DEBUG   ] Finished updating board flags in 1.867 seconds
2016-04-22 05:22:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:22:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 05:22:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 05:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:23:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:23:09 [DEBUG   ] Finished updating board flags in 1.760 seconds
2016-04-22 05:23:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:23:28 [DEBUG   ] Got command RPT from MCS: ref #676766
2016-04-22 05:23:28 [DEBUG   ] summary = ERROR
2016-04-22 05:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676766  13 57500 19408162 A  ERRORERROR'
2016-04-22 05:23:28 [DEBUG   ] Got command RPT from MCS: ref #676767
2016-04-22 05:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676767  77 57500 19408354 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:23:28 [DEBUG   ] Got command RPT from MCS: ref #676768
2016-04-22 05:23:28 [DEBUG   ] summary = ERROR
2016-04-22 05:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676768  13 57500 19408558 A  ERRORERROR'
2016-04-22 05:23:28 [DEBUG   ] Got command RPT from MCS: ref #676769
2016-04-22 05:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676769  77 57500 19408762 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:23:28 [DEBUG   ] Got command RPT from MCS: ref #676770
2016-04-22 05:23:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 05:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676770  12 57500 19408966 A  ERRORB“™š'
2016-04-22 05:23:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:23:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 05:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:24:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2016-04-22 05:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:24:09 [DEBUG   ] Finished updating board flags in 1.625 seconds
2016-04-22 05:24:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 05:24:29 [DEBUG   ] Got command RPT from MCS: ref #676771
2016-04-22 05:24:29 [DEBUG   ] summary = ERROR
2016-04-22 05:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676771  13 57500 19469942 A  ERRORERROR'
2016-04-22 05:24:29 [DEBUG   ] Got command RPT from MCS: ref #676772
2016-04-22 05:24:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676772  77 57500 19469942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:24:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 05:24:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:25:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:25:09 [DEBUG   ] Finished updating board flags in 1.644 seconds
2016-04-22 05:25:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:25:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 05:25:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:26:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:26:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:26:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:26:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:26:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:26:09 [DEBUG   ] Finished updating board flags in 1.523 seconds
2016-04-22 05:26:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:26:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:26:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:27:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:27:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:27:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:27:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:27:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:27:09 [DEBUG   ] Finished updating board flags in 1.518 seconds
2016-04-22 05:27:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:27:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:27:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:28:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:28:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:28:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:28:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:28:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:28:09 [DEBUG   ] Finished updating board flags in 1.547 seconds
2016-04-22 05:28:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:28:28 [DEBUG   ] Got command RPT from MCS: ref #676792
2016-04-22 05:28:28 [DEBUG   ] summary = ERROR
2016-04-22 05:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676792  13 57500 19708250 A  ERRORERROR'
2016-04-22 05:28:28 [DEBUG   ] Got command RPT from MCS: ref #676793
2016-04-22 05:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676793  77 57500 19708442 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:28:28 [DEBUG   ] Got command RPT from MCS: ref #676794
2016-04-22 05:28:28 [DEBUG   ] summary = ERROR
2016-04-22 05:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676794  13 57500 19708646 A  ERRORERROR'
2016-04-22 05:28:28 [DEBUG   ] Got command RPT from MCS: ref #676795
2016-04-22 05:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676795  77 57500 19708850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:28:29 [DEBUG   ] Got command RPT from MCS: ref #676796
2016-04-22 05:28:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 05:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676796  12 57500 19709054 A  ERRORB“™š'
2016-04-22 05:28:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:28:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:29:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:29:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:29:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:29:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:29:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:29:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2016-04-22 05:29:10 [DEBUG   ] Finished updating board flags in 2.210 seconds
2016-04-22 05:29:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:29:29 [DEBUG   ] Got command RPT from MCS: ref #676805
2016-04-22 05:29:29 [DEBUG   ] summary = ERROR
2016-04-22 05:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676805  13 57500 19769938 A  ERRORERROR'
2016-04-22 05:29:29 [DEBUG   ] Got command RPT from MCS: ref #676806
2016-04-22 05:29:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676806  77 57500 19769938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:29:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:29:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:30:10 [DEBUG   ] Finished updating board flags in 2.160 seconds
2016-04-22 05:30:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:30:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:30:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 05:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:31:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 05:31:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:31:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:31:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:31:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:31:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:31:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:31:10 [DEBUG   ] Finished updating board flags in 2.012 seconds
2016-04-22 05:31:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:31:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:31:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:32:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 05:32:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:32:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:32:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:32:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:32:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:32:10 [DEBUG   ] Finished updating board flags in 2.008 seconds
2016-04-22 05:32:11 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2016-04-22 05:32:31 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 05:32:52 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2016-04-22 05:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:33:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:33:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:33:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:33:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:33:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:33:10 [DEBUG   ] Finished updating board flags in 1.941 seconds
2016-04-22 05:33:12 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2016-04-22 05:33:28 [DEBUG   ] Got command RPT from MCS: ref #676825
2016-04-22 05:33:28 [DEBUG   ] summary = ERROR
2016-04-22 05:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676825  13 57500 20008350 A  ERRORERROR'
2016-04-22 05:33:28 [DEBUG   ] Got command RPT from MCS: ref #676826
2016-04-22 05:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676826  77 57500 20008554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:33:28 [DEBUG   ] Got command RPT from MCS: ref #676827
2016-04-22 05:33:28 [DEBUG   ] summary = ERROR
2016-04-22 05:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676827  13 57500 20008758 A  ERRORERROR'
2016-04-22 05:33:28 [DEBUG   ] Got command RPT from MCS: ref #676828
2016-04-22 05:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676828  77 57500 20008962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:33:29 [DEBUG   ] Got command RPT from MCS: ref #676829
2016-04-22 05:33:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 05:33:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676829  12 57500 20009154 A  ERRORB”™š'
2016-04-22 05:33:32 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-22 05:33:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 05:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:34:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 05:34:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 05:34:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:34:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:34:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:34:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:34:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:34:10 [DEBUG   ] Finished updating board flags in 1.829 seconds
2016-04-22 05:34:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 05:34:29 [DEBUG   ] Got command RPT from MCS: ref #676830
2016-04-22 05:34:29 [DEBUG   ] summary = ERROR
2016-04-22 05:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676830  13 57500 20069942 A  ERRORERROR'
2016-04-22 05:34:29 [DEBUG   ] Got command RPT from MCS: ref #676831
2016-04-22 05:34:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676831  77 57500 20069942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:34:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 05:34:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 05:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:35:10 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:35:10 [DEBUG   ] Finished updating board flags in 1.778 seconds
2016-04-22 05:35:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 05:35:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 05:35:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 05:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:36:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:36:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:36:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:36:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:36:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:36:10 [DEBUG   ] Finished updating board flags in 1.684 seconds
2016-04-22 05:36:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 05:36:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 05:36:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 05:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:37:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2016-04-22 05:37:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:37:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:37:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:37:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:37:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:37:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 05:37:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 05:37:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:37:10 [DEBUG   ] Finished updating board flags in 1.611 seconds
2016-04-22 05:37:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 05:37:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 05:37:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 05:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:38:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 05:38:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:38:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:38:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:38:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:38:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:38:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 05:38:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:38:10 [DEBUG   ] Finished updating board flags in 1.548 seconds
2016-04-22 05:38:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 05:38:28 [DEBUG   ] Got command RPT from MCS: ref #676854
2016-04-22 05:38:28 [DEBUG   ] summary = ERROR
2016-04-22 05:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676854  13 57500 20308442 A  ERRORERROR'
2016-04-22 05:38:28 [DEBUG   ] Got command RPT from MCS: ref #676855
2016-04-22 05:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676855  77 57500 20308646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:38:28 [DEBUG   ] Got command RPT from MCS: ref #676856
2016-04-22 05:38:28 [DEBUG   ] summary = ERROR
2016-04-22 05:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676856  13 57500 20308850 A  ERRORERROR'
2016-04-22 05:38:29 [DEBUG   ] Got command RPT from MCS: ref #676857
2016-04-22 05:38:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676857  77 57500 20309042 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:38:29 [DEBUG   ] Got command RPT from MCS: ref #676858
2016-04-22 05:38:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 05:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676858  12 57500 20309246 A  ERRORB”™š'
2016-04-22 05:38:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 05:38:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 05:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:39:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-22 05:39:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:39:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:39:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:39:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:39:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:39:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:39:10 [DEBUG   ] Finished updating board flags in 1.521 seconds
2016-04-22 05:39:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 05:39:29 [DEBUG   ] Got command RPT from MCS: ref #676864
2016-04-22 05:39:29 [DEBUG   ] summary = ERROR
2016-04-22 05:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676864  13 57500 20369946 A  ERRORERROR'
2016-04-22 05:39:29 [DEBUG   ] Got command RPT from MCS: ref #676865
2016-04-22 05:39:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676865  77 57500 20369946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:39:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 05:39:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 05:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:40:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:40:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:40:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:40:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:40:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:40:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:40:10 [DEBUG   ] Finished updating board flags in 1.541 seconds
2016-04-22 05:40:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 05:40:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 05:40:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 05:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:41:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:41:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:41:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:41:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:41:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:41:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:41:11 [DEBUG   ] Finished updating board flags in 2.169 seconds
2016-04-22 05:41:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 05:41:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 05:41:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 05:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:42:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 05:42:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:42:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:42:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:42:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:42:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:42:11 [DEBUG   ] Finished updating board flags in 2.024 seconds
2016-04-22 05:42:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 05:42:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 05:42:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 05:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:43:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:43:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:43:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:43:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:43:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:43:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 05:43:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:43:11 [DEBUG   ] Finished updating board flags in 2.040 seconds
2016-04-22 05:43:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 05:43:28 [DEBUG   ] Got command RPT from MCS: ref #676884
2016-04-22 05:43:28 [DEBUG   ] summary = ERROR
2016-04-22 05:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676884  13 57500 20608546 A  ERRORERROR'
2016-04-22 05:43:28 [DEBUG   ] Got command RPT from MCS: ref #676885
2016-04-22 05:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676885  77 57500 20608750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:43:28 [DEBUG   ] Got command RPT from MCS: ref #676886
2016-04-22 05:43:28 [DEBUG   ] summary = ERROR
2016-04-22 05:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676886  13 57500 20608942 A  ERRORERROR'
2016-04-22 05:43:29 [DEBUG   ] Got command RPT from MCS: ref #676887
2016-04-22 05:43:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:43:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676887  77 57500 20609146 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:43:29 [DEBUG   ] Got command RPT from MCS: ref #676888
2016-04-22 05:43:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 05:43:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676888  12 57500 20609350 A  ERRORB“™š'
2016-04-22 05:43:32 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-22 05:43:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 05:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:44:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 05:44:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:44:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:44:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:44:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:44:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:44:11 [DEBUG   ] Finished updating board flags in 1.910 seconds
2016-04-22 05:44:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 05:44:29 [DEBUG   ] Got command RPT from MCS: ref #676892
2016-04-22 05:44:29 [DEBUG   ] summary = ERROR
2016-04-22 05:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676892  13 57500 20669950 A  ERRORERROR'
2016-04-22 05:44:29 [DEBUG   ] Got command RPT from MCS: ref #676893
2016-04-22 05:44:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676893  77 57500 20669950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:44:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 05:44:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 05:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:45:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:45:11 [DEBUG   ] Finished updating board flags in 1.813 seconds
2016-04-22 05:45:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 05:45:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 05:45:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 05:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:46:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 05:46:11 [DEBUG   ] Finished updating board flags in 1.790 seconds
2016-04-22 05:46:12 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2016-04-22 05:46:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 05:46:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 05:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:47:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 05:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:47:11 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:47:11 [DEBUG   ] Finished updating board flags in 1.614 seconds
2016-04-22 05:47:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 05:47:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 05:47:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 05:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:48:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 05:48:11 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:48:11 [DEBUG   ] Finished updating board flags in 1.742 seconds
2016-04-22 05:48:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 05:48:28 [DEBUG   ] Got command RPT from MCS: ref #676913
2016-04-22 05:48:28 [DEBUG   ] summary = ERROR
2016-04-22 05:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676913  13 57500 20908638 A  ERRORERROR'
2016-04-22 05:48:28 [DEBUG   ] Got command RPT from MCS: ref #676914
2016-04-22 05:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676914  77 57500 20908842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:48:29 [DEBUG   ] Got command RPT from MCS: ref #676915
2016-04-22 05:48:29 [DEBUG   ] summary = ERROR
2016-04-22 05:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676915  13 57500 20909046 A  ERRORERROR'
2016-04-22 05:48:29 [DEBUG   ] Got command RPT from MCS: ref #676916
2016-04-22 05:48:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676916  77 57500 20909250 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:48:29 [DEBUG   ] Got command RPT from MCS: ref #676917
2016-04-22 05:48:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 05:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676917  12 57500 20909442 A  ERRORB”™š'
2016-04-22 05:48:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 05:48:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 05:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:49:11 [DEBUG   ] Finished updating board flags in 1.551 seconds
2016-04-22 05:49:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 05:49:29 [DEBUG   ] Got command RPT from MCS: ref #676923
2016-04-22 05:49:29 [DEBUG   ] summary = ERROR
2016-04-22 05:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676923  13 57500 20969942 A  ERRORERROR'
2016-04-22 05:49:29 [DEBUG   ] Got command RPT from MCS: ref #676924
2016-04-22 05:49:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676924  77 57500 20969942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:49:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 05:49:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 05:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:50:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 05:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:50:12 [DEBUG   ] Finished updating board flags in 1.628 seconds
2016-04-22 05:50:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 05:50:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 05:50:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 05:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:51:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 05:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:51:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:51:12 [DEBUG   ] Finished updating board flags in 1.629 seconds
2016-04-22 05:51:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 05:51:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 05:51:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 05:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:52:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2016-04-22 05:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:52:12 [DEBUG   ] Finished updating board flags in 1.628 seconds
2016-04-22 05:52:12 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-22 05:52:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:52:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 05:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:53:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 05:53:12 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-22 05:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:53:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:53:13 [DEBUG   ] Finished updating board flags in 2.575 seconds
2016-04-22 05:53:28 [DEBUG   ] Got command RPT from MCS: ref #676946
2016-04-22 05:53:28 [DEBUG   ] summary = ERROR
2016-04-22 05:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676946  13 57500 21208730 A  ERRORERROR'
2016-04-22 05:53:28 [DEBUG   ] Got command RPT from MCS: ref #676947
2016-04-22 05:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676947  77 57500 21208934 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:53:29 [DEBUG   ] Got command RPT from MCS: ref #676948
2016-04-22 05:53:29 [DEBUG   ] summary = ERROR
2016-04-22 05:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676948  13 57500 21209126 A  ERRORERROR'
2016-04-22 05:53:29 [DEBUG   ] Got command RPT from MCS: ref #676949
2016-04-22 05:53:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676949  77 57500 21209330 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:53:29 [DEBUG   ] Got command RPT from MCS: ref #676950
2016-04-22 05:53:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 05:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676950  12 57500 21209534 A  ERRORB“™š'
2016-04-22 05:53:32 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-22 05:53:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 05:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:54:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 05:54:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:54:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:54:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:54:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:54:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:54:12 [DEBUG   ] Finished updating ant stats in 0.447 seconds
2016-04-22 05:54:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:54:12 [DEBUG   ] Finished updating board flags in 2.064 seconds
2016-04-22 05:54:29 [DEBUG   ] Got command RPT from MCS: ref #676951
2016-04-22 05:54:29 [DEBUG   ] summary = ERROR
2016-04-22 05:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676951  13 57500 21269950 A  ERRORERROR'
2016-04-22 05:54:29 [DEBUG   ] Got command RPT from MCS: ref #676952
2016-04-22 05:54:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676952  77 57500 21269950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:54:33 [DEBUG   ] Finished updating ant stats in 1.359 seconds
2016-04-22 05:54:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 05:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:55:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:55:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:55:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:55:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:55:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:55:12 [DEBUG   ] Finished updating board flags in 2.030 seconds
2016-04-22 05:55:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 05:55:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 05:55:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 05:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:56:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2016-04-22 05:56:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 05:56:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:56:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:56:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:56:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:56:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:56:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 05:56:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:56:12 [DEBUG   ] Finished updating board flags in 2.061 seconds
2016-04-22 05:56:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 05:56:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 05:56:53 [DEBUG   ] Finished updating ant stats in 1.193 seconds
2016-04-22 05:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:57:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 05:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:57:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:57:12 [DEBUG   ] Finished updating board flags in 1.902 seconds
2016-04-22 05:57:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 05:57:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 05:57:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 05:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:58:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 05:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:58:12 [DEBUG   ] Finished updating board flags in 1.827 seconds
2016-04-22 05:58:13 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2016-04-22 05:58:28 [DEBUG   ] Got command RPT from MCS: ref #676972
2016-04-22 05:58:28 [DEBUG   ] summary = ERROR
2016-04-22 05:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676972  13 57500 21508814 A  ERRORERROR'
2016-04-22 05:58:29 [DEBUG   ] Got command RPT from MCS: ref #676973
2016-04-22 05:58:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676973  77 57500 21509018 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:58:29 [DEBUG   ] Got command RPT from MCS: ref #676974
2016-04-22 05:58:29 [DEBUG   ] summary = ERROR
2016-04-22 05:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676974  13 57500 21509222 A  ERRORERROR'
2016-04-22 05:58:29 [DEBUG   ] Got command RPT from MCS: ref #676975
2016-04-22 05:58:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676975  77 57500 21509414 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:58:29 [DEBUG   ] Got command RPT from MCS: ref #676976
2016-04-22 05:58:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 05:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676976  12 57500 21509618 A  ERRORB”™š'
2016-04-22 05:58:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 05:58:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 05:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 05:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 05:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 05:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 05:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 05:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 05:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 05:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 05:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 05:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 05:59:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 05:59:12 [DEBUG   ] Finished updating board flags in 1.781 seconds
2016-04-22 05:59:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 05:59:29 [DEBUG   ] Got command RPT from MCS: ref #676985
2016-04-22 05:59:29 [DEBUG   ] summary = ERROR
2016-04-22 05:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676985  13 57500 21569950 A  ERRORERROR'
2016-04-22 05:59:29 [DEBUG   ] Got command RPT from MCS: ref #676986
2016-04-22 05:59:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 05:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   676986  77 57500 21569950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 05:59:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 05:59:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 06:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:00:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 06:00:12 [DEBUG   ] Finished updating board flags in 1.641 seconds
2016-04-22 06:00:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 06:00:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 06:00:53 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2016-04-22 06:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:01:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 06:01:12 [DEBUG   ] Finished updating board flags in 1.567 seconds
2016-04-22 06:01:13 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-22 06:01:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 06:01:53 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2016-04-22 06:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:02:12 [DEBUG   ] Finished updating board flags in 1.429 seconds
2016-04-22 06:02:14 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2016-04-22 06:02:34 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-22 06:02:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 06:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:03:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 06:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:03:12 [DEBUG   ] Finished updating board flags in 1.438 seconds
2016-04-22 06:03:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 06:03:28 [DEBUG   ] Got command RPT from MCS: ref #677005
2016-04-22 06:03:28 [DEBUG   ] summary = ERROR
2016-04-22 06:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677005  13 57500 21808902 A  ERRORERROR'
2016-04-22 06:03:29 [DEBUG   ] Got command RPT from MCS: ref #677006
2016-04-22 06:03:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:03:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677006  77 57500 21809106 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:03:29 [DEBUG   ] Got command RPT from MCS: ref #677007
2016-04-22 06:03:29 [DEBUG   ] summary = ERROR
2016-04-22 06:03:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677007  13 57500 21809310 A  ERRORERROR'
2016-04-22 06:03:29 [DEBUG   ] Got command RPT from MCS: ref #677008
2016-04-22 06:03:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:03:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677008  77 57500 21809502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:03:29 [DEBUG   ] Got command RPT from MCS: ref #677009
2016-04-22 06:03:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 06:03:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677009  12 57500 21809706 A  ERRORB”™š'
2016-04-22 06:03:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:03:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 06:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:04:12 [DEBUG   ] Finished updating board flags in 1.547 seconds
2016-04-22 06:04:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 06:04:29 [DEBUG   ] Got command RPT from MCS: ref #677010
2016-04-22 06:04:29 [DEBUG   ] summary = ERROR
2016-04-22 06:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677010  13 57500 21869958 A  ERRORERROR'
2016-04-22 06:04:29 [DEBUG   ] Got command RPT from MCS: ref #677011
2016-04-22 06:04:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677011  77 57500 21869958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:04:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 06:04:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:05:13 [DEBUG   ] Finished updating board flags in 2.223 seconds
2016-04-22 06:05:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 06:05:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 06:05:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 06:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:06:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 06:06:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 06:06:13 [DEBUG   ] Finished updating board flags in 2.237 seconds
2016-04-22 06:06:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:06:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:06:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 06:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:07:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 06:07:13 [DEBUG   ] Finished updating board flags in 2.152 seconds
2016-04-22 06:07:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 06:07:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:07:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 06:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:08:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 06:08:13 [DEBUG   ] Finished updating board flags in 2.045 seconds
2016-04-22 06:08:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 06:08:28 [DEBUG   ] Got command RPT from MCS: ref #677034
2016-04-22 06:08:28 [DEBUG   ] summary = ERROR
2016-04-22 06:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677034  13 57500 22108994 A  ERRORERROR'
2016-04-22 06:08:29 [DEBUG   ] Got command RPT from MCS: ref #677035
2016-04-22 06:08:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677035  77 57500 22109186 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:08:29 [DEBUG   ] Got command RPT from MCS: ref #677036
2016-04-22 06:08:29 [DEBUG   ] summary = ERROR
2016-04-22 06:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677036  13 57500 22109390 A  ERRORERROR'
2016-04-22 06:08:29 [DEBUG   ] Got command RPT from MCS: ref #677037
2016-04-22 06:08:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677037  77 57500 22109594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:08:29 [DEBUG   ] Got command RPT from MCS: ref #677038
2016-04-22 06:08:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 06:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677038  12 57500 22109798 A  ERRORB•™š'
2016-04-22 06:08:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 06:08:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 06:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:09:13 [DEBUG   ] Finished updating board flags in 1.935 seconds
2016-04-22 06:09:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 06:09:29 [DEBUG   ] Got command RPT from MCS: ref #677044
2016-04-22 06:09:29 [DEBUG   ] summary = ERROR
2016-04-22 06:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677044  13 57500 22169954 A  ERRORERROR'
2016-04-22 06:09:29 [DEBUG   ] Got command RPT from MCS: ref #677045
2016-04-22 06:09:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677045  77 57500 22169954 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:09:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 06:09:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 06:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:10:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:10:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:10:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:10:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:10:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:10:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 06:10:13 [DEBUG   ] Finished updating board flags in 1.866 seconds
2016-04-22 06:10:14 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2016-04-22 06:10:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 06:10:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 06:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:11:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:11:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:11:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:11:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:11:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:11:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 06:11:13 [DEBUG   ] Finished updating board flags in 1.724 seconds
2016-04-22 06:11:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 06:11:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 06:11:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 06:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:12:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:12:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:12:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:12:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:12:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:12:13 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 06:12:13 [DEBUG   ] Finished updating board flags in 1.591 seconds
2016-04-22 06:12:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 06:12:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 06:12:55 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2016-04-22 06:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:13:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 06:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:13:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 06:13:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 06:13:13 [DEBUG   ] Finished updating board flags in 1.409 seconds
2016-04-22 06:13:14 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2016-04-22 06:13:29 [DEBUG   ] Got command RPT from MCS: ref #677064
2016-04-22 06:13:29 [DEBUG   ] summary = ERROR
2016-04-22 06:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677064  13 57500 22409086 A  ERRORERROR'
2016-04-22 06:13:29 [DEBUG   ] Got command RPT from MCS: ref #677065
2016-04-22 06:13:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677065  77 57500 22409290 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:13:29 [DEBUG   ] Got command RPT from MCS: ref #677066
2016-04-22 06:13:29 [DEBUG   ] summary = ERROR
2016-04-22 06:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677066  13 57500 22409482 A  ERRORERROR'
2016-04-22 06:13:29 [DEBUG   ] Got command RPT from MCS: ref #677067
2016-04-22 06:13:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677067  77 57500 22409686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:13:29 [DEBUG   ] Got command RPT from MCS: ref #677068
2016-04-22 06:13:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 06:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677068  12 57500 22409890 A  ERRORB”™š'
2016-04-22 06:13:35 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2016-04-22 06:13:55 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-22 06:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:14:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 06:14:13 [DEBUG   ] Finished updating board flags in 1.389 seconds
2016-04-22 06:14:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:14:29 [DEBUG   ] Got command RPT from MCS: ref #677072
2016-04-22 06:14:29 [DEBUG   ] summary = ERROR
2016-04-22 06:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677072  13 57500 22469950 A  ERRORERROR'
2016-04-22 06:14:29 [DEBUG   ] Got command RPT from MCS: ref #677073
2016-04-22 06:14:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677073  77 57500 22469950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:14:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:14:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:15:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2016-04-22 06:15:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 06:15:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:15:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:15:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:15:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:15:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:15:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-22 06:15:14 [DEBUG   ] Finished updating board flags in 2.320 seconds
2016-04-22 06:15:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:15:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:15:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:16:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:16:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:16:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:16:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:16:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:16:14 [DEBUG   ] Finished updating board flags in 2.106 seconds
2016-04-22 06:16:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 06:16:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 06:16:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:17:13 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 06:17:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:17:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:17:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:17:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:17:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2016-04-22 06:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 06:17:14 [DEBUG   ] Finished updating board flags in 2.044 seconds
2016-04-22 06:17:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:17:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:17:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:18:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:18:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:18:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:18:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:18:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 06:18:14 [DEBUG   ] Finished updating board flags in 2.010 seconds
2016-04-22 06:18:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:18:29 [DEBUG   ] Got command RPT from MCS: ref #677093
2016-04-22 06:18:29 [DEBUG   ] summary = ERROR
2016-04-22 06:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677093  13 57500 22709158 A  ERRORERROR'
2016-04-22 06:18:29 [DEBUG   ] Got command RPT from MCS: ref #677094
2016-04-22 06:18:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677094  77 57500 22709362 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:18:29 [DEBUG   ] Got command RPT from MCS: ref #677095
2016-04-22 06:18:29 [DEBUG   ] summary = ERROR
2016-04-22 06:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677095  13 57500 22709566 A  ERRORERROR'
2016-04-22 06:18:29 [DEBUG   ] Got command RPT from MCS: ref #677096
2016-04-22 06:18:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677096  77 57500 22709770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:18:29 [DEBUG   ] Got command RPT from MCS: ref #677097
2016-04-22 06:18:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 06:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677097  12 57500 22709962 A  ERRORB”™š'
2016-04-22 06:18:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 06:18:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:19:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:19:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:19:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:19:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:19:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:19:14 [DEBUG   ] Finished updating board flags in 2.006 seconds
2016-04-22 06:19:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 06:19:29 [DEBUG   ] Got command RPT from MCS: ref #677103
2016-04-22 06:19:29 [DEBUG   ] summary = ERROR
2016-04-22 06:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677103  13 57500 22769958 A  ERRORERROR'
2016-04-22 06:19:29 [DEBUG   ] Got command RPT from MCS: ref #677104
2016-04-22 06:19:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677104  77 57500 22769958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:19:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:19:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:20:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:20:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:20:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:20:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:20:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:20:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 06:20:14 [DEBUG   ] Finished updating board flags in 2.046 seconds
2016-04-22 06:20:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:20:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:20:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:21:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:21:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:21:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:21:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:21:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:21:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 06:21:14 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 06:21:14 [DEBUG   ] Finished updating board flags in 1.907 seconds
2016-04-22 06:21:15 [DEBUG   ] Finished updating ant stats in 1.184 seconds
2016-04-22 06:21:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 06:21:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 06:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:22:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:22:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:22:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:22:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:22:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:22:14 [DEBUG   ] Finished updating board flags in 1.808 seconds
2016-04-22 06:22:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 06:22:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 06:22:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 06:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:23:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:23:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:23:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:23:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:23:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:23:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 06:23:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 06:23:15 [DEBUG   ] Finished updating board flags in 2.711 seconds
2016-04-22 06:23:29 [DEBUG   ] Got command RPT from MCS: ref #677126
2016-04-22 06:23:29 [DEBUG   ] summary = ERROR
2016-04-22 06:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677126  13 57500 23009254 A  ERRORERROR'
2016-04-22 06:23:29 [DEBUG   ] Got command RPT from MCS: ref #677127
2016-04-22 06:23:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677127  77 57500 23009458 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:23:29 [DEBUG   ] Got command RPT from MCS: ref #677128
2016-04-22 06:23:29 [DEBUG   ] summary = ERROR
2016-04-22 06:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677128  13 57500 23009662 A  ERRORERROR'
2016-04-22 06:23:29 [DEBUG   ] Got command RPT from MCS: ref #677129
2016-04-22 06:23:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677129  77 57500 23009854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:23:30 [DEBUG   ] Got command RPT from MCS: ref #677130
2016-04-22 06:23:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 06:23:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677130  12 57500 23010058 A  ERRORB”™š'
2016-04-22 06:23:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 06:23:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 06:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:24:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:24:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:24:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:24:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:24:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:24:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 06:24:14 [DEBUG   ] Finished updating board flags in 1.701 seconds
2016-04-22 06:24:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 06:24:29 [DEBUG   ] Got command RPT from MCS: ref #677131
2016-04-22 06:24:29 [DEBUG   ] summary = ERROR
2016-04-22 06:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677131  13 57500 23069962 A  ERRORERROR'
2016-04-22 06:24:29 [DEBUG   ] Got command RPT from MCS: ref #677132
2016-04-22 06:24:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677132  77 57500 23069962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:24:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 06:24:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 06:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:25:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2016-04-22 06:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:25:14 [DEBUG   ] Finished updating board flags in 1.650 seconds
2016-04-22 06:25:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 06:25:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 06:25:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 06:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:26:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-22 06:26:15 [DEBUG   ] Finished updating board flags in 2.208 seconds
2016-04-22 06:26:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 06:26:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 06:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:27:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 06:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:27:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 06:27:14 [DEBUG   ] Finished updating board flags in 1.519 seconds
2016-04-22 06:27:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 06:27:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 06:27:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 06:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:28:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 06:28:14 [DEBUG   ] Finished updating board flags in 1.410 seconds
2016-04-22 06:28:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 06:28:29 [DEBUG   ] Got command RPT from MCS: ref #677152
2016-04-22 06:28:29 [DEBUG   ] summary = ERROR
2016-04-22 06:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677152  13 57500 23309354 A  ERRORERROR'
2016-04-22 06:28:29 [DEBUG   ] Got command RPT from MCS: ref #677153
2016-04-22 06:28:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677153  77 57500 23309546 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:28:29 [DEBUG   ] Got command RPT from MCS: ref #677154
2016-04-22 06:28:29 [DEBUG   ] summary = ERROR
2016-04-22 06:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677154  13 57500 23309750 A  ERRORERROR'
2016-04-22 06:28:29 [DEBUG   ] Got command RPT from MCS: ref #677155
2016-04-22 06:28:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677155  77 57500 23309954 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:28:30 [DEBUG   ] Got command RPT from MCS: ref #677156
2016-04-22 06:28:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 06:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677156  12 57500 23310158 A  ERRORB”™š'
2016-04-22 06:28:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 06:28:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 06:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:29:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 06:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:29:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 06:29:14 [DEBUG   ] Finished updating board flags in 1.567 seconds
2016-04-22 06:29:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 06:29:29 [DEBUG   ] Got command RPT from MCS: ref #677165
2016-04-22 06:29:29 [DEBUG   ] summary = ERROR
2016-04-22 06:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677165  13 57500 23369958 A  ERRORERROR'
2016-04-22 06:29:29 [DEBUG   ] Got command RPT from MCS: ref #677166
2016-04-22 06:29:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677166  77 57500 23369958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:29:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 06:29:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 06:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:30:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 06:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:30:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 06:30:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 06:30:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2016-04-22 06:30:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 06:30:15 [DEBUG   ] Finished updating board flags in 2.113 seconds
2016-04-22 06:30:35 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2016-04-22 06:30:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 06:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:31:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:31:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:31:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:31:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:31:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:31:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2016-04-22 06:31:15 [DEBUG   ] Finished updating board flags in 2.148 seconds
2016-04-22 06:31:16 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 06:31:36 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-22 06:31:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 06:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:32:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:32:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:32:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:32:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:32:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:32:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 06:32:15 [DEBUG   ] Finished updating board flags in 2.036 seconds
2016-04-22 06:32:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:32:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:32:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:33:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2016-04-22 06:33:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:33:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:33:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:33:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:33:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:33:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 06:33:15 [DEBUG   ] Finished updating board flags in 1.981 seconds
2016-04-22 06:33:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 06:33:29 [DEBUG   ] Got command RPT from MCS: ref #677185
2016-04-22 06:33:29 [DEBUG   ] summary = ERROR
2016-04-22 06:33:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677185  13 57500 23609422 A  ERRORERROR'
2016-04-22 06:33:29 [DEBUG   ] Got command RPT from MCS: ref #677186
2016-04-22 06:33:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:33:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677186  77 57500 23609626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:33:29 [DEBUG   ] Got command RPT from MCS: ref #677187
2016-04-22 06:33:29 [DEBUG   ] summary = ERROR
2016-04-22 06:33:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677187  13 57500 23609830 A  ERRORERROR'
2016-04-22 06:33:30 [DEBUG   ] Got command RPT from MCS: ref #677188
2016-04-22 06:33:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677188  77 57500 23610034 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:33:30 [DEBUG   ] Got command RPT from MCS: ref #677189
2016-04-22 06:33:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 06:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677189  12 57500 23610226 A  ERRORB”™š'
2016-04-22 06:33:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:33:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:34:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:34:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:34:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:34:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:34:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:34:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 06:34:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 06:34:15 [DEBUG   ] Finished updating board flags in 1.849 seconds
2016-04-22 06:34:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 06:34:29 [DEBUG   ] Got command RPT from MCS: ref #677190
2016-04-22 06:34:29 [DEBUG   ] summary = ERROR
2016-04-22 06:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677190  13 57500 23669962 A  ERRORERROR'
2016-04-22 06:34:29 [DEBUG   ] Got command RPT from MCS: ref #677191
2016-04-22 06:34:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677191  77 57500 23669962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:34:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 06:34:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:35:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:35:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:35:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:35:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:35:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:35:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 06:35:15 [DEBUG   ] Finished updating board flags in 1.816 seconds
2016-04-22 06:35:16 [DEBUG   ] Finished updating ant stats in 1.514 seconds
2016-04-22 06:35:36 [DEBUG   ] Finished updating ant stats in 1.086 seconds
2016-04-22 06:35:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 06:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:36:15 [DEBUG   ] Finished updating board flags in 1.714 seconds
2016-04-22 06:36:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 06:36:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 06:36:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 06:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:37:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 06:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:37:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 06:37:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 06:37:15 [DEBUG   ] Finished updating board flags in 1.610 seconds
2016-04-22 06:37:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 06:37:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 06:37:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 06:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:38:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:38:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:38:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:38:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:38:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:38:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 06:38:15 [DEBUG   ] Finished updating board flags in 1.600 seconds
2016-04-22 06:38:16 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2016-04-22 06:38:29 [DEBUG   ] Got command RPT from MCS: ref #677214
2016-04-22 06:38:29 [DEBUG   ] summary = ERROR
2016-04-22 06:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677214  13 57500 23909534 A  ERRORERROR'
2016-04-22 06:38:29 [DEBUG   ] Got command RPT from MCS: ref #677215
2016-04-22 06:38:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677215  77 57500 23909738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:38:29 [DEBUG   ] Got command RPT from MCS: ref #677216
2016-04-22 06:38:29 [DEBUG   ] summary = ERROR
2016-04-22 06:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677216  13 57500 23909930 A  ERRORERROR'
2016-04-22 06:38:30 [DEBUG   ] Got command RPT from MCS: ref #677217
2016-04-22 06:38:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677217  77 57500 23910134 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:38:30 [DEBUG   ] Got command RPT from MCS: ref #677218
2016-04-22 06:38:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 06:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677218  12 57500 23910338 A  ERRORB“™š'
2016-04-22 06:38:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 06:38:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 06:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:39:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 06:39:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 06:39:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 06:39:15 [DEBUG   ] Finished updating board flags in 1.600 seconds
2016-04-22 06:39:16 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2016-04-22 06:39:29 [DEBUG   ] Got command RPT from MCS: ref #677224
2016-04-22 06:39:29 [DEBUG   ] summary = ERROR
2016-04-22 06:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677224  13 57500 23969958 A  ERRORERROR'
2016-04-22 06:39:29 [DEBUG   ] Got command RPT from MCS: ref #677225
2016-04-22 06:39:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677225  77 57500 23969958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:39:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 06:39:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 06:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:40:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 06:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:40:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 06:40:15 [DEBUG   ] Finished updating board flags in 1.607 seconds
2016-04-22 06:40:16 [DEBUG   ] Finished updating ant stats in 0.849 seconds
2016-04-22 06:40:36 [DEBUG   ] Finished updating ant stats in 0.550 seconds
2016-04-22 06:40:57 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 06:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:41:15 [DEBUG   ] Finished updating board flags in 1.549 seconds
2016-04-22 06:41:17 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 06:41:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 06:41:57 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 06:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:42:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 06:42:15 [DEBUG   ] Finished updating board flags in 1.412 seconds
2016-04-22 06:42:17 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2016-04-22 06:42:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 06:42:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 06:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:43:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2016-04-22 06:43:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 06:43:15 [DEBUG   ] Finished updating board flags in 1.377 seconds
2016-04-22 06:43:17 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2016-04-22 06:43:29 [DEBUG   ] Got command RPT from MCS: ref #677244
2016-04-22 06:43:29 [DEBUG   ] summary = ERROR
2016-04-22 06:43:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677244  13 57500 24209634 A  ERRORERROR'
2016-04-22 06:43:29 [DEBUG   ] Got command RPT from MCS: ref #677245
2016-04-22 06:43:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:43:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677245  77 57500 24209838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:43:30 [DEBUG   ] Got command RPT from MCS: ref #677246
2016-04-22 06:43:30 [DEBUG   ] summary = ERROR
2016-04-22 06:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677246  13 57500 24210042 A  ERRORERROR'
2016-04-22 06:43:30 [DEBUG   ] Got command RPT from MCS: ref #677247
2016-04-22 06:43:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677247  77 57500 24210246 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:43:30 [DEBUG   ] Got command RPT from MCS: ref #677248
2016-04-22 06:43:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 06:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677248  12 57500 24210438 A  ERRORB”™š'
2016-04-22 06:43:37 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2016-04-22 06:43:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 06:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:44:15 [DEBUG   ] Finished updating board flags in 1.369 seconds
2016-04-22 06:44:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 06:44:29 [DEBUG   ] Got command RPT from MCS: ref #677252
2016-04-22 06:44:29 [DEBUG   ] summary = ERROR
2016-04-22 06:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677252  13 57500 24269958 A  ERRORERROR'
2016-04-22 06:44:29 [DEBUG   ] Got command RPT from MCS: ref #677253
2016-04-22 06:44:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677253  77 57500 24269958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:44:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-22 06:44:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 06:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:45:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:45:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:45:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:45:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:45:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:45:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 06:45:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 06:45:16 [DEBUG   ] Finished updating board flags in 2.056 seconds
2016-04-22 06:45:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 06:45:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 06:45:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 06:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:46:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:46:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:46:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:46:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:46:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:46:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 06:46:16 [DEBUG   ] Finished updating board flags in 2.047 seconds
2016-04-22 06:46:18 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2016-04-22 06:46:38 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 06:46:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-22 06:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:47:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:47:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:47:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:47:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:47:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:47:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 06:47:16 [DEBUG   ] Finished updating board flags in 1.942 seconds
2016-04-22 06:47:18 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2016-04-22 06:47:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 06:47:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 06:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:48:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2016-04-22 06:48:16 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 06:48:16 [DEBUG   ] Finished updating board flags in 1.818 seconds
2016-04-22 06:48:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 06:48:29 [DEBUG   ] Got command RPT from MCS: ref #677273
2016-04-22 06:48:29 [DEBUG   ] summary = ERROR
2016-04-22 06:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677273  13 57500 24509722 A  ERRORERROR'
2016-04-22 06:48:29 [DEBUG   ] Got command RPT from MCS: ref #677274
2016-04-22 06:48:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677274  77 57500 24509926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:48:30 [DEBUG   ] Got command RPT from MCS: ref #677275
2016-04-22 06:48:30 [DEBUG   ] summary = ERROR
2016-04-22 06:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677275  13 57500 24510118 A  ERRORERROR'
2016-04-22 06:48:30 [DEBUG   ] Got command RPT from MCS: ref #677276
2016-04-22 06:48:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677276  77 57500 24510322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:48:30 [DEBUG   ] Got command RPT from MCS: ref #677277
2016-04-22 06:48:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 06:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677277  12 57500 24510526 A  ERRORB”™š'
2016-04-22 06:48:38 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2016-04-22 06:48:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 06:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:49:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 06:49:16 [DEBUG   ] Finished updating board flags in 1.788 seconds
2016-04-22 06:49:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 06:49:29 [DEBUG   ] Got command RPT from MCS: ref #677283
2016-04-22 06:49:29 [DEBUG   ] summary = ERROR
2016-04-22 06:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677283  13 57500 24569966 A  ERRORERROR'
2016-04-22 06:49:29 [DEBUG   ] Got command RPT from MCS: ref #677284
2016-04-22 06:49:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677284  77 57500 24569966 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:49:38 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-22 06:49:58 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-22 06:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:50:16 [DEBUG   ] Finished updating board flags in 1.621 seconds
2016-04-22 06:50:18 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2016-04-22 06:50:38 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-22 06:50:59 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 06:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:51:16 [DEBUG   ] Finished updating board flags in 1.585 seconds
2016-04-22 06:51:19 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-22 06:51:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:51:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 06:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:52:16 [DEBUG   ] Finished updating board flags in 1.414 seconds
2016-04-22 06:52:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:52:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 06:52:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 06:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:53:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 06:53:16 [DEBUG   ] Finished updating board flags in 1.449 seconds
2016-04-22 06:53:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 06:53:29 [DEBUG   ] Got command RPT from MCS: ref #677306
2016-04-22 06:53:29 [DEBUG   ] summary = ERROR
2016-04-22 06:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677306  13 57500 24809838 A  ERRORERROR'
2016-04-22 06:53:30 [DEBUG   ] Got command RPT from MCS: ref #677307
2016-04-22 06:53:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677307  77 57500 24810045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:53:30 [DEBUG   ] Got command RPT from MCS: ref #677308
2016-04-22 06:53:30 [DEBUG   ] summary = ERROR
2016-04-22 06:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677308  13 57500 24810234 A  ERRORERROR'
2016-04-22 06:53:30 [DEBUG   ] Got command RPT from MCS: ref #677309
2016-04-22 06:53:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677309  77 57500 24810438 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:53:30 [DEBUG   ] Got command RPT from MCS: ref #677310
2016-04-22 06:53:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 06:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677310  12 57500 24810642 A  ERRORB”™š'
2016-04-22 06:53:39 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2016-04-22 06:53:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 06:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:54:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2016-04-22 06:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:54:16 [DEBUG   ] Finished updating board flags in 1.433 seconds
2016-04-22 06:54:19 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-22 06:54:29 [DEBUG   ] Got command RPT from MCS: ref #677311
2016-04-22 06:54:29 [DEBUG   ] summary = ERROR
2016-04-22 06:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677311  13 57500 24869966 A  ERRORERROR'
2016-04-22 06:54:29 [DEBUG   ] Got command RPT from MCS: ref #677312
2016-04-22 06:54:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677312  77 57500 24869966 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:54:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 06:54:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 06:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:55:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 06:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:55:16 [DEBUG   ] Finished updating board flags in 1.499 seconds
2016-04-22 06:55:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 06:55:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 06:55:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 06:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:56:16 [DEBUG   ] Finished updating board flags in 1.423 seconds
2016-04-22 06:56:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 06:56:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 06:56:59 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 06:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:57:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:57:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:57:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:57:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:57:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:57:17 [DEBUG   ] Finished updating board flags in 2.272 seconds
2016-04-22 06:57:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 06:57:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 06:57:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 06:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:58:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:58:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:58:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:58:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:58:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:58:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 06:58:17 [DEBUG   ] Finished updating board flags in 2.248 seconds
2016-04-22 06:58:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 06:58:29 [DEBUG   ] Got command RPT from MCS: ref #677332
2016-04-22 06:58:29 [DEBUG   ] summary = ERROR
2016-04-22 06:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677332  13 57500 25109922 A  ERRORERROR'
2016-04-22 06:58:30 [DEBUG   ] Got command RPT from MCS: ref #677333
2016-04-22 06:58:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:58:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677333  77 57500 25110114 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:58:30 [DEBUG   ] Got command RPT from MCS: ref #677334
2016-04-22 06:58:30 [DEBUG   ] summary = ERROR
2016-04-22 06:58:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677334  13 57500 25110327 A  ERRORERROR'
2016-04-22 06:58:30 [DEBUG   ] Got command RPT from MCS: ref #677335
2016-04-22 06:58:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:58:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677335  77 57500 25110518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:58:30 [DEBUG   ] Got command RPT from MCS: ref #677336
2016-04-22 06:58:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 06:58:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677336  12 57500 25110722 A  ERRORB”™š'
2016-04-22 06:58:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 06:58:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 06:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 06:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 06:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 06:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 06:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 06:59:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 06:59:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 06:59:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 06:59:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 06:59:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 06:59:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 06:59:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 06:59:17 [DEBUG   ] Finished updating board flags in 2.088 seconds
2016-04-22 06:59:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 06:59:29 [DEBUG   ] Got command RPT from MCS: ref #677345
2016-04-22 06:59:29 [DEBUG   ] summary = ERROR
2016-04-22 06:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677345  13 57500 25169970 A  ERRORERROR'
2016-04-22 06:59:29 [DEBUG   ] Got command RPT from MCS: ref #677346
2016-04-22 06:59:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 06:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677346  77 57500 25169970 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 06:59:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 06:59:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:00:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2016-04-22 07:00:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 07:00:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:00:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:00:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:00:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:00:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:00:17 [DEBUG   ] Finished updating board flags in 1.999 seconds
2016-04-22 07:00:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 07:00:39 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-22 07:00:59 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-22 07:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:01:17 [DEBUG   ] Finished updating board flags in 1.811 seconds
2016-04-22 07:01:19 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 07:01:40 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 07:02:00 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-22 07:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:02:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:02:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:02:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:02:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:02:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:02:17 [DEBUG   ] Finished updating board flags in 1.777 seconds
2016-04-22 07:02:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 07:02:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 07:03:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 07:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:03:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 07:03:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:03:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:03:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:03:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:03:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:03:17 [DEBUG   ] Finished updating board flags in 1.626 seconds
2016-04-22 07:03:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 07:03:30 [DEBUG   ] Got command RPT from MCS: ref #677365
2016-04-22 07:03:30 [DEBUG   ] summary = ERROR
2016-04-22 07:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677365  13 57500 25410002 A  ERRORERROR'
2016-04-22 07:03:30 [DEBUG   ] Got command RPT from MCS: ref #677366
2016-04-22 07:03:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677366  77 57500 25410206 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:03:30 [DEBUG   ] Got command RPT from MCS: ref #677367
2016-04-22 07:03:30 [DEBUG   ] summary = ERROR
2016-04-22 07:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677367  13 57500 25410410 A  ERRORERROR'
2016-04-22 07:03:30 [DEBUG   ] Got command RPT from MCS: ref #677368
2016-04-22 07:03:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677368  77 57500 25410614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:03:30 [DEBUG   ] Got command RPT from MCS: ref #677369
2016-04-22 07:03:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 07:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677369  12 57500 25410806 A  ERRORB”™š'
2016-04-22 07:03:40 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2016-04-22 07:04:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 07:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:04:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:04:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:04:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:04:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:04:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:04:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 07:04:17 [DEBUG   ] Finished updating board flags in 1.587 seconds
2016-04-22 07:04:20 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-22 07:04:29 [DEBUG   ] Got command RPT from MCS: ref #677370
2016-04-22 07:04:29 [DEBUG   ] summary = ERROR
2016-04-22 07:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677370  13 57500 25469971 A  ERRORERROR'
2016-04-22 07:04:29 [DEBUG   ] Got command RPT from MCS: ref #677371
2016-04-22 07:04:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677371  77 57500 25469972 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:04:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 07:05:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:05:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 07:05:17 [DEBUG   ] Finished updating board flags in 1.415 seconds
2016-04-22 07:05:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 07:05:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 07:06:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 07:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:06:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 07:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:06:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2016-04-22 07:06:17 [DEBUG   ] Finished updating board flags in 1.393 seconds
2016-04-22 07:06:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:06:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:07:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:07:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:07:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:07:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:07:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:07:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:07:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 07:07:18 [DEBUG   ] Finished updating board flags in 2.315 seconds
2016-04-22 07:07:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 07:07:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:08:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:08:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 07:08:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:08:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:08:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:08:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:08:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:08:18 [DEBUG   ] Finished updating board flags in 2.083 seconds
2016-04-22 07:08:20 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2016-04-22 07:08:30 [DEBUG   ] Got command RPT from MCS: ref #677394
2016-04-22 07:08:30 [DEBUG   ] summary = ERROR
2016-04-22 07:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677394  13 57500 25710102 A  ERRORERROR'
2016-04-22 07:08:30 [DEBUG   ] Got command RPT from MCS: ref #677395
2016-04-22 07:08:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677395  77 57500 25710294 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:08:30 [DEBUG   ] Got command RPT from MCS: ref #677396
2016-04-22 07:08:30 [DEBUG   ] summary = ERROR
2016-04-22 07:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677396  13 57500 25710498 A  ERRORERROR'
2016-04-22 07:08:30 [DEBUG   ] Got command RPT from MCS: ref #677397
2016-04-22 07:08:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677397  77 57500 25710702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:08:30 [DEBUG   ] Got command RPT from MCS: ref #677398
2016-04-22 07:08:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 07:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677398  12 57500 25710906 A  ERRORB”™š'
2016-04-22 07:08:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 07:09:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:09:18 [DEBUG   ] Finished updating board flags in 2.017 seconds
2016-04-22 07:09:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 07:09:29 [DEBUG   ] Got command RPT from MCS: ref #677404
2016-04-22 07:09:29 [DEBUG   ] summary = ERROR
2016-04-22 07:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677404  13 57500 25769974 A  ERRORERROR'
2016-04-22 07:09:29 [DEBUG   ] Got command RPT from MCS: ref #677405
2016-04-22 07:09:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677405  77 57500 25769974 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:09:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 07:10:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 07:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:10:17 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 07:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:10:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 07:10:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 07:10:18 [DEBUG   ] Finished updating board flags in 2.031 seconds
2016-04-22 07:10:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:10:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:11:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:11:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:11:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:11:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:11:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:11:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:11:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 07:11:18 [DEBUG   ] Finished updating board flags in 1.960 seconds
2016-04-22 07:11:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 07:11:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:12:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:12:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:12:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:12:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:12:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:12:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:12:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2016-04-22 07:12:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 07:12:18 [CRITICAL] MGT underflow detected on beam(s) 1
2016-04-22 07:12:18 [DEBUG   ] Finished updating board flags in 1.836 seconds
2016-04-22 07:12:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 07:12:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 07:13:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:13:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:13:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:13:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:13:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:13:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:13:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 07:13:18 [DEBUG   ] Finished updating board flags in 1.862 seconds
2016-04-22 07:13:20 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-22 07:13:30 [DEBUG   ] Got command RPT from MCS: ref #677424
2016-04-22 07:13:30 [DEBUG   ] summary = ERROR
2016-04-22 07:13:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677424  13 57500 26010182 A  ERRORERROR'
2016-04-22 07:13:30 [DEBUG   ] Got command RPT from MCS: ref #677425
2016-04-22 07:13:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:13:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677425  77 57500 26010386 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:13:30 [DEBUG   ] Got command RPT from MCS: ref #677426
2016-04-22 07:13:30 [DEBUG   ] summary = ERROR
2016-04-22 07:13:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677426  13 57500 26010578 A  ERRORERROR'
2016-04-22 07:13:30 [DEBUG   ] Got command RPT from MCS: ref #677427
2016-04-22 07:13:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:13:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677427  77 57500 26010782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:13:30 [DEBUG   ] Got command RPT from MCS: ref #677428
2016-04-22 07:13:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 07:13:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677428  12 57500 26010986 A  ERRORB”™š'
2016-04-22 07:13:40 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 07:14:01 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2016-04-22 07:14:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:14:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:14:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:14:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:14:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:14:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-22 07:14:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 07:14:18 [DEBUG   ] Finished updating board flags in 1.707 seconds
2016-04-22 07:14:21 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 07:14:29 [DEBUG   ] Got command RPT from MCS: ref #677432
2016-04-22 07:14:29 [DEBUG   ] summary = ERROR
2016-04-22 07:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677432  13 57500 26069985 A  ERRORERROR'
2016-04-22 07:14:29 [DEBUG   ] Got command RPT from MCS: ref #677433
2016-04-22 07:14:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677433  77 57500 26069986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:14:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 07:15:01 [DEBUG   ] Finished updating ant stats in 1.534 seconds
2016-04-22 07:15:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:15:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:15:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:15:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:15:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:15:18 [DEBUG   ] Finished updating board flags in 1.605 seconds
2016-04-22 07:15:21 [DEBUG   ] Finished updating ant stats in 1.070 seconds
2016-04-22 07:15:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 07:16:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 07:16:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:16:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:16:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:16:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:16:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:16:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 07:16:18 [DEBUG   ] Finished updating board flags in 1.607 seconds
2016-04-22 07:16:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 07:16:41 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-22 07:17:01 [DEBUG   ] Finished updating ant stats in 0.874 seconds
2016-04-22 07:17:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:17:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:17:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:17:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:17:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:17:18 [DEBUG   ] Finished updating board flags in 1.593 seconds
2016-04-22 07:17:21 [DEBUG   ] Finished updating ant stats in 0.731 seconds
2016-04-22 07:17:41 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 07:18:02 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2016-04-22 07:18:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:18:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:18:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:18:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:18:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:18:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 07:18:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 07:18:18 [DEBUG   ] Finished updating board flags in 1.421 seconds
2016-04-22 07:18:21 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2016-04-22 07:18:30 [DEBUG   ] Got command RPT from MCS: ref #677453
2016-04-22 07:18:30 [DEBUG   ] summary = ERROR
2016-04-22 07:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677453  13 57500 26310262 A  ERRORERROR'
2016-04-22 07:18:30 [DEBUG   ] Got command RPT from MCS: ref #677454
2016-04-22 07:18:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677454  77 57500 26310466 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:18:30 [DEBUG   ] Got command RPT from MCS: ref #677455
2016-04-22 07:18:30 [DEBUG   ] summary = ERROR
2016-04-22 07:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677455  13 57500 26310670 A  ERRORERROR'
2016-04-22 07:18:30 [DEBUG   ] Got command RPT from MCS: ref #677456
2016-04-22 07:18:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677456  77 57500 26310866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:18:31 [DEBUG   ] Got command RPT from MCS: ref #677457
2016-04-22 07:18:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 07:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677457  12 57500 26311073 A  ERRORB“™š'
2016-04-22 07:18:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-22 07:19:02 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 07:19:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:19:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:19:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:19:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:19:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:19:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 07:19:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 07:19:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:19:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:19:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:19:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:19:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:19:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 07:19:18 [DEBUG   ] Finished updating board flags in 1.400 seconds
2016-04-22 07:19:22 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 07:19:29 [DEBUG   ] Got command RPT from MCS: ref #677463
2016-04-22 07:19:29 [DEBUG   ] summary = ERROR
2016-04-22 07:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677463  13 57500 26369985 A  ERRORERROR'
2016-04-22 07:19:29 [DEBUG   ] Got command RPT from MCS: ref #677464
2016-04-22 07:19:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677464  77 57500 26369985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:19:42 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 07:20:02 [DEBUG   ] Finished updating ant stats in 1.359 seconds
2016-04-22 07:20:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:20:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:20:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:20:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:20:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:20:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-22 07:20:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:20:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:20:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:20:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:20:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:20:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 07:20:19 [DEBUG   ] Finished updating board flags in 2.205 seconds
2016-04-22 07:20:22 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2016-04-22 07:20:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:21:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 07:21:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:21:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:21:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:21:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:21:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:21:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 07:21:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:21:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:21:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:21:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:21:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:21:19 [DEBUG   ] Finished updating board flags in 2.179 seconds
2016-04-22 07:21:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-22 07:21:42 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-22 07:22:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 07:22:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:22:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:22:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:22:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:22:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:22:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:22:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:22:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:22:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:22:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:22:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2016-04-22 07:22:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2016-04-22 07:22:19 [DEBUG   ] Finished updating board flags in 2.018 seconds
2016-04-22 07:22:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 07:22:42 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-22 07:23:03 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 07:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:23:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:23:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:23:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:23:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:23:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:23:19 [DEBUG   ] Finished updating board flags in 2.006 seconds
2016-04-22 07:23:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 07:23:30 [DEBUG   ] Got command RPT from MCS: ref #677486
2016-04-22 07:23:30 [DEBUG   ] summary = ERROR
2016-04-22 07:23:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677486  13 57500 26610350 A  ERRORERROR'
2016-04-22 07:23:30 [DEBUG   ] Got command RPT from MCS: ref #677487
2016-04-22 07:23:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:23:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677487  77 57500 26610542 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:23:30 [DEBUG   ] Got command RPT from MCS: ref #677488
2016-04-22 07:23:30 [DEBUG   ] summary = ERROR
2016-04-22 07:23:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677488  13 57500 26610746 A  ERRORERROR'
2016-04-22 07:23:30 [DEBUG   ] Got command RPT from MCS: ref #677489
2016-04-22 07:23:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:23:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677489  77 57500 26610950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:23:31 [DEBUG   ] Got command RPT from MCS: ref #677490
2016-04-22 07:23:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 07:23:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677490  12 57500 26611154 A  ERRORB”™š'
2016-04-22 07:23:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 07:24:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 07:24:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:24:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:24:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:24:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:24:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:24:19 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 07:24:19 [DEBUG   ] Finished updating board flags in 1.984 seconds
2016-04-22 07:24:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 07:24:29 [DEBUG   ] Got command RPT from MCS: ref #677491
2016-04-22 07:24:29 [DEBUG   ] summary = ERROR
2016-04-22 07:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677491  13 57500 26669987 A  ERRORERROR'
2016-04-22 07:24:29 [DEBUG   ] Got command RPT from MCS: ref #677492
2016-04-22 07:24:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677492  77 57500 26669988 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:24:43 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2016-04-22 07:25:03 [DEBUG   ] Finished updating ant stats in 1.125 seconds
2016-04-22 07:25:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:25:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:25:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:25:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:25:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:25:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 07:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:25:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 07:25:19 [DEBUG   ] Finished updating board flags in 1.809 seconds
2016-04-22 07:25:23 [DEBUG   ] Finished updating ant stats in 0.677 seconds
2016-04-22 07:25:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:26:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:26:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:26:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:26:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:26:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:26:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:26:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-22 07:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:26:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 07:26:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 07:26:19 [DEBUG   ] Finished updating board flags in 1.799 seconds
2016-04-22 07:26:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:26:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:27:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:27:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:27:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:27:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:27:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:27:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:27:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 07:27:19 [DEBUG   ] Finished updating board flags in 1.633 seconds
2016-04-22 07:27:23 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-22 07:27:43 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 07:28:03 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 07:28:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:28:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:28:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:28:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:28:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:28:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 07:28:19 [DEBUG   ] Finished updating board flags in 1.618 seconds
2016-04-22 07:28:24 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2016-04-22 07:28:30 [DEBUG   ] Got command RPT from MCS: ref #677512
2016-04-22 07:28:30 [DEBUG   ] summary = ERROR
2016-04-22 07:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677512  13 57500 26910438 A  ERRORERROR'
2016-04-22 07:28:30 [DEBUG   ] Got command RPT from MCS: ref #677513
2016-04-22 07:28:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677513  77 57500 26910642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:28:30 [DEBUG   ] Got command RPT from MCS: ref #677514
2016-04-22 07:28:30 [DEBUG   ] summary = ERROR
2016-04-22 07:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677514  13 57500 26910846 A  ERRORERROR'
2016-04-22 07:28:31 [DEBUG   ] Got command RPT from MCS: ref #677515
2016-04-22 07:28:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677515  77 57500 26911038 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:28:31 [DEBUG   ] Got command RPT from MCS: ref #677516
2016-04-22 07:28:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 07:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677516  12 57500 26911242 A  ERRORB”™š'
2016-04-22 07:28:44 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 07:29:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 07:29:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:29:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:29:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:29:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:29:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:29:19 [DEBUG   ] Finished updating board flags in 1.551 seconds
2016-04-22 07:29:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 07:29:29 [DEBUG   ] Got command RPT from MCS: ref #677525
2016-04-22 07:29:29 [DEBUG   ] summary = ERROR
2016-04-22 07:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677525  13 57500 26969982 A  ERRORERROR'
2016-04-22 07:29:29 [DEBUG   ] Got command RPT from MCS: ref #677526
2016-04-22 07:29:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677526  77 57500 26969983 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:29:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 07:30:04 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-22 07:30:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:30:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:30:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:30:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:30:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:30:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:30:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:30:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:30:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:30:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:30:19 [DEBUG   ] Finished updating board flags in 1.421 seconds
2016-04-22 07:30:24 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2016-04-22 07:30:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 07:31:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 07:31:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:31:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:31:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:31:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:31:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:31:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:31:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:31:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:31:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:31:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:31:19 [DEBUG   ] Finished updating board flags in 1.383 seconds
2016-04-22 07:31:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 07:31:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 07:32:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 07:32:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:32:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:32:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:32:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:32:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:32:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:32:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:32:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:32:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:32:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:32:19 [DEBUG   ] Finished updating board flags in 1.459 seconds
2016-04-22 07:32:24 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-22 07:32:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:33:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:33:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:33:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:33:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:33:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:33:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:33:20 [DEBUG   ] Finished updating board flags in 2.200 seconds
2016-04-22 07:33:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:33:30 [DEBUG   ] Got command RPT from MCS: ref #677545
2016-04-22 07:33:30 [DEBUG   ] summary = ERROR
2016-04-22 07:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677545  13 57500 27210530 A  ERRORERROR'
2016-04-22 07:33:30 [DEBUG   ] Got command RPT from MCS: ref #677546
2016-04-22 07:33:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677546  77 57500 27210734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:33:30 [DEBUG   ] Got command RPT from MCS: ref #677547
2016-04-22 07:33:30 [DEBUG   ] summary = ERROR
2016-04-22 07:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677547  13 57500 27210926 A  ERRORERROR'
2016-04-22 07:33:31 [DEBUG   ] Got command RPT from MCS: ref #677548
2016-04-22 07:33:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677548  77 57500 27211130 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:33:31 [DEBUG   ] Got command RPT from MCS: ref #677549
2016-04-22 07:33:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 07:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677549  12 57500 27211334 A  ERRORB”™š'
2016-04-22 07:33:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 07:34:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:34:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 07:34:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 07:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:34:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 07:34:20 [DEBUG   ] Finished updating board flags in 1.948 seconds
2016-04-22 07:34:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:34:29 [DEBUG   ] Got command RPT from MCS: ref #677550
2016-04-22 07:34:29 [DEBUG   ] summary = ERROR
2016-04-22 07:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677550  13 57500 27269974 A  ERRORERROR'
2016-04-22 07:34:29 [DEBUG   ] Got command RPT from MCS: ref #677551
2016-04-22 07:34:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677551  77 57500 27269974 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:34:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:35:04 [DEBUG   ] Finished updating ant stats in 0.808 seconds
2016-04-22 07:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:35:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 07:35:19 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 07:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:35:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 07:35:20 [DEBUG   ] Finished updating board flags in 1.881 seconds
2016-04-22 07:35:24 [DEBUG   ] Finished updating ant stats in 0.793 seconds
2016-04-22 07:35:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:36:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:36:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 07:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:36:20 [DEBUG   ] Finished updating board flags in 1.733 seconds
2016-04-22 07:36:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 07:36:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 07:37:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:37:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:37:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:37:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:37:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:37:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:37:20 [DEBUG   ] Finished updating board flags in 1.615 seconds
2016-04-22 07:37:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 07:37:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 07:38:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 07:38:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:38:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:38:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:38:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:38:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:38:20 [DEBUG   ] Finished updating board flags in 1.581 seconds
2016-04-22 07:38:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:38:30 [DEBUG   ] Got command RPT from MCS: ref #677574
2016-04-22 07:38:30 [DEBUG   ] summary = ERROR
2016-04-22 07:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677574  13 57500 27510614 A  ERRORERROR'
2016-04-22 07:38:30 [DEBUG   ] Got command RPT from MCS: ref #677575
2016-04-22 07:38:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677575  77 57500 27510818 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:38:31 [DEBUG   ] Got command RPT from MCS: ref #677576
2016-04-22 07:38:31 [DEBUG   ] summary = ERROR
2016-04-22 07:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677576  13 57500 27511022 A  ERRORERROR'
2016-04-22 07:38:31 [DEBUG   ] Got command RPT from MCS: ref #677577
2016-04-22 07:38:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677577  77 57500 27511214 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:38:31 [DEBUG   ] Got command RPT from MCS: ref #677578
2016-04-22 07:38:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 07:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677578  12 57500 27511622 A  ERRORB“™š'
2016-04-22 07:38:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:39:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 07:39:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:39:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:39:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:39:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:39:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:39:20 [DEBUG   ] Finished updating board flags in 1.421 seconds
2016-04-22 07:39:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:39:29 [DEBUG   ] Got command RPT from MCS: ref #677584
2016-04-22 07:39:29 [DEBUG   ] summary = ERROR
2016-04-22 07:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677584  13 57500 27569982 A  ERRORERROR'
2016-04-22 07:39:29 [DEBUG   ] Got command RPT from MCS: ref #677585
2016-04-22 07:39:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677585  77 57500 27569982 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:39:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:40:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:40:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:40:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:40:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:40:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:40:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:40:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 07:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:40:20 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 07:40:20 [DEBUG   ] Finished updating board flags in 1.579 seconds
2016-04-22 07:40:24 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-22 07:40:45 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 07:41:05 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-22 07:41:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:41:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:41:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:41:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:41:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:41:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 07:41:21 [DEBUG   ] Finished updating board flags in 1.573 seconds
2016-04-22 07:41:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-22 07:41:45 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-22 07:42:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 07:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:42:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2016-04-22 07:42:21 [DEBUG   ] Finished updating board flags in 2.142 seconds
2016-04-22 07:42:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 07:42:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 07:43:05 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-22 07:43:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:43:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:43:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:43:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:43:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:43:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 07:43:21 [DEBUG   ] Finished updating board flags in 1.888 seconds
2016-04-22 07:43:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:43:30 [DEBUG   ] Got command RPT from MCS: ref #677604
2016-04-22 07:43:30 [DEBUG   ] summary = ERROR
2016-04-22 07:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677604  13 57500 27810706 A  ERRORERROR'
2016-04-22 07:43:30 [DEBUG   ] Got command RPT from MCS: ref #677605
2016-04-22 07:43:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677605  77 57500 27810910 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:43:31 [DEBUG   ] Got command RPT from MCS: ref #677606
2016-04-22 07:43:31 [DEBUG   ] summary = ERROR
2016-04-22 07:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677606  13 57500 27811102 A  ERRORERROR'
2016-04-22 07:43:31 [DEBUG   ] Got command RPT from MCS: ref #677607
2016-04-22 07:43:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677607  77 57500 27811306 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:43:31 [DEBUG   ] Got command RPT from MCS: ref #677608
2016-04-22 07:43:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 07:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677608  12 57500 27811510 A  ERRORB”™š'
2016-04-22 07:43:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 07:44:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-22 07:44:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:44:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:44:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:44:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:44:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:44:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 07:44:21 [DEBUG   ] Finished updating board flags in 1.769 seconds
2016-04-22 07:44:25 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-22 07:44:29 [DEBUG   ] Got command RPT from MCS: ref #677612
2016-04-22 07:44:29 [DEBUG   ] summary = ERROR
2016-04-22 07:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677612  13 57500 27869978 A  ERRORERROR'
2016-04-22 07:44:29 [DEBUG   ] Got command RPT from MCS: ref #677613
2016-04-22 07:44:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677613  77 57500 27869978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:44:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 07:45:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 07:45:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:45:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:45:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:45:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:45:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:45:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 07:45:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 07:45:21 [DEBUG   ] Finished updating board flags in 1.574 seconds
2016-04-22 07:45:26 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 07:45:46 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 07:46:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 07:46:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:46:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:46:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:46:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:46:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:46:21 [DEBUG   ] Finished updating board flags in 1.410 seconds
2016-04-22 07:46:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 07:46:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:47:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 07:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:47:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 07:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:47:21 [DEBUG   ] Finished updating board flags in 1.394 seconds
2016-04-22 07:47:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 07:47:46 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-22 07:48:06 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-22 07:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:48:22 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 07:48:22 [DEBUG   ] Finished updating board flags in 2.205 seconds
2016-04-22 07:48:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:48:30 [DEBUG   ] Got command RPT from MCS: ref #677633
2016-04-22 07:48:30 [DEBUG   ] summary = ERROR
2016-04-22 07:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677633  13 57500 28110806 A  ERRORERROR'
2016-04-22 07:48:31 [DEBUG   ] Got command RPT from MCS: ref #677634
2016-04-22 07:48:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677634  77 57500 28111010 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:48:31 [DEBUG   ] Got command RPT from MCS: ref #677635
2016-04-22 07:48:31 [DEBUG   ] summary = ERROR
2016-04-22 07:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677635  13 57500 28111214 A  ERRORERROR'
2016-04-22 07:48:31 [DEBUG   ] Got command RPT from MCS: ref #677636
2016-04-22 07:48:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677636  77 57500 28111418 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:48:31 [DEBUG   ] Got command RPT from MCS: ref #677637
2016-04-22 07:48:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 07:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677637  12 57500 28111610 A  ERRORB”™š'
2016-04-22 07:48:46 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2016-04-22 07:49:06 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-22 07:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:49:22 [DEBUG   ] Finished updating board flags in 2.185 seconds
2016-04-22 07:49:27 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 07:49:29 [DEBUG   ] Got command RPT from MCS: ref #677643
2016-04-22 07:49:29 [DEBUG   ] summary = ERROR
2016-04-22 07:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677643  13 57500 28169978 A  ERRORERROR'
2016-04-22 07:49:29 [DEBUG   ] Got command RPT from MCS: ref #677644
2016-04-22 07:49:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677644  77 57500 28169978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:49:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 07:50:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 07:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:50:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 07:50:22 [DEBUG   ] Finished updating board flags in 2.015 seconds
2016-04-22 07:50:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 07:50:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 07:51:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-22 07:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:51:22 [DEBUG   ] Finished updating board flags in 2.010 seconds
2016-04-22 07:51:27 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-22 07:51:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 07:52:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 07:52:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:52:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:52:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:52:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:52:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:52:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 07:52:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 07:52:22 [DEBUG   ] Finished updating board flags in 1.996 seconds
2016-04-22 07:52:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 07:52:47 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-22 07:53:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:53:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:53:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:53:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:53:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:53:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:53:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 07:53:22 [DEBUG   ] Finished updating board flags in 1.807 seconds
2016-04-22 07:53:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:53:30 [DEBUG   ] Got command RPT from MCS: ref #677666
2016-04-22 07:53:30 [DEBUG   ] summary = ERROR
2016-04-22 07:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677666  13 57500 28410890 A  ERRORERROR'
2016-04-22 07:53:31 [DEBUG   ] Got command RPT from MCS: ref #677667
2016-04-22 07:53:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677667  77 57500 28411094 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:53:31 [DEBUG   ] Got command RPT from MCS: ref #677668
2016-04-22 07:53:31 [DEBUG   ] summary = ERROR
2016-04-22 07:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677668  13 57500 28411298 A  ERRORERROR'
2016-04-22 07:53:31 [DEBUG   ] Got command RPT from MCS: ref #677669
2016-04-22 07:53:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677669  77 57500 28411502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:53:31 [DEBUG   ] Got command RPT from MCS: ref #677670
2016-04-22 07:53:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 07:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677670  12 57500 28411694 A  ERRORB”™š'
2016-04-22 07:53:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 07:54:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:54:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:54:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:54:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:54:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:54:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:54:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 07:54:22 [DEBUG   ] Finished updating board flags in 1.793 seconds
2016-04-22 07:54:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:54:29 [DEBUG   ] Got command RPT from MCS: ref #677671
2016-04-22 07:54:29 [DEBUG   ] summary = ERROR
2016-04-22 07:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677671  13 57500 28469978 A  ERRORERROR'
2016-04-22 07:54:29 [DEBUG   ] Got command RPT from MCS: ref #677672
2016-04-22 07:54:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677672  77 57500 28469978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:54:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:55:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:55:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:55:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:55:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:55:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:55:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:55:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 07:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:55:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2016-04-22 07:55:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 07:55:22 [DEBUG   ] Finished updating board flags in 1.681 seconds
2016-04-22 07:55:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:55:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:56:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 07:56:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:56:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:56:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:56:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:56:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:56:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 07:56:22 [DEBUG   ] Finished updating board flags in 1.553 seconds
2016-04-22 07:56:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 07:56:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:57:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:57:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:57:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:57:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:57:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:57:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:57:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 07:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:57:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 07:57:22 [DEBUG   ] Finished updating board flags in 1.445 seconds
2016-04-22 07:57:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 07:57:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 07:58:07 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2016-04-22 07:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:58:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 07:58:22 [DEBUG   ] Finished updating board flags in 1.449 seconds
2016-04-22 07:58:27 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 07:58:30 [DEBUG   ] Got command RPT from MCS: ref #677692
2016-04-22 07:58:30 [DEBUG   ] summary = ERROR
2016-04-22 07:58:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677692  13 57500 28710998 A  ERRORERROR'
2016-04-22 07:58:31 [DEBUG   ] Got command RPT from MCS: ref #677693
2016-04-22 07:58:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677693  77 57500 28711190 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:58:31 [DEBUG   ] Got command RPT from MCS: ref #677694
2016-04-22 07:58:31 [DEBUG   ] summary = ERROR
2016-04-22 07:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677694  13 57500 28711394 A  ERRORERROR'
2016-04-22 07:58:31 [DEBUG   ] Got command RPT from MCS: ref #677695
2016-04-22 07:58:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677695  77 57500 28711598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:58:31 [DEBUG   ] Got command RPT from MCS: ref #677696
2016-04-22 07:58:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 07:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677696  12 57500 28711802 A  ERRORB”™š'
2016-04-22 07:58:47 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 07:59:08 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2016-04-22 07:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 07:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 07:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 07:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 07:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 07:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 07:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 07:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 07:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 07:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 07:59:22 [DEBUG   ] Finished updating board flags in 1.480 seconds
2016-04-22 07:59:28 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 07:59:29 [DEBUG   ] Got command RPT from MCS: ref #677705
2016-04-22 07:59:29 [DEBUG   ] summary = ERROR
2016-04-22 07:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677705  13 57500 28769986 A  ERRORERROR'
2016-04-22 07:59:29 [DEBUG   ] Got command RPT from MCS: ref #677706
2016-04-22 07:59:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 07:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677706  77 57500 28769986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 07:59:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:00:08 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2016-04-22 08:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:00:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 08:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:00:23 [DEBUG   ] Finished updating board flags in 2.249 seconds
2016-04-22 08:00:28 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2016-04-22 08:00:48 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2016-04-22 08:01:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 08:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:01:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 08:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:01:23 [DEBUG   ] Finished updating board flags in 2.153 seconds
2016-04-22 08:01:28 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-22 08:01:48 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 08:02:09 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2016-04-22 08:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:02:23 [DEBUG   ] Finished updating board flags in 2.022 seconds
2016-04-22 08:02:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 08:02:49 [DEBUG   ] Finished updating ant stats in 1.137 seconds
2016-04-22 08:03:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:03:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:03:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:03:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:03:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:03:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:03:23 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 08:03:23 [DEBUG   ] Finished updating board flags in 1.973 seconds
2016-04-22 08:03:29 [DEBUG   ] Finished updating ant stats in 0.711 seconds
2016-04-22 08:03:31 [DEBUG   ] Got command RPT from MCS: ref #677725
2016-04-22 08:03:31 [DEBUG   ] summary = ERROR
2016-04-22 08:03:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677725  13 57500 29011107 A  ERRORERROR'
2016-04-22 08:03:31 [DEBUG   ] Got command RPT from MCS: ref #677726
2016-04-22 08:03:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:03:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677726  77 57500 29011315 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:03:31 [DEBUG   ] Got command RPT from MCS: ref #677727
2016-04-22 08:03:31 [DEBUG   ] summary = ERROR
2016-04-22 08:03:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677727  13 57500 29011698 A  ERRORERROR'
2016-04-22 08:03:31 [DEBUG   ] Got command RPT from MCS: ref #677728
2016-04-22 08:03:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:03:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677728  77 57500 29011902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:03:32 [DEBUG   ] Got command RPT from MCS: ref #677729
2016-04-22 08:03:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 08:03:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677729  12 57500 29012094 A  ERRORB”™š'
2016-04-22 08:03:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 08:04:09 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2016-04-22 08:04:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:04:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:04:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:04:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:04:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:04:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 08:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:04:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 08:04:23 [DEBUG   ] Finished updating board flags in 1.655 seconds
2016-04-22 08:04:29 [DEBUG   ] Got command RPT from MCS: ref #677730
2016-04-22 08:04:29 [DEBUG   ] summary = ERROR
2016-04-22 08:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677730  13 57500 29069982 A  ERRORERROR'
2016-04-22 08:04:29 [DEBUG   ] Got command RPT from MCS: ref #677731
2016-04-22 08:04:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677731  77 57500 29069982 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:04:30 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2016-04-22 08:04:50 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-22 08:05:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 08:05:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:05:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:05:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:05:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:05:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:05:23 [DEBUG   ] Finished updating board flags in 1.587 seconds
2016-04-22 08:05:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:05:50 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 08:06:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-22 08:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:06:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 08:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:06:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 08:06:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 08:06:23 [DEBUG   ] Finished updating board flags in 1.424 seconds
2016-04-22 08:06:30 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-22 08:06:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:07:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 08:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:07:23 [DEBUG   ] Finished updating board flags in 1.387 seconds
2016-04-22 08:07:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-22 08:07:50 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-22 08:08:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 08:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:08:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 08:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:08:23 [DEBUG   ] Finished updating board flags in 1.363 seconds
2016-04-22 08:08:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 08:08:31 [DEBUG   ] Got command RPT from MCS: ref #677754
2016-04-22 08:08:31 [DEBUG   ] summary = ERROR
2016-04-22 08:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677754  13 57500 29311178 A  ERRORERROR'
2016-04-22 08:08:31 [DEBUG   ] Got command RPT from MCS: ref #677755
2016-04-22 08:08:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677755  77 57500 29311382 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:08:31 [DEBUG   ] Got command RPT from MCS: ref #677756
2016-04-22 08:08:31 [DEBUG   ] summary = ERROR
2016-04-22 08:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677756  13 57500 29311574 A  ERRORERROR'
2016-04-22 08:08:31 [DEBUG   ] Got command RPT from MCS: ref #677757
2016-04-22 08:08:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677757  77 57500 29311778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:08:31 [DEBUG   ] Got command RPT from MCS: ref #677758
2016-04-22 08:08:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 08:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677758  12 57500 29311982 A  ERRORB”™š'
2016-04-22 08:08:50 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2016-04-22 08:09:11 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-22 08:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:09:24 [DEBUG   ] Finished updating board flags in 2.048 seconds
2016-04-22 08:09:29 [DEBUG   ] Got command RPT from MCS: ref #677764
2016-04-22 08:09:29 [DEBUG   ] summary = ERROR
2016-04-22 08:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677764  13 57500 29369978 A  ERRORERROR'
2016-04-22 08:09:29 [DEBUG   ] Got command RPT from MCS: ref #677765
2016-04-22 08:09:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677765  77 57500 29369978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:09:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 08:09:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:10:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:10:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:10:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:10:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:10:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:10:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:10:24 [DEBUG   ] Finished updating board flags in 2.015 seconds
2016-04-22 08:10:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 08:10:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:11:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:11:24 [DEBUG   ] Finished updating board flags in 2.015 seconds
2016-04-22 08:11:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:11:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:12:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 08:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:12:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2016-04-22 08:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:12:24 [DEBUG   ] Finished updating board flags in 1.973 seconds
2016-04-22 08:12:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:12:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:13:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:13:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:13:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:13:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:13:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:13:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:13:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 08:13:24 [DEBUG   ] Finished updating board flags in 1.874 seconds
2016-04-22 08:13:31 [DEBUG   ] Got command RPT from MCS: ref #677784
2016-04-22 08:13:31 [DEBUG   ] summary = ERROR
2016-04-22 08:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677784  13 57500 29611266 A  ERRORERROR'
2016-04-22 08:13:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 08:13:31 [DEBUG   ] Got command RPT from MCS: ref #677785
2016-04-22 08:13:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677785  77 57500 29611458 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:13:31 [DEBUG   ] Got command RPT from MCS: ref #677786
2016-04-22 08:13:31 [DEBUG   ] summary = ERROR
2016-04-22 08:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677786  13 57500 29611662 A  ERRORERROR'
2016-04-22 08:13:31 [DEBUG   ] Got command RPT from MCS: ref #677787
2016-04-22 08:13:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677787  77 57500 29611866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:13:32 [DEBUG   ] Got command RPT from MCS: ref #677788
2016-04-22 08:13:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 08:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677788  12 57500 29612070 A  ERRORB”™š'
2016-04-22 08:13:51 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-22 08:14:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:14:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:14:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:14:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:14:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:14:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:14:24 [DEBUG   ] Finished updating board flags in 1.722 seconds
2016-04-22 08:14:29 [DEBUG   ] Got command RPT from MCS: ref #677792
2016-04-22 08:14:29 [DEBUG   ] summary = ERROR
2016-04-22 08:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677792  13 57500 29669986 A  ERRORERROR'
2016-04-22 08:14:29 [DEBUG   ] Got command RPT from MCS: ref #677793
2016-04-22 08:14:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677793  77 57500 29669986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:14:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:14:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 08:15:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 08:15:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:15:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:15:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:15:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:15:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:15:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 08:15:24 [DEBUG   ] Finished updating board flags in 1.631 seconds
2016-04-22 08:15:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 08:15:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 08:16:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 08:16:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:16:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:16:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:16:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:16:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:16:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 08:16:24 [DEBUG   ] Finished updating board flags in 1.598 seconds
2016-04-22 08:16:31 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-22 08:16:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 08:17:11 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-22 08:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:17:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2016-04-22 08:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:17:24 [DEBUG   ] Finished updating board flags in 1.425 seconds
2016-04-22 08:17:32 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2016-04-22 08:17:52 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 08:18:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 08:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:18:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 08:18:24 [DEBUG   ] Finished updating board flags in 1.368 seconds
2016-04-22 08:18:31 [DEBUG   ] Got command RPT from MCS: ref #677813
2016-04-22 08:18:31 [DEBUG   ] summary = ERROR
2016-04-22 08:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677813  13 57500 29911358 A  ERRORERROR'
2016-04-22 08:18:31 [DEBUG   ] Got command RPT from MCS: ref #677814
2016-04-22 08:18:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677814  77 57500 29911562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:18:31 [DEBUG   ] Got command RPT from MCS: ref #677815
2016-04-22 08:18:31 [DEBUG   ] summary = ERROR
2016-04-22 08:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677815  13 57500 29911766 A  ERRORERROR'
2016-04-22 08:18:31 [DEBUG   ] Got command RPT from MCS: ref #677816
2016-04-22 08:18:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677816  77 57500 29911958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:18:32 [DEBUG   ] Got command RPT from MCS: ref #677817
2016-04-22 08:18:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 08:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677817  12 57500 29912162 A  ERRORB”™š'
2016-04-22 08:18:32 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-22 08:18:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:19:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:19:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2016-04-22 08:19:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 08:19:25 [DEBUG   ] Finished updating board flags in 2.212 seconds
2016-04-22 08:19:29 [DEBUG   ] Got command RPT from MCS: ref #677823
2016-04-22 08:19:29 [DEBUG   ] summary = ERROR
2016-04-22 08:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677823  13 57500 29969990 A  ERRORERROR'
2016-04-22 08:19:29 [DEBUG   ] Got command RPT from MCS: ref #677824
2016-04-22 08:19:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677824  77 57500 29969990 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:19:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:19:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 08:20:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:20:25 [DEBUG   ] Finished updating board flags in 2.191 seconds
2016-04-22 08:20:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:20:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:21:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 08:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:21:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 08:21:25 [DEBUG   ] Finished updating board flags in 2.033 seconds
2016-04-22 08:21:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 08:21:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:22:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 08:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:22:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 08:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:22:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 08:22:25 [DEBUG   ] Finished updating board flags in 1.973 seconds
2016-04-22 08:22:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 08:22:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 08:23:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:23:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 08:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:23:25 [DEBUG   ] Finished updating board flags in 1.893 seconds
2016-04-22 08:23:31 [DEBUG   ] Got command RPT from MCS: ref #677846
2016-04-22 08:23:31 [DEBUG   ] summary = ERROR
2016-04-22 08:23:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677846  13 57500 30211458 A  ERRORERROR'
2016-04-22 08:23:31 [DEBUG   ] Got command RPT from MCS: ref #677847
2016-04-22 08:23:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:23:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677847  77 57500 30211650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:23:31 [DEBUG   ] Got command RPT from MCS: ref #677848
2016-04-22 08:23:31 [DEBUG   ] summary = ERROR
2016-04-22 08:23:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677848  13 57500 30211854 A  ERRORERROR'
2016-04-22 08:23:32 [DEBUG   ] Got command RPT from MCS: ref #677849
2016-04-22 08:23:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677849  77 57500 30212058 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:23:32 [DEBUG   ] Got command RPT from MCS: ref #677850
2016-04-22 08:23:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 08:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677850  12 57500 30212250 A  ERRORB“™š'
2016-04-22 08:23:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:23:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:24:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:24:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2016-04-22 08:24:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 08:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:24:25 [DEBUG   ] Finished updating board flags in 1.734 seconds
2016-04-22 08:24:29 [DEBUG   ] Got command RPT from MCS: ref #677851
2016-04-22 08:24:29 [DEBUG   ] summary = ERROR
2016-04-22 08:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677851  13 57500 30269986 A  ERRORERROR'
2016-04-22 08:24:29 [DEBUG   ] Got command RPT from MCS: ref #677852
2016-04-22 08:24:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677852  77 57500 30269986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:24:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:24:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 08:25:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 08:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:25:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 08:25:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 08:25:25 [DEBUG   ] Finished updating board flags in 1.621 seconds
2016-04-22 08:25:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:25:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:26:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:26:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:26:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:26:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:26:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:26:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:26:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 08:26:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 08:26:25 [DEBUG   ] Finished updating board flags in 1.569 seconds
2016-04-22 08:26:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 08:26:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:27:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:27:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:27:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:27:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:27:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:27:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:27:25 [DEBUG   ] Finished updating board flags in 1.504 seconds
2016-04-22 08:27:32 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2016-04-22 08:27:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 08:28:12 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 08:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:28:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 08:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:28:25 [DEBUG   ] Finished updating board flags in 1.509 seconds
2016-04-22 08:28:31 [DEBUG   ] Got command RPT from MCS: ref #677872
2016-04-22 08:28:31 [DEBUG   ] summary = ERROR
2016-04-22 08:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677872  13 57500 30511547 A  ERRORERROR'
2016-04-22 08:28:31 [DEBUG   ] Got command RPT from MCS: ref #677873
2016-04-22 08:28:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677873  77 57500 30511750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:28:31 [DEBUG   ] Got command RPT from MCS: ref #677874
2016-04-22 08:28:31 [DEBUG   ] summary = ERROR
2016-04-22 08:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677874  13 57500 30511942 A  ERRORERROR'
2016-04-22 08:28:32 [DEBUG   ] Got command RPT from MCS: ref #677875
2016-04-22 08:28:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677875  77 57500 30512146 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:28:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 08:28:32 [DEBUG   ] Got command RPT from MCS: ref #677876
2016-04-22 08:28:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 08:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677876  12 57500 30512350 A  ERRORB”™š'
2016-04-22 08:28:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 08:29:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 08:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:29:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 08:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:29:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 08:29:26 [DEBUG   ] Finished updating board flags in 2.224 seconds
2016-04-22 08:29:29 [DEBUG   ] Got command RPT from MCS: ref #677885
2016-04-22 08:29:29 [DEBUG   ] summary = ERROR
2016-04-22 08:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677885  13 57500 30569986 A  ERRORERROR'
2016-04-22 08:29:29 [DEBUG   ] Got command RPT from MCS: ref #677886
2016-04-22 08:29:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677886  77 57500 30569986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:29:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 08:29:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 08:30:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 08:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:30:26 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 08:30:26 [DEBUG   ] Finished updating board flags in 2.236 seconds
2016-04-22 08:30:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 08:30:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 08:31:12 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 08:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:31:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 08:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:31:26 [DEBUG   ] Finished updating board flags in 2.225 seconds
2016-04-22 08:31:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 08:31:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 08:32:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 08:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:32:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 08:32:26 [DEBUG   ] Finished updating board flags in 2.097 seconds
2016-04-22 08:32:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 08:32:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 08:33:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 08:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:33:26 [DEBUG   ] Finished updating board flags in 2.027 seconds
2016-04-22 08:33:31 [DEBUG   ] Got command RPT from MCS: ref #677905
2016-04-22 08:33:31 [DEBUG   ] summary = ERROR
2016-04-22 08:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677905  13 57500 30811634 A  ERRORERROR'
2016-04-22 08:33:31 [DEBUG   ] Got command RPT from MCS: ref #677906
2016-04-22 08:33:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677906  77 57500 30811838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:33:32 [DEBUG   ] Got command RPT from MCS: ref #677907
2016-04-22 08:33:32 [DEBUG   ] summary = ERROR
2016-04-22 08:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677907  13 57500 30812042 A  ERRORERROR'
2016-04-22 08:33:32 [DEBUG   ] Got command RPT from MCS: ref #677908
2016-04-22 08:33:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677908  77 57500 30812234 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:33:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 08:33:32 [DEBUG   ] Got command RPT from MCS: ref #677909
2016-04-22 08:33:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 08:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677909  12 57500 30812438 A  ERRORB”™š'
2016-04-22 08:33:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 08:34:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 08:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:34:26 [DEBUG   ] Finished updating board flags in 2.009 seconds
2016-04-22 08:34:29 [DEBUG   ] Got command RPT from MCS: ref #677910
2016-04-22 08:34:29 [DEBUG   ] summary = ERROR
2016-04-22 08:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677910  13 57500 30869990 A  ERRORERROR'
2016-04-22 08:34:29 [DEBUG   ] Got command RPT from MCS: ref #677911
2016-04-22 08:34:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677911  77 57500 30869990 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:34:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 08:34:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 08:35:12 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 08:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:35:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 08:35:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 08:35:26 [DEBUG   ] Finished updating board flags in 1.957 seconds
2016-04-22 08:35:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 08:35:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 08:36:12 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 08:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:36:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 08:36:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 08:36:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 08:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:36:26 [DEBUG   ] Finished updating board flags in 1.888 seconds
2016-04-22 08:36:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 08:36:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 08:37:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 08:37:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:37:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:37:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:37:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:37:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:37:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2016-04-22 08:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:37:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 08:37:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 08:37:26 [DEBUG   ] Finished updating board flags in 1.816 seconds
2016-04-22 08:37:32 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2016-04-22 08:37:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 08:38:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 08:38:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:38:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:38:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:38:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:38:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:38:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 08:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:38:26 [DEBUG   ] Finished updating board flags in 1.700 seconds
2016-04-22 08:38:31 [DEBUG   ] Got command RPT from MCS: ref #677934
2016-04-22 08:38:31 [DEBUG   ] summary = ERROR
2016-04-22 08:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677934  13 57500 31111740 A  ERRORERROR'
2016-04-22 08:38:31 [DEBUG   ] Got command RPT from MCS: ref #677935
2016-04-22 08:38:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677935  77 57500 31111942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:38:32 [DEBUG   ] Got command RPT from MCS: ref #677936
2016-04-22 08:38:32 [DEBUG   ] summary = ERROR
2016-04-22 08:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677936  13 57500 31112134 A  ERRORERROR'
2016-04-22 08:38:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 08:38:32 [DEBUG   ] Got command RPT from MCS: ref #677937
2016-04-22 08:38:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677937  77 57500 31112338 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:38:32 [DEBUG   ] Got command RPT from MCS: ref #677938
2016-04-22 08:38:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 08:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677938  12 57500 31112542 A  ERRORB”™š'
2016-04-22 08:38:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 08:39:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 08:39:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:39:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:39:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:39:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:39:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:39:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 08:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:39:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 08:39:26 [DEBUG   ] Finished updating board flags in 1.617 seconds
2016-04-22 08:39:29 [DEBUG   ] Got command RPT from MCS: ref #677944
2016-04-22 08:39:29 [DEBUG   ] summary = ERROR
2016-04-22 08:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677944  13 57500 31169990 A  ERRORERROR'
2016-04-22 08:39:29 [DEBUG   ] Got command RPT from MCS: ref #677945
2016-04-22 08:39:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677945  77 57500 31169990 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:39:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 08:39:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 08:40:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 08:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:40:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 08:40:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 08:40:26 [DEBUG   ] Finished updating board flags in 1.597 seconds
2016-04-22 08:40:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 08:40:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 08:41:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 08:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:41:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2016-04-22 08:41:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 08:41:26 [DEBUG   ] Finished updating board flags in 1.454 seconds
2016-04-22 08:41:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 08:41:52 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-22 08:42:13 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2016-04-22 08:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:42:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 08:42:26 [DEBUG   ] Finished updating board flags in 1.461 seconds
2016-04-22 08:42:33 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2016-04-22 08:42:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:43:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 08:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:43:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 08:43:26 [DEBUG   ] Finished updating board flags in 1.461 seconds
2016-04-22 08:43:31 [DEBUG   ] Got command RPT from MCS: ref #677964
2016-04-22 08:43:31 [DEBUG   ] summary = ERROR
2016-04-22 08:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677964  13 57500 31411834 A  ERRORERROR'
2016-04-22 08:43:32 [DEBUG   ] Got command RPT from MCS: ref #677965
2016-04-22 08:43:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677965  77 57500 31412038 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:43:32 [DEBUG   ] Got command RPT from MCS: ref #677966
2016-04-22 08:43:32 [DEBUG   ] summary = ERROR
2016-04-22 08:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677966  13 57500 31412230 A  ERRORERROR'
2016-04-22 08:43:32 [DEBUG   ] Got command RPT from MCS: ref #677967
2016-04-22 08:43:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677967  77 57500 31412434 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:43:32 [DEBUG   ] Got command RPT from MCS: ref #677968
2016-04-22 08:43:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 08:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677968  12 57500 31412638 A  ERRORB”™š'
2016-04-22 08:43:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-22 08:43:53 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-22 08:44:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 08:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:44:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 08:44:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2016-04-22 08:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:44:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 08:44:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 08:44:26 [DEBUG   ] Finished updating board flags in 1.461 seconds
2016-04-22 08:44:29 [DEBUG   ] Got command RPT from MCS: ref #677972
2016-04-22 08:44:29 [DEBUG   ] summary = ERROR
2016-04-22 08:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677972  13 57500 31469986 A  ERRORERROR'
2016-04-22 08:44:29 [DEBUG   ] Got command RPT from MCS: ref #677973
2016-04-22 08:44:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677973  77 57500 31469986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:44:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 08:44:53 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-22 08:45:13 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-22 08:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:45:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:45:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:45:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:45:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:45:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:45:27 [DEBUG   ] Finished updating board flags in 2.186 seconds
2016-04-22 08:45:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 08:45:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 08:46:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 08:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:46:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 08:46:27 [DEBUG   ] Finished updating board flags in 2.028 seconds
2016-04-22 08:46:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 08:46:54 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2016-04-22 08:47:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 08:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:47:27 [DEBUG   ] Finished updating board flags in 1.954 seconds
2016-04-22 08:47:34 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-22 08:47:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 08:48:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 08:48:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:48:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:48:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:48:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:48:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:48:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:48:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:48:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:48:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:48:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:48:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 08:48:27 [DEBUG   ] Finished updating board flags in 1.872 seconds
2016-04-22 08:48:31 [DEBUG   ] Got command RPT from MCS: ref #677993
2016-04-22 08:48:31 [DEBUG   ] summary = ERROR
2016-04-22 08:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677993  13 57500 31711918 A  ERRORERROR'
2016-04-22 08:48:32 [DEBUG   ] Got command RPT from MCS: ref #677994
2016-04-22 08:48:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677994  77 57500 31712110 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:48:32 [DEBUG   ] Got command RPT from MCS: ref #677995
2016-04-22 08:48:32 [DEBUG   ] summary = ERROR
2016-04-22 08:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677995  13 57500 31712314 A  ERRORERROR'
2016-04-22 08:48:32 [DEBUG   ] Got command RPT from MCS: ref #677996
2016-04-22 08:48:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677996  77 57500 31712518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:48:32 [DEBUG   ] Got command RPT from MCS: ref #677997
2016-04-22 08:48:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 08:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   677997  12 57500 31712722 A  ERRORB”™š'
2016-04-22 08:48:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 08:48:54 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-22 08:49:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:49:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:49:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:49:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:49:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:49:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:49:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:49:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:49:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:49:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:49:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:49:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 08:49:27 [DEBUG   ] Finished updating board flags in 1.803 seconds
2016-04-22 08:49:29 [DEBUG   ] Got command RPT from MCS: ref #678003
2016-04-22 08:49:29 [DEBUG   ] summary = ERROR
2016-04-22 08:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678003  13 57500 31769990 A  ERRORERROR'
2016-04-22 08:49:29 [DEBUG   ] Got command RPT from MCS: ref #678004
2016-04-22 08:49:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678004  77 57500 31769990 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:49:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 08:49:54 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 08:50:14 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-22 08:50:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:50:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:50:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:50:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:50:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:50:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:50:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:50:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:50:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:50:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:50:27 [DEBUG   ] Finished updating board flags in 1.943 seconds
2016-04-22 08:50:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 08:50:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 08:51:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-22 08:51:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:51:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:51:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:51:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:51:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:51:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 08:51:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:51:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:51:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:51:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:51:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:51:27 [DEBUG   ] Finished updating board flags in 1.590 seconds
2016-04-22 08:51:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 08:51:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 08:52:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 08:52:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:52:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:52:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:52:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:52:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:52:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:52:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:52:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:52:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:52:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:52:27 [DEBUG   ] Finished updating board flags in 1.401 seconds
2016-04-22 08:52:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 08:52:54 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2016-04-22 08:53:15 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2016-04-22 08:53:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:53:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:53:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:53:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:53:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:53:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:53:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:53:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:53:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:53:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:53:27 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 08:53:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 08:53:27 [DEBUG   ] Finished updating board flags in 1.409 seconds
2016-04-22 08:53:31 [DEBUG   ] Got command RPT from MCS: ref #678026
2016-04-22 08:53:31 [DEBUG   ] summary = ERROR
2016-04-22 08:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678026  13 57500 32011994 A  ERRORERROR'
2016-04-22 08:53:32 [DEBUG   ] Got command RPT from MCS: ref #678027
2016-04-22 08:53:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:53:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678027  77 57500 32012198 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:53:32 [DEBUG   ] Got command RPT from MCS: ref #678028
2016-04-22 08:53:32 [DEBUG   ] summary = ERROR
2016-04-22 08:53:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678028  13 57500 32012391 A  ERRORERROR'
2016-04-22 08:53:32 [DEBUG   ] Got command RPT from MCS: ref #678029
2016-04-22 08:53:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:53:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678029  77 57500 32012594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:53:32 [DEBUG   ] Got command RPT from MCS: ref #678030
2016-04-22 08:53:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 08:53:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678030  12 57500 32012798 A  ERRORB”™š'
2016-04-22 08:53:35 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2016-04-22 08:53:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:54:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 08:54:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:54:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:54:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:54:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:54:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:54:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:54:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:54:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:54:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:54:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:54:27 [DEBUG   ] Finished updating board flags in 1.380 seconds
2016-04-22 08:54:29 [DEBUG   ] Got command RPT from MCS: ref #678031
2016-04-22 08:54:29 [DEBUG   ] summary = ERROR
2016-04-22 08:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678031  13 57500 32069998 A  ERRORERROR'
2016-04-22 08:54:29 [DEBUG   ] Got command RPT from MCS: ref #678032
2016-04-22 08:54:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678032  77 57500 32069998 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:54:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:54:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:55:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:55:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:55:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:55:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:55:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:55:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:55:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:55:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:55:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:55:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:55:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:55:27 [DEBUG   ] Finished updating board flags in 1.365 seconds
2016-04-22 08:55:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:55:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 08:56:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:56:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:56:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:56:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:56:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:56:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:56:27 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 08:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:56:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 08:56:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2016-04-22 08:56:28 [DEBUG   ] Finished updating board flags in 2.093 seconds
2016-04-22 08:56:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:56:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:57:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 08:57:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:57:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:57:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:57:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:57:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:57:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 08:57:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:57:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:57:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:57:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:57:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:57:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2016-04-22 08:57:28 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 08:57:28 [DEBUG   ] Finished updating board flags in 2.066 seconds
2016-04-22 08:57:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:57:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:58:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 08:58:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:58:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:58:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:58:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:58:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:58:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:58:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:58:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:58:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:58:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:58:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 08:58:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 08:58:28 [DEBUG   ] Finished updating board flags in 1.911 seconds
2016-04-22 08:58:32 [DEBUG   ] Got command RPT from MCS: ref #678052
2016-04-22 08:58:32 [DEBUG   ] summary = ERROR
2016-04-22 08:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678052  13 57500 32312082 A  ERRORERROR'
2016-04-22 08:58:32 [DEBUG   ] Got command RPT from MCS: ref #678053
2016-04-22 08:58:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678053  77 57500 32312274 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:58:32 [DEBUG   ] Got command RPT from MCS: ref #678054
2016-04-22 08:58:32 [DEBUG   ] summary = ERROR
2016-04-22 08:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678054  13 57500 32312478 A  ERRORERROR'
2016-04-22 08:58:32 [DEBUG   ] Got command RPT from MCS: ref #678055
2016-04-22 08:58:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678055  77 57500 32312682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:58:32 [DEBUG   ] Got command RPT from MCS: ref #678056
2016-04-22 08:58:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 08:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678056  12 57500 32312886 A  ERRORB“™š'
2016-04-22 08:58:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 08:58:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:59:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 08:59:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 08:59:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 08:59:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 08:59:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 08:59:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 08:59:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 08:59:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 08:59:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 08:59:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 08:59:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 08:59:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2016-04-22 08:59:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 08:59:28 [DEBUG   ] Finished updating board flags in 1.823 seconds
2016-04-22 08:59:29 [DEBUG   ] Got command RPT from MCS: ref #678065
2016-04-22 08:59:29 [DEBUG   ] summary = ERROR
2016-04-22 08:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678065  13 57500 32369998 A  ERRORERROR'
2016-04-22 08:59:29 [DEBUG   ] Got command RPT from MCS: ref #678066
2016-04-22 08:59:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 08:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678066  77 57500 32369998 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 08:59:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 08:59:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:00:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:00:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:00:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:00:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:00:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:00:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:00:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:00:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:00:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:00:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:00:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:00:28 [DEBUG   ] Finished updating board flags in 1.768 seconds
2016-04-22 09:00:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:00:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 09:01:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 09:01:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:01:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:01:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:01:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:01:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:01:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:01:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:01:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:01:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:01:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:01:28 [DEBUG   ] Finished updating board flags in 1.610 seconds
2016-04-22 09:01:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:01:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:02:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2016-04-22 09:02:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:02:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:02:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:02:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:02:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:02:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 09:02:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:02:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:02:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:02:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:02:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:02:28 [DEBUG   ] Finished updating board flags in 1.685 seconds
2016-04-22 09:02:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:02:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:03:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:03:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:03:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:03:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:03:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:03:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:03:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 09:03:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:03:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:03:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:03:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:03:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:03:28 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 09:03:28 [DEBUG   ] Finished updating board flags in 1.506 seconds
2016-04-22 09:03:32 [DEBUG   ] Got command RPT from MCS: ref #678085
2016-04-22 09:03:32 [DEBUG   ] summary = ERROR
2016-04-22 09:03:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678085  13 57500 32612162 A  ERRORERROR'
2016-04-22 09:03:32 [DEBUG   ] Got command RPT from MCS: ref #678086
2016-04-22 09:03:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:03:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678086  77 57500 32612366 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:03:32 [DEBUG   ] Got command RPT from MCS: ref #678087
2016-04-22 09:03:32 [DEBUG   ] summary = ERROR
2016-04-22 09:03:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678087  13 57500 32612558 A  ERRORERROR'
2016-04-22 09:03:32 [DEBUG   ] Got command RPT from MCS: ref #678088
2016-04-22 09:03:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:03:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678088  77 57500 32612762 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:03:32 [DEBUG   ] Got command RPT from MCS: ref #678089
2016-04-22 09:03:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 09:03:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678089  12 57500 32612966 A  ERRORB•™š'
2016-04-22 09:03:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 09:03:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 09:04:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:04:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:04:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:04:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:04:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:04:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:04:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:04:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:04:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:04:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:04:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:04:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2016-04-22 09:04:28 [DEBUG   ] Finished updating board flags in 1.508 seconds
2016-04-22 09:04:29 [DEBUG   ] Got command RPT from MCS: ref #678090
2016-04-22 09:04:29 [DEBUG   ] summary = ERROR
2016-04-22 09:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678090  13 57500 32669994 A  ERRORERROR'
2016-04-22 09:04:29 [DEBUG   ] Got command RPT from MCS: ref #678091
2016-04-22 09:04:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678091  77 57500 32669994 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:04:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:04:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:05:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:05:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:05:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:05:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:05:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:05:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:05:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:05:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:05:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:05:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:05:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:05:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 09:05:28 [DEBUG   ] Finished updating board flags in 1.513 seconds
2016-04-22 09:05:35 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-22 09:05:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:06:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 09:06:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:06:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:06:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:06:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:06:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:06:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 09:06:29 [DEBUG   ] Finished updating board flags in 2.212 seconds
2016-04-22 09:06:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 09:06:55 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-22 09:07:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:07:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:07:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:07:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:07:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:07:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:07:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:07:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:07:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:07:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:07:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:07:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 09:07:29 [DEBUG   ] Finished updating board flags in 2.198 seconds
2016-04-22 09:07:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:07:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 09:08:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:08:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:08:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:08:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:08:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:08:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:08:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:08:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:08:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:08:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:08:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:08:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2016-04-22 09:08:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 09:08:29 [DEBUG   ] Finished updating board flags in 1.973 seconds
2016-04-22 09:08:32 [DEBUG   ] Got command RPT from MCS: ref #678114
2016-04-22 09:08:32 [DEBUG   ] summary = ERROR
2016-04-22 09:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678114  13 57500 32912234 A  ERRORERROR'
2016-04-22 09:08:32 [DEBUG   ] Got command RPT from MCS: ref #678115
2016-04-22 09:08:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678115  77 57500 32912438 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:08:32 [DEBUG   ] Got command RPT from MCS: ref #678116
2016-04-22 09:08:32 [DEBUG   ] summary = ERROR
2016-04-22 09:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678116  13 57500 32912642 A  ERRORERROR'
2016-04-22 09:08:32 [DEBUG   ] Got command RPT from MCS: ref #678117
2016-04-22 09:08:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678117  77 57500 32912846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:08:33 [DEBUG   ] Got command RPT from MCS: ref #678118
2016-04-22 09:08:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 09:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678118  12 57500 32913038 A  ERRORB”™š'
2016-04-22 09:08:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:08:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 09:09:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 09:09:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:09:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:09:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:09:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:09:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:09:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:09:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:09:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:09:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:09:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:09:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 09:09:29 [DEBUG   ] Finished updating board flags in 1.847 seconds
2016-04-22 09:09:29 [DEBUG   ] Got command RPT from MCS: ref #678124
2016-04-22 09:09:29 [DEBUG   ] summary = ERROR
2016-04-22 09:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678124  13 57500 32969994 A  ERRORERROR'
2016-04-22 09:09:29 [DEBUG   ] Got command RPT from MCS: ref #678125
2016-04-22 09:09:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678125  77 57500 32969994 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:09:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:09:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:10:15 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2016-04-22 09:10:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:10:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:10:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:10:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:10:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:10:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:10:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:10:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:10:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:10:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:10:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 09:10:29 [DEBUG   ] Finished updating board flags in 1.759 seconds
2016-04-22 09:10:35 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-22 09:10:55 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 09:11:16 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2016-04-22 09:11:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:11:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:11:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:11:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:11:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:11:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:11:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:11:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:11:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:11:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:11:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 09:11:29 [DEBUG   ] Finished updating board flags in 1.607 seconds
2016-04-22 09:11:36 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-22 09:11:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:12:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:12:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:12:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:12:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:12:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:12:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:12:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:12:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:12:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:12:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:12:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:12:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2016-04-22 09:12:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 09:12:29 [DEBUG   ] Finished updating board flags in 1.613 seconds
2016-04-22 09:12:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 09:12:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 09:13:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:13:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:13:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:13:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:13:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:13:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:13:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:13:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:13:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:13:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:13:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:13:29 [DEBUG   ] Finished updating board flags in 1.588 seconds
2016-04-22 09:13:32 [DEBUG   ] Got command RPT from MCS: ref #678144
2016-04-22 09:13:32 [DEBUG   ] summary = ERROR
2016-04-22 09:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678144  13 57500 33212326 A  ERRORERROR'
2016-04-22 09:13:32 [DEBUG   ] Got command RPT from MCS: ref #678145
2016-04-22 09:13:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678145  77 57500 33212518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:13:32 [DEBUG   ] Got command RPT from MCS: ref #678146
2016-04-22 09:13:32 [DEBUG   ] summary = ERROR
2016-04-22 09:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678146  13 57500 33212722 A  ERRORERROR'
2016-04-22 09:13:32 [DEBUG   ] Got command RPT from MCS: ref #678147
2016-04-22 09:13:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678147  77 57500 33212926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:13:33 [DEBUG   ] Got command RPT from MCS: ref #678148
2016-04-22 09:13:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 09:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678148  12 57500 33213322 A  ERRORB•™š'
2016-04-22 09:13:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:13:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 09:14:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 09:14:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:14:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:14:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:14:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:14:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:14:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:14:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:14:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:14:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:14:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:14:29 [DEBUG   ] Finished updating board flags in 1.546 seconds
2016-04-22 09:14:30 [DEBUG   ] Got command RPT from MCS: ref #678152
2016-04-22 09:14:30 [DEBUG   ] summary = ERROR
2016-04-22 09:14:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678152  13 57500 33270002 A  ERRORERROR'
2016-04-22 09:14:30 [DEBUG   ] Got command RPT from MCS: ref #678153
2016-04-22 09:14:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:14:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678153  77 57500 33270002 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:14:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:14:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:15:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 09:15:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:15:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:15:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:15:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:15:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:15:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:15:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:15:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:15:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:15:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:15:29 [DEBUG   ] Finished updating board flags in 1.573 seconds
2016-04-22 09:15:36 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-22 09:15:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:16:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 09:16:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:16:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:16:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:16:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:16:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:16:30 [DEBUG   ] Finished updating board flags in 2.190 seconds
2016-04-22 09:16:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 09:16:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 09:17:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:17:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:17:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:17:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:17:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:17:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:17:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 09:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:17:30 [DEBUG   ] Finished updating board flags in 1.907 seconds
2016-04-22 09:17:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:17:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 09:18:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 09:18:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:18:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:18:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:18:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:18:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:18:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 09:18:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 09:18:30 [DEBUG   ] Finished updating board flags in 1.823 seconds
2016-04-22 09:18:32 [DEBUG   ] Got command RPT from MCS: ref #678173
2016-04-22 09:18:32 [DEBUG   ] summary = ERROR
2016-04-22 09:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678173  13 57500 33512402 A  ERRORERROR'
2016-04-22 09:18:32 [DEBUG   ] Got command RPT from MCS: ref #678174
2016-04-22 09:18:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678174  77 57500 33512606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:18:32 [DEBUG   ] Got command RPT from MCS: ref #678175
2016-04-22 09:18:32 [DEBUG   ] summary = ERROR
2016-04-22 09:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678175  13 57500 33512810 A  ERRORERROR'
2016-04-22 09:18:33 [DEBUG   ] Got command RPT from MCS: ref #678176
2016-04-22 09:18:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678176  77 57500 33513014 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:18:33 [DEBUG   ] Got command RPT from MCS: ref #678177
2016-04-22 09:18:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 09:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678177  12 57500 33513206 A  ERRORB”™š'
2016-04-22 09:18:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:18:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:19:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:19:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:19:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:19:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:19:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:19:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:19:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 09:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:19:30 [DEBUG   ] Got command RPT from MCS: ref #678183
2016-04-22 09:19:30 [DEBUG   ] summary = ERROR
2016-04-22 09:19:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678183  13 57500 33570030 A  ERRORERROR'
2016-04-22 09:19:30 [DEBUG   ] Got command RPT from MCS: ref #678184
2016-04-22 09:19:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:19:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678184  77 57500 33570031 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:19:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 09:19:30 [DEBUG   ] Finished updating board flags in 1.761 seconds
2016-04-22 09:19:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 09:19:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:20:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 09:20:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:20:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:20:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:20:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:20:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:20:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:20:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:20:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:20:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:20:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:20:30 [DEBUG   ] Finished updating board flags in 1.633 seconds
2016-04-22 09:20:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 09:20:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 09:21:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:21:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:21:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:21:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:21:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:21:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:21:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:21:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:21:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:21:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:21:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:21:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 09:21:30 [DEBUG   ] Finished updating board flags in 1.672 seconds
2016-04-22 09:21:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:21:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 09:22:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 09:22:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:22:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:22:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:22:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:22:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:22:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:22:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:22:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:22:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:22:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:22:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 09:22:30 [DEBUG   ] Finished updating board flags in 1.511 seconds
2016-04-22 09:22:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:22:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:23:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 09:23:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:23:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:23:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:23:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:23:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:23:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 09:23:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:23:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:23:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:23:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:23:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:23:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 09:23:30 [DEBUG   ] Finished updating board flags in 1.530 seconds
2016-04-22 09:23:32 [DEBUG   ] Got command RPT from MCS: ref #678206
2016-04-22 09:23:32 [DEBUG   ] summary = ERROR
2016-04-22 09:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678206  13 57500 33812490 A  ERRORERROR'
2016-04-22 09:23:32 [DEBUG   ] Got command RPT from MCS: ref #678207
2016-04-22 09:23:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678207  77 57500 33812694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:23:32 [DEBUG   ] Got command RPT from MCS: ref #678208
2016-04-22 09:23:32 [DEBUG   ] summary = ERROR
2016-04-22 09:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678208  13 57500 33812898 A  ERRORERROR'
2016-04-22 09:23:33 [DEBUG   ] Got command RPT from MCS: ref #678209
2016-04-22 09:23:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:23:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678209  77 57500 33813102 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:23:33 [DEBUG   ] Got command RPT from MCS: ref #678210
2016-04-22 09:23:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 09:23:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678210  12 57500 33813294 A  ERRORB”™š'
2016-04-22 09:23:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 09:23:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:24:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:24:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:24:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:24:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:24:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:24:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:24:30 [DEBUG   ] Got command RPT from MCS: ref #678211
2016-04-22 09:24:30 [DEBUG   ] summary = ERROR
2016-04-22 09:24:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678211  13 57500 33870030 A  ERRORERROR'
2016-04-22 09:24:30 [DEBUG   ] Got command RPT from MCS: ref #678212
2016-04-22 09:24:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:24:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678212  77 57500 33870030 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:24:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 09:24:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:24:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:24:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:24:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:24:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:24:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 09:24:30 [DEBUG   ] Finished updating board flags in 1.527 seconds
2016-04-22 09:24:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 09:24:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 09:25:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:25:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:25:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:25:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:25:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:25:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:25:31 [DEBUG   ] Finished updating board flags in 2.177 seconds
2016-04-22 09:25:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:25:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 09:26:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 09:26:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:26:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:26:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:26:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:26:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:26:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2016-04-22 09:26:31 [DEBUG   ] Finished updating board flags in 1.958 seconds
2016-04-22 09:26:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:26:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:27:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 09:27:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:27:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:27:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:27:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:27:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:27:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-22 09:27:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:27:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:27:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:27:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:27:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:27:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 09:27:31 [DEBUG   ] Finished updating board flags in 1.880 seconds
2016-04-22 09:27:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 09:27:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:28:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:28:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:28:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:28:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:28:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:28:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:28:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2016-04-22 09:28:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:28:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:28:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:28:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:28:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:28:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 09:28:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 09:28:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 09:28:31 [DEBUG   ] Finished updating board flags in 1.836 seconds
2016-04-22 09:28:32 [DEBUG   ] Got command RPT from MCS: ref #678232
2016-04-22 09:28:32 [DEBUG   ] summary = ERROR
2016-04-22 09:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678232  13 57500 34112570 A  ERRORERROR'
2016-04-22 09:28:32 [DEBUG   ] Got command RPT from MCS: ref #678233
2016-04-22 09:28:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678233  77 57500 34112774 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:28:32 [DEBUG   ] Got command RPT from MCS: ref #678234
2016-04-22 09:28:32 [DEBUG   ] summary = ERROR
2016-04-22 09:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678234  13 57500 34112978 A  ERRORERROR'
2016-04-22 09:28:33 [DEBUG   ] Got command RPT from MCS: ref #678235
2016-04-22 09:28:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:28:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678235  77 57500 34113182 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:28:33 [DEBUG   ] Got command RPT from MCS: ref #678236
2016-04-22 09:28:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 09:28:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678236  12 57500 34113374 A  ERRORB”™š'
2016-04-22 09:28:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 09:28:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 09:29:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:29:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:29:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:29:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:29:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:29:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:29:30 [DEBUG   ] Got command RPT from MCS: ref #678245
2016-04-22 09:29:30 [DEBUG   ] summary = ERROR
2016-04-22 09:29:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678245  13 57500 34170030 A  ERRORERROR'
2016-04-22 09:29:30 [DEBUG   ] Got command RPT from MCS: ref #678246
2016-04-22 09:29:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:29:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678246  77 57500 34170030 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:29:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:29:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:29:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:29:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:29:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:29:31 [DEBUG   ] Finished updating board flags in 1.709 seconds
2016-04-22 09:29:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:29:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:30:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 09:30:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:30:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:30:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:30:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:30:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:30:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 09:30:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 09:30:31 [DEBUG   ] Finished updating board flags in 1.622 seconds
2016-04-22 09:30:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:30:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:31:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:31:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:31:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:31:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:31:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:31:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:31:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 09:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:31:31 [DEBUG   ] Finished updating board flags in 1.580 seconds
2016-04-22 09:31:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 09:31:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:32:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:32:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:32:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:32:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:32:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:32:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:32:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:32:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:32:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:32:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:32:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:32:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 09:32:31 [DEBUG   ] Finished updating board flags in 1.505 seconds
2016-04-22 09:32:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:32:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 09:33:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:33:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:33:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:33:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:33:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:33:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:33:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:33:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:33:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:33:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:33:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:33:31 [DEBUG   ] Finished updating board flags in 1.547 seconds
2016-04-22 09:33:32 [DEBUG   ] Got command RPT from MCS: ref #678265
2016-04-22 09:33:32 [DEBUG   ] summary = ERROR
2016-04-22 09:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678265  13 57500 34412642 A  ERRORERROR'
2016-04-22 09:33:32 [DEBUG   ] Got command RPT from MCS: ref #678266
2016-04-22 09:33:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678266  77 57500 34412846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:33:33 [DEBUG   ] Got command RPT from MCS: ref #678267
2016-04-22 09:33:33 [DEBUG   ] summary = ERROR
2016-04-22 09:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678267  13 57500 34413050 A  ERRORERROR'
2016-04-22 09:33:33 [DEBUG   ] Got command RPT from MCS: ref #678268
2016-04-22 09:33:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678268  77 57500 34413254 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:33:33 [DEBUG   ] Got command RPT from MCS: ref #678269
2016-04-22 09:33:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 09:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678269  12 57500 34413446 A  ERRORB•™š'
2016-04-22 09:33:36 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2016-04-22 09:33:56 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-22 09:34:17 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 09:34:30 [DEBUG   ] Got command RPT from MCS: ref #678270
2016-04-22 09:34:30 [DEBUG   ] summary = ERROR
2016-04-22 09:34:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678270  13 57500 34470038 A  ERRORERROR'
2016-04-22 09:34:30 [DEBUG   ] Got command RPT from MCS: ref #678271
2016-04-22 09:34:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:34:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678271  77 57500 34470038 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:34:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:34:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:34:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:34:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:34:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:34:32 [DEBUG   ] Finished updating board flags in 2.214 seconds
2016-04-22 09:34:37 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 09:34:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-22 09:35:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 09:35:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:35:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:35:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:35:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:35:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:35:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 09:35:32 [DEBUG   ] Finished updating board flags in 2.123 seconds
2016-04-22 09:35:37 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-22 09:35:57 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2016-04-22 09:36:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 09:36:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:36:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:36:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:36:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:36:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:36:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-22 09:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:36:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 09:36:32 [DEBUG   ] Finished updating board flags in 2.026 seconds
2016-04-22 09:36:38 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2016-04-22 09:36:58 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 09:37:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 09:37:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:37:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:37:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:37:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:37:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:37:32 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 09:37:32 [DEBUG   ] Finished updating board flags in 1.985 seconds
2016-04-22 09:37:38 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 09:37:58 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-22 09:38:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 09:38:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:38:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:38:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:38:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:38:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:38:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 09:38:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 09:38:32 [DEBUG   ] Finished updating board flags in 1.816 seconds
2016-04-22 09:38:32 [DEBUG   ] Got command RPT from MCS: ref #678294
2016-04-22 09:38:32 [DEBUG   ] summary = ERROR
2016-04-22 09:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678294  13 57500 34712742 A  ERRORERROR'
2016-04-22 09:38:32 [DEBUG   ] Got command RPT from MCS: ref #678295
2016-04-22 09:38:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678295  77 57500 34712946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:38:33 [DEBUG   ] Got command RPT from MCS: ref #678296
2016-04-22 09:38:33 [DEBUG   ] summary = ERROR
2016-04-22 09:38:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678296  13 57500 34713138 A  ERRORERROR'
2016-04-22 09:38:33 [DEBUG   ] Got command RPT from MCS: ref #678297
2016-04-22 09:38:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:38:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678297  77 57500 34713342 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:38:33 [DEBUG   ] Got command RPT from MCS: ref #678298
2016-04-22 09:38:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 09:38:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678298  12 57500 34713546 A  ERRORB”™š'
2016-04-22 09:38:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 09:38:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-22 09:39:18 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-22 09:39:30 [DEBUG   ] Got command RPT from MCS: ref #678304
2016-04-22 09:39:30 [DEBUG   ] summary = ERROR
2016-04-22 09:39:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678304  13 57500 34770030 A  ERRORERROR'
2016-04-22 09:39:30 [DEBUG   ] Got command RPT from MCS: ref #678305
2016-04-22 09:39:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:39:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678305  77 57500 34770031 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:39:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:39:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:39:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:39:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:39:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:39:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 09:39:32 [DEBUG   ] Finished updating board flags in 1.785 seconds
2016-04-22 09:39:38 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-22 09:39:59 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2016-04-22 09:40:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 09:40:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:40:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:40:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:40:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:40:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:40:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:40:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:40:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:40:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:40:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:40:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 09:40:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 09:40:32 [DEBUG   ] Finished updating board flags in 1.607 seconds
2016-04-22 09:40:39 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-22 09:40:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:41:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:41:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:41:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:41:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:41:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:41:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:41:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:41:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:41:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:41:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:41:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:41:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-22 09:41:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 09:41:32 [DEBUG   ] Finished updating board flags in 1.583 seconds
2016-04-22 09:41:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:41:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:42:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:42:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:42:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:42:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:42:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:42:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:42:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:42:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:42:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:42:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:42:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:42:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2016-04-22 09:42:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 09:42:32 [DEBUG   ] Finished updating board flags in 1.448 seconds
2016-04-22 09:42:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:42:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:43:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:43:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:43:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:43:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:43:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:43:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:43:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 09:43:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:43:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:43:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:43:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:43:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:43:32 [DEBUG   ] Finished updating board flags in 1.362 seconds
2016-04-22 09:43:32 [DEBUG   ] Got command RPT from MCS: ref #678324
2016-04-22 09:43:32 [DEBUG   ] summary = ERROR
2016-04-22 09:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678324  13 57500 35012826 A  ERRORERROR'
2016-04-22 09:43:33 [DEBUG   ] Got command RPT from MCS: ref #678325
2016-04-22 09:43:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678325  77 57500 35013030 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:43:33 [DEBUG   ] Got command RPT from MCS: ref #678326
2016-04-22 09:43:33 [DEBUG   ] summary = ERROR
2016-04-22 09:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678326  13 57500 35013234 A  ERRORERROR'
2016-04-22 09:43:33 [DEBUG   ] Got command RPT from MCS: ref #678327
2016-04-22 09:43:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678327  77 57500 35013426 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:43:33 [DEBUG   ] Got command RPT from MCS: ref #678328
2016-04-22 09:43:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 09:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678328  12 57500 35013630 A  ERRORB“™š'
2016-04-22 09:43:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 09:43:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:44:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:44:30 [DEBUG   ] Got command RPT from MCS: ref #678332
2016-04-22 09:44:30 [DEBUG   ] summary = ERROR
2016-04-22 09:44:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678332  13 57500 35070030 A  ERRORERROR'
2016-04-22 09:44:30 [DEBUG   ] Got command RPT from MCS: ref #678333
2016-04-22 09:44:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:44:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678333  77 57500 35070031 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:44:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:44:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:44:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:44:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:44:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:44:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:44:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:44:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:44:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:44:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:44:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 09:44:32 [DEBUG   ] Finished updating board flags in 1.391 seconds
2016-04-22 09:44:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:44:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 09:45:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:45:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:45:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:45:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:45:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:45:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:45:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 09:45:33 [DEBUG   ] Finished updating board flags in 2.112 seconds
2016-04-22 09:45:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:45:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:46:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:46:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:46:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:46:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:46:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:46:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:46:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 09:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:46:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 09:46:33 [DEBUG   ] Finished updating board flags in 1.905 seconds
2016-04-22 09:46:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:46:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:47:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 09:47:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:47:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:47:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:47:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:47:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:47:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 09:47:33 [DEBUG   ] Finished updating board flags in 1.847 seconds
2016-04-22 09:47:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 09:47:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:48:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:48:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:48:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:48:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:48:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:48:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:48:32 [DEBUG   ] Got command RPT from MCS: ref #678353
2016-04-22 09:48:32 [DEBUG   ] summary = ERROR
2016-04-22 09:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678353  13 57500 35312918 A  ERRORERROR'
2016-04-22 09:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:48:33 [DEBUG   ] Got command RPT from MCS: ref #678354
2016-04-22 09:48:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:48:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678354  77 57500 35313126 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:48:33 [DEBUG   ] Got command RPT from MCS: ref #678355
2016-04-22 09:48:33 [DEBUG   ] summary = ERROR
2016-04-22 09:48:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678355  13 57500 35313318 A  ERRORERROR'
2016-04-22 09:48:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 09:48:33 [DEBUG   ] Got command RPT from MCS: ref #678356
2016-04-22 09:48:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:48:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678356  77 57500 35313522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:48:33 [DEBUG   ] Finished updating board flags in 1.754 seconds
2016-04-22 09:48:33 [DEBUG   ] Got command RPT from MCS: ref #678357
2016-04-22 09:48:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 09:48:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678357  12 57500 35313726 A  ERRORB•™š'
2016-04-22 09:48:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:48:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 09:49:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:49:30 [DEBUG   ] Got command RPT from MCS: ref #678363
2016-04-22 09:49:30 [DEBUG   ] summary = ERROR
2016-04-22 09:49:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678363  13 57500 35370030 A  ERRORERROR'
2016-04-22 09:49:30 [DEBUG   ] Got command RPT from MCS: ref #678364
2016-04-22 09:49:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:49:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678364  77 57500 35370030 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:49:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:49:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:49:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:49:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:49:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:49:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 09:49:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:49:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:49:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:49:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:49:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:49:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 09:49:33 [DEBUG   ] Finished updating board flags in 1.623 seconds
2016-04-22 09:49:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:49:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:50:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:50:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:50:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:50:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:50:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:50:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:50:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:50:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:50:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:50:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:50:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:50:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 09:50:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2016-04-22 09:50:33 [DEBUG   ] Finished updating board flags in 1.666 seconds
2016-04-22 09:50:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:50:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:51:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 09:51:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:51:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:51:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:51:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:51:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:51:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:51:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:51:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:51:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:51:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:51:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 09:51:33 [DEBUG   ] Finished updating board flags in 1.521 seconds
2016-04-22 09:51:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:51:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:52:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:52:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:52:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:52:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:52:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:52:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:52:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 09:52:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:52:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:52:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:52:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:52:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:52:33 [DEBUG   ] Finished updating board flags in 1.510 seconds
2016-04-22 09:52:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 09:52:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 09:53:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 09:53:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:53:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:53:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:53:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:53:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:53:33 [DEBUG   ] Got command RPT from MCS: ref #678386
2016-04-22 09:53:33 [DEBUG   ] summary = ERROR
2016-04-22 09:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678386  13 57500 35613018 A  ERRORERROR'
2016-04-22 09:53:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:53:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:53:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:53:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:53:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:53:33 [DEBUG   ] Got command RPT from MCS: ref #678387
2016-04-22 09:53:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678387  77 57500 35613222 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:53:33 [DEBUG   ] Got command RPT from MCS: ref #678388
2016-04-22 09:53:33 [DEBUG   ] summary = ERROR
2016-04-22 09:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678388  13 57500 35613426 A  ERRORERROR'
2016-04-22 09:53:33 [DEBUG   ] Got command RPT from MCS: ref #678389
2016-04-22 09:53:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678389  77 57500 35613618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:53:33 [DEBUG   ] Got command RPT from MCS: ref #678390
2016-04-22 09:53:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 09:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678390  12 57500 35613826 A  ERRORB”™š'
2016-04-22 09:53:33 [DEBUG   ] Finished updating board flags in 1.521 seconds
2016-04-22 09:53:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 09:53:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 09:54:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 09:54:30 [DEBUG   ] Got command RPT from MCS: ref #678391
2016-04-22 09:54:30 [DEBUG   ] summary = ERROR
2016-04-22 09:54:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678391  13 57500 35670038 A  ERRORERROR'
2016-04-22 09:54:30 [DEBUG   ] Got command RPT from MCS: ref #678392
2016-04-22 09:54:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:54:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678392  77 57500 35670038 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:54:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:54:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:54:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:54:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:54:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:54:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 09:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:54:34 [DEBUG   ] Finished updating board flags in 2.228 seconds
2016-04-22 09:54:39 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2016-04-22 09:55:00 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 09:55:20 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-22 09:55:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:55:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:55:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:55:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:55:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:55:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 09:55:34 [DEBUG   ] Finished updating board flags in 2.143 seconds
2016-04-22 09:55:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:56:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:56:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 09:56:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:56:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:56:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:56:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:56:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:56:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2016-04-22 09:56:34 [DEBUG   ] Finished updating board flags in 2.024 seconds
2016-04-22 09:56:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 09:57:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:57:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:57:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:57:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:57:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:57:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:57:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:57:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 09:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:57:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 09:57:34 [DEBUG   ] Finished updating board flags in 1.982 seconds
2016-04-22 09:57:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 09:58:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 09:58:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:58:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:58:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:58:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:58:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:58:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:58:33 [DEBUG   ] Got command RPT from MCS: ref #678412
2016-04-22 09:58:33 [DEBUG   ] summary = ERROR
2016-04-22 09:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678412  13 57500 35913102 A  ERRORERROR'
2016-04-22 09:58:33 [DEBUG   ] Got command RPT from MCS: ref #678413
2016-04-22 09:58:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678413  77 57500 35913310 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:58:33 [DEBUG   ] Got command RPT from MCS: ref #678414
2016-04-22 09:58:33 [DEBUG   ] summary = ERROR
2016-04-22 09:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678414  13 57500 35913502 A  ERRORERROR'
2016-04-22 09:58:33 [DEBUG   ] Got command RPT from MCS: ref #678415
2016-04-22 09:58:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678415  77 57500 35913706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:58:33 [DEBUG   ] Got command RPT from MCS: ref #678416
2016-04-22 09:58:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 09:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678416  12 57500 35913910 A  ERRORB‹ÌÍ'
2016-04-22 09:58:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:58:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:58:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:58:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:58:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:58:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 09:58:34 [DEBUG   ] Finished updating board flags in 1.824 seconds
2016-04-22 09:58:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 09:59:00 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-22 09:59:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 09:59:30 [DEBUG   ] Got command RPT from MCS: ref #678425
2016-04-22 09:59:30 [DEBUG   ] summary = ERROR
2016-04-22 09:59:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678425  13 57500 35970034 A  ERRORERROR'
2016-04-22 09:59:30 [DEBUG   ] Got command RPT from MCS: ref #678426
2016-04-22 09:59:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 09:59:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678426  77 57500 35970034 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 09:59:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 09:59:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 09:59:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 09:59:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 09:59:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 09:59:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 09:59:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 09:59:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 09:59:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 09:59:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 09:59:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 09:59:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 09:59:34 [DEBUG   ] Finished updating board flags in 1.771 seconds
2016-04-22 09:59:40 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2016-04-22 10:00:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 10:00:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 10:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:00:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:00:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 10:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:00:34 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:00:34 [DEBUG   ] Finished updating board flags in 1.624 seconds
2016-04-22 10:00:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 10:01:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 10:01:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 10:01:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:01:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:01:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:01:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:01:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:01:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:01:34 [DEBUG   ] Finished updating board flags in 1.688 seconds
2016-04-22 10:01:40 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-22 10:02:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 10:02:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 10:02:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:02:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:02:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:02:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:02:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:02:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 1, bottom port
2016-04-22 10:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:02:34 [CRITICAL] MGT underflow detected on beam(s) 1
2016-04-22 10:02:34 [DEBUG   ] Finished updating board flags in 1.497 seconds
2016-04-22 10:02:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 10:03:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 10:03:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 10:03:33 [DEBUG   ] Got command RPT from MCS: ref #678445
2016-04-22 10:03:33 [DEBUG   ] summary = ERROR
2016-04-22 10:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678445  13 57500 36213186 A  ERRORERROR'
2016-04-22 10:03:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:03:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:03:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:03:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:03:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:03:33 [DEBUG   ] Got command RPT from MCS: ref #678446
2016-04-22 10:03:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678446  77 57500 36213390 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:03:33 [DEBUG   ] Got command RPT from MCS: ref #678447
2016-04-22 10:03:33 [DEBUG   ] summary = ERROR
2016-04-22 10:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678447  13 57500 36213582 A  ERRORERROR'
2016-04-22 10:03:33 [DEBUG   ] Got command RPT from MCS: ref #678448
2016-04-22 10:03:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678448  77 57500 36213786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:03:33 [DEBUG   ] Got command RPT from MCS: ref #678449
2016-04-22 10:03:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 10:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678449  12 57500 36213986 A  ERRORB‰ÌÍ'
2016-04-22 10:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:03:34 [DEBUG   ] Finished updating board flags in 1.485 seconds
2016-04-22 10:03:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 10:04:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 10:04:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 10:04:30 [DEBUG   ] Got command RPT from MCS: ref #678450
2016-04-22 10:04:30 [DEBUG   ] summary = ERROR
2016-04-22 10:04:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678450  13 57500 36270038 A  ERRORERROR'
2016-04-22 10:04:30 [DEBUG   ] Got command RPT from MCS: ref #678451
2016-04-22 10:04:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:04:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678451  77 57500 36270038 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:04:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:04:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:04:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:04:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:04:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:04:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 10:04:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 10:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:04:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:04:34 [DEBUG   ] Finished updating board flags in 1.501 seconds
2016-04-22 10:04:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 10:05:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 10:05:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 10:05:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:05:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:05:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:05:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:05:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:05:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 10:05:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 10:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:05:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 10:05:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:05:34 [DEBUG   ] Finished updating board flags in 1.502 seconds
2016-04-22 10:05:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 10:06:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 10:06:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 10:06:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:06:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:06:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:06:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:06:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:06:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 10:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:06:35 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:06:35 [DEBUG   ] Finished updating board flags in 2.200 seconds
2016-04-22 10:06:40 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-22 10:07:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 10:07:21 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 10:07:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:07:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:07:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:07:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:07:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:07:35 [DEBUG   ] Finished updating board flags in 1.928 seconds
2016-04-22 10:07:41 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 10:08:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 10:08:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-22 10:08:33 [DEBUG   ] Got command RPT from MCS: ref #678474
2016-04-22 10:08:33 [DEBUG   ] summary = ERROR
2016-04-22 10:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678474  13 57500 36513278 A  ERRORERROR'
2016-04-22 10:08:33 [DEBUG   ] Got command RPT from MCS: ref #678475
2016-04-22 10:08:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678475  77 57500 36513470 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:08:33 [DEBUG   ] Got command RPT from MCS: ref #678476
2016-04-22 10:08:33 [DEBUG   ] summary = ERROR
2016-04-22 10:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678476  13 57500 36513674 A  ERRORERROR'
2016-04-22 10:08:33 [DEBUG   ] Got command RPT from MCS: ref #678477
2016-04-22 10:08:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678477  77 57500 36513878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:08:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:08:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:08:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:08:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:08:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:08:34 [DEBUG   ] Got command RPT from MCS: ref #678478
2016-04-22 10:08:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 10:08:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678478  12 57500 36514082 A  ERRORB‚'
2016-04-22 10:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:08:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:08:35 [DEBUG   ] Finished updating board flags in 1.820 seconds
2016-04-22 10:08:41 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-22 10:09:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 10:09:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 10:09:30 [DEBUG   ] Got command RPT from MCS: ref #678484
2016-04-22 10:09:30 [DEBUG   ] summary = ERROR
2016-04-22 10:09:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678484  13 57500 36570038 A  ERRORERROR'
2016-04-22 10:09:30 [DEBUG   ] Got command RPT from MCS: ref #678485
2016-04-22 10:09:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:09:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678485  77 57500 36570038 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:09:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:09:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:09:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:09:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:09:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:09:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 10:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:09:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 10:09:35 [DEBUG   ] Finished updating board flags in 1.776 seconds
2016-04-22 10:09:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 10:10:01 [DEBUG   ] Finished updating ant stats in 0.807 seconds
2016-04-22 10:10:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 10:10:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:10:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:10:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:10:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:10:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:10:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 10:10:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 10:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:10:35 [DEBUG   ] Finished updating board flags in 1.619 seconds
2016-04-22 10:10:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 10:11:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 10:11:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 10:11:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:11:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:11:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:11:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:11:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:11:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 10:11:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:11:35 [DEBUG   ] Finished updating board flags in 1.652 seconds
2016-04-22 10:11:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 10:12:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2016-04-22 10:12:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-22 10:12:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:12:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:12:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:12:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:12:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:12:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 10:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:12:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2016-04-22 10:12:35 [DEBUG   ] Finished updating board flags in 1.540 seconds
2016-04-22 10:12:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 10:13:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 10:13:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 10:13:33 [DEBUG   ] Got command RPT from MCS: ref #678504
2016-04-22 10:13:33 [DEBUG   ] summary = ERROR
2016-04-22 10:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678504  13 57500 36813366 A  ERRORERROR'
2016-04-22 10:13:33 [DEBUG   ] Got command RPT from MCS: ref #678505
2016-04-22 10:13:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678505  77 57500 36813570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:13:33 [DEBUG   ] Got command RPT from MCS: ref #678506
2016-04-22 10:13:33 [DEBUG   ] summary = ERROR
2016-04-22 10:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678506  13 57500 36813762 A  ERRORERROR'
2016-04-22 10:13:33 [DEBUG   ] Got command RPT from MCS: ref #678507
2016-04-22 10:13:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678507  77 57500 36813966 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:13:34 [DEBUG   ] Got command RPT from MCS: ref #678508
2016-04-22 10:13:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 10:13:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678508  12 57500 36814170 A  ERRORB”™š'
2016-04-22 10:13:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:13:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:13:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:13:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:13:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:13:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 10:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:13:35 [DEBUG   ] Finished updating board flags in 1.419 seconds
2016-04-22 10:13:42 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 10:14:02 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-22 10:14:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 10:14:30 [DEBUG   ] Got command RPT from MCS: ref #678512
2016-04-22 10:14:30 [DEBUG   ] summary = ERROR
2016-04-22 10:14:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678512  13 57500 36870038 A  ERRORERROR'
2016-04-22 10:14:30 [DEBUG   ] Got command RPT from MCS: ref #678513
2016-04-22 10:14:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:14:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678513  77 57500 36870038 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:14:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:14:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:14:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:14:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:14:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:14:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 10:14:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 10:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:14:35 [DEBUG   ] Finished updating board flags in 1.383 seconds
2016-04-22 10:14:42 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 10:15:02 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-22 10:15:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 10:15:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:15:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:15:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:15:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:15:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:15:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 10:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:15:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 10:15:35 [DEBUG   ] Finished updating board flags in 1.386 seconds
2016-04-22 10:15:42 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2016-04-22 10:16:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 10:16:23 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2016-04-22 10:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:16:36 [DEBUG   ] Finished updating board flags in 2.038 seconds
2016-04-22 10:16:42 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2016-04-22 10:17:03 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2016-04-22 10:17:23 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 10:17:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:17:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:17:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:17:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:17:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:17:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2016-04-22 10:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:17:36 [DEBUG   ] Finished updating board flags in 1.991 seconds
2016-04-22 10:17:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 10:18:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 10:18:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 10:18:33 [DEBUG   ] Got command RPT from MCS: ref #678533
2016-04-22 10:18:33 [DEBUG   ] summary = ERROR
2016-04-22 10:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678533  13 57500 37113454 A  ERRORERROR'
2016-04-22 10:18:33 [DEBUG   ] Got command RPT from MCS: ref #678534
2016-04-22 10:18:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678534  77 57500 37113646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:18:33 [DEBUG   ] Got command RPT from MCS: ref #678535
2016-04-22 10:18:33 [DEBUG   ] summary = ERROR
2016-04-22 10:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678535  13 57500 37113850 A  ERRORERROR'
2016-04-22 10:18:34 [DEBUG   ] Got command RPT from MCS: ref #678536
2016-04-22 10:18:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:18:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678536  77 57500 37114054 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:18:34 [DEBUG   ] Got command RPT from MCS: ref #678537
2016-04-22 10:18:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 10:18:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678537  12 57500 37114258 A  ERRORB•™š'
2016-04-22 10:18:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:18:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:18:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:18:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:18:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:18:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 10:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:18:36 [DEBUG   ] Finished updating board flags in 1.856 seconds
2016-04-22 10:18:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 10:19:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 10:19:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 10:19:30 [DEBUG   ] Got command RPT from MCS: ref #678543
2016-04-22 10:19:30 [DEBUG   ] summary = ERROR
2016-04-22 10:19:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678543  13 57500 37170046 A  ERRORERROR'
2016-04-22 10:19:30 [DEBUG   ] Got command RPT from MCS: ref #678544
2016-04-22 10:19:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:19:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678544  77 57500 37170046 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:19:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:19:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:19:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:19:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:19:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:19:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 10:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:19:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 10:19:36 [DEBUG   ] Finished updating board flags in 1.743 seconds
2016-04-22 10:19:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 10:20:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 10:20:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 10:20:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:20:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:20:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:20:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:20:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:20:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:20:36 [DEBUG   ] Finished updating board flags in 1.644 seconds
2016-04-22 10:20:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 10:21:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 10:21:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 10:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:21:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:21:36 [DEBUG   ] Finished updating board flags in 1.614 seconds
2016-04-22 10:21:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 10:22:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 10:22:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 10:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:22:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:22:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2016-04-22 10:22:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:22:36 [DEBUG   ] Finished updating board flags in 1.625 seconds
2016-04-22 10:22:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 10:23:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 10:23:23 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 10:23:33 [DEBUG   ] Got command RPT from MCS: ref #678566
2016-04-22 10:23:33 [DEBUG   ] summary = ERROR
2016-04-22 10:23:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678566  13 57500 37413542 A  ERRORERROR'
2016-04-22 10:23:33 [DEBUG   ] Got command RPT from MCS: ref #678567
2016-04-22 10:23:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:23:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678567  77 57500 37413746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:23:33 [DEBUG   ] Got command RPT from MCS: ref #678568
2016-04-22 10:23:33 [DEBUG   ] summary = ERROR
2016-04-22 10:23:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678568  13 57500 37413938 A  ERRORERROR'
2016-04-22 10:23:34 [DEBUG   ] Got command RPT from MCS: ref #678569
2016-04-22 10:23:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:23:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678569  77 57500 37414142 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:23:34 [DEBUG   ] Got command RPT from MCS: ref #678570
2016-04-22 10:23:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 10:23:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678570  12 57500 37414346 A  ERRORB”™š'
2016-04-22 10:23:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:23:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:23:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:23:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:23:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:23:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 10:23:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2016-04-22 10:23:36 [DEBUG   ] Finished updating board flags in 1.565 seconds
2016-04-22 10:23:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 10:24:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 10:24:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 10:24:30 [DEBUG   ] Got command RPT from MCS: ref #678571
2016-04-22 10:24:30 [DEBUG   ] summary = ERROR
2016-04-22 10:24:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678571  13 57500 37470042 A  ERRORERROR'
2016-04-22 10:24:30 [DEBUG   ] Got command RPT from MCS: ref #678572
2016-04-22 10:24:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:24:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678572  77 57500 37470042 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:24:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:24:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:24:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:24:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:24:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:24:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 10:24:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 10:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:24:36 [DEBUG   ] Finished updating board flags in 1.514 seconds
2016-04-22 10:24:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 10:25:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 10:25:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 10:25:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:25:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:25:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:25:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:25:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:25:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 10:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:25:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 10:25:36 [DEBUG   ] Finished updating board flags in 1.539 seconds
2016-04-22 10:25:43 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2016-04-22 10:26:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 10:26:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 10:26:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:26:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:26:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:26:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:26:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:26:37 [DEBUG   ] Finished updating board flags in 2.168 seconds
2016-04-22 10:26:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 10:27:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 10:27:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 10:27:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:27:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:27:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:27:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:27:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:27:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:27:37 [DEBUG   ] Finished updating board flags in 1.944 seconds
2016-04-22 10:27:43 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2016-04-22 10:28:03 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 10:28:24 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2016-04-22 10:28:33 [DEBUG   ] Got command RPT from MCS: ref #678592
2016-04-22 10:28:33 [DEBUG   ] summary = ERROR
2016-04-22 10:28:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678592  13 57500 37713634 A  ERRORERROR'
2016-04-22 10:28:33 [DEBUG   ] Got command RPT from MCS: ref #678593
2016-04-22 10:28:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:28:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678593  77 57500 37713838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:28:34 [DEBUG   ] Got command RPT from MCS: ref #678594
2016-04-22 10:28:34 [DEBUG   ] summary = ERROR
2016-04-22 10:28:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678594  13 57500 37714042 A  ERRORERROR'
2016-04-22 10:28:34 [DEBUG   ] Got command RPT from MCS: ref #678595
2016-04-22 10:28:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:28:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678595  77 57500 37714246 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:28:34 [DEBUG   ] Got command RPT from MCS: ref #678596
2016-04-22 10:28:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 10:28:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678596  12 57500 37714438 A  ERRORB•™š'
2016-04-22 10:28:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:28:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:28:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:28:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:28:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:28:37 [DEBUG   ] Finished updating board flags in 1.751 seconds
2016-04-22 10:28:44 [DEBUG   ] Finished updating ant stats in 1.009 seconds
2016-04-22 10:29:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 10:29:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 10:29:30 [DEBUG   ] Got command RPT from MCS: ref #678605
2016-04-22 10:29:30 [DEBUG   ] summary = ERROR
2016-04-22 10:29:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678605  13 57500 37770042 A  ERRORERROR'
2016-04-22 10:29:30 [DEBUG   ] Got command RPT from MCS: ref #678606
2016-04-22 10:29:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:29:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678606  77 57500 37770042 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:29:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:29:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:29:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:29:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:29:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:29:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 10:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:29:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 10:29:37 [DEBUG   ] Finished updating board flags in 1.592 seconds
2016-04-22 10:29:44 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-22 10:30:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 10:30:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 10:30:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:30:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:30:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:30:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:30:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:30:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2016-04-22 10:30:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2016-04-22 10:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:30:37 [DEBUG   ] Finished updating board flags in 1.403 seconds
2016-04-22 10:30:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 10:31:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 10:31:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 10:31:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:31:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:31:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:31:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:31:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:31:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 10:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:31:37 [DEBUG   ] Finished updating board flags in 1.471 seconds
2016-04-22 10:31:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 10:32:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 10:32:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 10:32:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:32:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:32:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:32:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:32:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:32:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:32:37 [DEBUG   ] Finished updating board flags in 1.430 seconds
2016-04-22 10:32:44 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2016-04-22 10:33:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 10:33:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 10:33:33 [DEBUG   ] Got command RPT from MCS: ref #678625
2016-04-22 10:33:33 [DEBUG   ] summary = ERROR
2016-04-22 10:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678625  13 57500 38013738 A  ERRORERROR'
2016-04-22 10:33:33 [DEBUG   ] Got command RPT from MCS: ref #678626
2016-04-22 10:33:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678626  77 57500 38013942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:33:34 [DEBUG   ] Got command RPT from MCS: ref #678627
2016-04-22 10:33:34 [DEBUG   ] summary = ERROR
2016-04-22 10:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678627  13 57500 38014134 A  ERRORERROR'
2016-04-22 10:33:34 [DEBUG   ] Got command RPT from MCS: ref #678628
2016-04-22 10:33:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678628  77 57500 38014338 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:33:34 [DEBUG   ] Got command RPT from MCS: ref #678629
2016-04-22 10:33:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 10:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678629  12 57500 38014542 A  ERRORB”™š'
2016-04-22 10:33:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:33:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:33:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:33:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:33:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:33:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 10:33:37 [DEBUG   ] Finished updating board flags in 1.439 seconds
2016-04-22 10:33:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 10:34:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 10:34:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 10:34:30 [DEBUG   ] Got command RPT from MCS: ref #678630
2016-04-22 10:34:30 [DEBUG   ] summary = ERROR
2016-04-22 10:34:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678630  13 57500 38070042 A  ERRORERROR'
2016-04-22 10:34:30 [DEBUG   ] Got command RPT from MCS: ref #678631
2016-04-22 10:34:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:34:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678631  77 57500 38070042 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:34:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:34:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:34:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:34:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:34:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:34:37 [DEBUG   ] Finished updating board flags in 1.450 seconds
2016-04-22 10:34:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 10:35:04 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-22 10:35:25 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 10:35:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:35:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:35:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:35:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:35:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:35:37 [DEBUG   ] Finished updating board flags in 1.459 seconds
2016-04-22 10:35:45 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-22 10:36:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-22 10:36:25 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2016-04-22 10:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:36:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 10:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:36:38 [DEBUG   ] Finished updating board flags in 2.244 seconds
2016-04-22 10:36:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 10:37:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 10:37:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 10:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:37:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 10:37:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 10:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:37:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:37:38 [DEBUG   ] Finished updating board flags in 2.149 seconds
2016-04-22 10:37:45 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-22 10:38:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 10:38:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 10:38:33 [DEBUG   ] Got command RPT from MCS: ref #678654
2016-04-22 10:38:33 [DEBUG   ] summary = ERROR
2016-04-22 10:38:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678654  13 57500 38313822 A  ERRORERROR'
2016-04-22 10:38:34 [DEBUG   ] Got command RPT from MCS: ref #678655
2016-04-22 10:38:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678655  77 57500 38314026 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:38:34 [DEBUG   ] Got command RPT from MCS: ref #678656
2016-04-22 10:38:34 [DEBUG   ] summary = ERROR
2016-04-22 10:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678656  13 57500 38314218 A  ERRORERROR'
2016-04-22 10:38:34 [DEBUG   ] Got command RPT from MCS: ref #678657
2016-04-22 10:38:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678657  77 57500 38314422 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:38:34 [DEBUG   ] Got command RPT from MCS: ref #678658
2016-04-22 10:38:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 10:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678658  12 57500 38314626 A  ERRORB”™š'
2016-04-22 10:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:38:38 [DEBUG   ] Finished updating board flags in 1.985 seconds
2016-04-22 10:38:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-22 10:39:05 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-22 10:39:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 10:39:30 [DEBUG   ] Got command RPT from MCS: ref #678664
2016-04-22 10:39:30 [DEBUG   ] summary = ERROR
2016-04-22 10:39:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678664  13 57500 38370050 A  ERRORERROR'
2016-04-22 10:39:30 [DEBUG   ] Got command RPT from MCS: ref #678665
2016-04-22 10:39:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:39:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678665  77 57500 38370050 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:39:38 [DEBUG   ] Finished updating board flags in 1.791 seconds
2016-04-22 10:39:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 10:40:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 10:40:25 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2016-04-22 10:40:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:40:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:40:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:40:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:40:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:40:38 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 10:40:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:40:38 [DEBUG   ] Finished updating board flags in 1.608 seconds
2016-04-22 10:40:46 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2016-04-22 10:41:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-22 10:41:26 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-22 10:41:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:41:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:41:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:41:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:41:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:41:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:41:38 [DEBUG   ] Finished updating board flags in 1.591 seconds
2016-04-22 10:41:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 10:42:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 10:42:26 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 10:42:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:42:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:42:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:42:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:42:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:42:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 10:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:42:38 [DEBUG   ] Finished updating board flags in 1.446 seconds
2016-04-22 10:42:46 [DEBUG   ] Finished updating ant stats in 0.709 seconds
2016-04-22 10:43:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 10:43:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 10:43:33 [DEBUG   ] Got command RPT from MCS: ref #678684
2016-04-22 10:43:33 [DEBUG   ] summary = ERROR
2016-04-22 10:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678684  13 57500 38613922 A  ERRORERROR'
2016-04-22 10:43:34 [DEBUG   ] Got command RPT from MCS: ref #678685
2016-04-22 10:43:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678685  77 57500 38614126 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:43:34 [DEBUG   ] Got command RPT from MCS: ref #678686
2016-04-22 10:43:34 [DEBUG   ] summary = ERROR
2016-04-22 10:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678686  13 57500 38614318 A  ERRORERROR'
2016-04-22 10:43:34 [DEBUG   ] Got command RPT from MCS: ref #678687
2016-04-22 10:43:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678687  77 57500 38614522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:43:34 [DEBUG   ] Got command RPT from MCS: ref #678688
2016-04-22 10:43:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 10:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678688  12 57500 38614726 A  ERRORB•™š'
2016-04-22 10:43:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:43:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:43:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:43:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:43:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:43:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 10:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:43:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:43:38 [DEBUG   ] Finished updating board flags in 1.416 seconds
2016-04-22 10:43:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 10:44:06 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 10:44:27 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2016-04-22 10:44:30 [DEBUG   ] Got command RPT from MCS: ref #678692
2016-04-22 10:44:30 [DEBUG   ] summary = ERROR
2016-04-22 10:44:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678692  13 57500 38670054 A  ERRORERROR'
2016-04-22 10:44:30 [DEBUG   ] Got command RPT from MCS: ref #678693
2016-04-22 10:44:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:44:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678693  77 57500 38670054 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:44:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:44:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:44:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:44:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:44:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:44:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2016-04-22 10:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:44:38 [DEBUG   ] Finished updating board flags in 1.410 seconds
2016-04-22 10:44:47 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2016-04-22 10:45:07 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 10:45:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 10:45:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:45:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:45:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:45:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:45:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:45:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 10:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:45:38 [DEBUG   ] Finished updating board flags in 1.471 seconds
2016-04-22 10:45:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 10:46:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 10:46:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 10:46:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:46:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:46:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:46:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:46:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:46:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:46:38 [DEBUG   ] Finished updating board flags in 1.482 seconds
2016-04-22 10:46:47 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-22 10:47:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 10:47:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 10:47:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:47:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:47:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:47:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:47:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:47:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:47:38 [DEBUG   ] Finished updating board flags in 1.480 seconds
2016-04-22 10:47:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 10:48:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 10:48:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 10:48:34 [DEBUG   ] Got command RPT from MCS: ref #678713
2016-04-22 10:48:34 [DEBUG   ] summary = ERROR
2016-04-22 10:48:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678713  13 57500 38914010 A  ERRORERROR'
2016-04-22 10:48:34 [DEBUG   ] Got command RPT from MCS: ref #678714
2016-04-22 10:48:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:48:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678714  77 57500 38914214 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:48:34 [DEBUG   ] Got command RPT from MCS: ref #678715
2016-04-22 10:48:34 [DEBUG   ] summary = ERROR
2016-04-22 10:48:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678715  13 57500 38914418 A  ERRORERROR'
2016-04-22 10:48:34 [DEBUG   ] Got command RPT from MCS: ref #678716
2016-04-22 10:48:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:48:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678716  77 57500 38914622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:48:34 [DEBUG   ] Got command RPT from MCS: ref #678717
2016-04-22 10:48:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 10:48:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678717  12 57500 38914814 A  ERRORB”™š'
2016-04-22 10:48:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:48:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:48:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:48:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:48:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:48:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 10:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:48:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:48:39 [DEBUG   ] Finished updating board flags in 2.209 seconds
2016-04-22 10:48:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 10:49:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 10:49:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 10:49:30 [DEBUG   ] Got command RPT from MCS: ref #678723
2016-04-22 10:49:30 [DEBUG   ] summary = ERROR
2016-04-22 10:49:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678723  13 57500 38970046 A  ERRORERROR'
2016-04-22 10:49:30 [DEBUG   ] Got command RPT from MCS: ref #678724
2016-04-22 10:49:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:49:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678724  77 57500 38970046 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:49:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:49:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:49:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:49:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:49:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:49:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 10:49:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 10:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:49:39 [DEBUG   ] Finished updating board flags in 2.150 seconds
2016-04-22 10:49:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 10:50:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 10:50:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 10:50:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:50:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:50:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:50:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:50:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:50:39 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:50:39 [DEBUG   ] Finished updating board flags in 2.020 seconds
2016-04-22 10:50:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 10:51:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 10:51:27 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-22 10:51:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:51:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:51:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:51:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:51:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:51:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2016-04-22 10:51:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 10:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:51:39 [DEBUG   ] Finished updating board flags in 1.938 seconds
2016-04-22 10:51:47 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2016-04-22 10:52:07 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-22 10:52:27 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-22 10:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:52:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:52:39 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 10:52:39 [DEBUG   ] Finished updating board flags in 1.817 seconds
2016-04-22 10:52:48 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 10:53:08 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 10:53:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 10:53:34 [DEBUG   ] Got command RPT from MCS: ref #678746
2016-04-22 10:53:34 [DEBUG   ] summary = ERROR
2016-04-22 10:53:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678746  13 57500 39214122 A  ERRORERROR'
2016-04-22 10:53:34 [DEBUG   ] Got command RPT from MCS: ref #678747
2016-04-22 10:53:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:53:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678747  77 57500 39214314 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:53:34 [DEBUG   ] Got command RPT from MCS: ref #678748
2016-04-22 10:53:34 [DEBUG   ] summary = ERROR
2016-04-22 10:53:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678748  13 57500 39214518 A  ERRORERROR'
2016-04-22 10:53:34 [DEBUG   ] Got command RPT from MCS: ref #678749
2016-04-22 10:53:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:53:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678749  77 57500 39214722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:53:34 [DEBUG   ] Got command RPT from MCS: ref #678750
2016-04-22 10:53:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 10:53:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678750  12 57500 39214926 A  ERRORB•™š'
2016-04-22 10:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:53:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:53:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2016-04-22 10:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:53:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:53:39 [DEBUG   ] Finished updating board flags in 1.782 seconds
2016-04-22 10:53:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 10:54:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 10:54:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 10:54:30 [DEBUG   ] Got command RPT from MCS: ref #678751
2016-04-22 10:54:30 [DEBUG   ] summary = ERROR
2016-04-22 10:54:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678751  13 57500 39270046 A  ERRORERROR'
2016-04-22 10:54:30 [DEBUG   ] Got command RPT from MCS: ref #678752
2016-04-22 10:54:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:54:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678752  77 57500 39270046 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:54:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:54:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:54:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:54:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:54:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:54:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 10:54:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 10:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:54:39 [DEBUG   ] Finished updating board flags in 1.624 seconds
2016-04-22 10:54:48 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-22 10:55:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 10:55:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 10:55:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:55:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:55:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:55:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:55:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:55:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 10:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:55:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2016-04-22 10:55:39 [DEBUG   ] Finished updating board flags in 1.587 seconds
2016-04-22 10:55:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 10:56:08 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-22 10:56:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 10:56:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:56:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:56:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:56:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:56:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:56:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 10:56:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:56:39 [DEBUG   ] Finished updating board flags in 1.413 seconds
2016-04-22 10:56:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 10:57:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 10:57:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 10:57:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:57:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:57:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:57:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:57:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:57:39 [DEBUG   ] Finished updating board flags in 1.473 seconds
2016-04-22 10:57:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 10:58:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 10:58:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 10:58:34 [DEBUG   ] Got command RPT from MCS: ref #678772
2016-04-22 10:58:34 [DEBUG   ] summary = ERROR
2016-04-22 10:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678772  13 57500 39514234 A  ERRORERROR'
2016-04-22 10:58:34 [DEBUG   ] Got command RPT from MCS: ref #678773
2016-04-22 10:58:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678773  77 57500 39514426 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:58:34 [DEBUG   ] Got command RPT from MCS: ref #678774
2016-04-22 10:58:34 [DEBUG   ] summary = ERROR
2016-04-22 10:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678774  13 57500 39514630 A  ERRORERROR'
2016-04-22 10:58:34 [DEBUG   ] Got command RPT from MCS: ref #678775
2016-04-22 10:58:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678775  77 57500 39514834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:58:35 [DEBUG   ] Got command RPT from MCS: ref #678776
2016-04-22 10:58:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 10:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678776  12 57500 39515038 A  ERRORB”™š'
2016-04-22 10:58:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:58:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:58:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:58:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:58:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:58:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:58:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:58:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:58:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:58:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:58:39 [DEBUG   ] Finished updating board flags in 1.478 seconds
2016-04-22 10:58:48 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-22 10:59:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 10:59:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 10:59:30 [DEBUG   ] Got command RPT from MCS: ref #678785
2016-04-22 10:59:30 [DEBUG   ] summary = ERROR
2016-04-22 10:59:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678785  13 57500 39570054 A  ERRORERROR'
2016-04-22 10:59:30 [DEBUG   ] Got command RPT from MCS: ref #678786
2016-04-22 10:59:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 10:59:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678786  77 57500 39570054 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 10:59:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 10:59:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 10:59:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 10:59:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 10:59:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 10:59:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 10:59:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 10:59:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 10:59:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 10:59:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 10:59:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 10:59:39 [DEBUG   ] Finished updating board flags in 1.476 seconds
2016-04-22 10:59:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 11:00:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 11:00:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 11:00:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:00:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:00:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:00:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:00:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:00:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 11:00:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:00:40 [DEBUG   ] Finished updating board flags in 2.246 seconds
2016-04-22 11:00:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 11:01:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 11:01:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 11:01:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:01:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:01:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:01:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:01:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:01:40 [DEBUG   ] Finished updating board flags in 2.253 seconds
2016-04-22 11:01:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 11:02:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 11:02:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 11:02:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:02:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:02:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:02:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:02:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:02:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:02:40 [DEBUG   ] Finished updating board flags in 2.079 seconds
2016-04-22 11:02:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 11:03:08 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-22 11:03:28 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 11:03:34 [DEBUG   ] Got command RPT from MCS: ref #678805
2016-04-22 11:03:34 [DEBUG   ] summary = ERROR
2016-04-22 11:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678805  13 57500 39814322 A  ERRORERROR'
2016-04-22 11:03:34 [DEBUG   ] Got command RPT from MCS: ref #678806
2016-04-22 11:03:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678806  77 57500 39814526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:03:34 [DEBUG   ] Got command RPT from MCS: ref #678807
2016-04-22 11:03:34 [DEBUG   ] summary = ERROR
2016-04-22 11:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678807  13 57500 39814718 A  ERRORERROR'
2016-04-22 11:03:34 [DEBUG   ] Got command RPT from MCS: ref #678808
2016-04-22 11:03:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678808  77 57500 39814922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:03:35 [DEBUG   ] Got command RPT from MCS: ref #678809
2016-04-22 11:03:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 11:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678809  12 57500 39815126 A  ERRORB”™š'
2016-04-22 11:03:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:03:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:03:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:03:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:03:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:03:40 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 11:03:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:03:40 [DEBUG   ] Finished updating board flags in 2.014 seconds
2016-04-22 11:03:49 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2016-04-22 11:04:09 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2016-04-22 11:04:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 11:04:30 [DEBUG   ] Got command RPT from MCS: ref #678810
2016-04-22 11:04:30 [DEBUG   ] summary = ERROR
2016-04-22 11:04:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678810  13 57500 39870050 A  ERRORERROR'
2016-04-22 11:04:30 [DEBUG   ] Got command RPT from MCS: ref #678811
2016-04-22 11:04:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:04:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678811  77 57500 39870050 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:04:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:04:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:04:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:04:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:04:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:04:40 [DEBUG   ] Finished updating board flags in 1.989 seconds
2016-04-22 11:04:49 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-22 11:05:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 11:05:29 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-22 11:05:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:05:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:05:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:05:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:05:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:05:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2016-04-22 11:05:40 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:05:40 [DEBUG   ] Finished updating board flags in 1.803 seconds
2016-04-22 11:05:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 11:06:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 11:06:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-22 11:06:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:06:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:06:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:06:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:06:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:06:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:06:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:06:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:06:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:06:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:06:40 [DEBUG   ] Finished updating board flags in 1.813 seconds
2016-04-22 11:06:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 11:07:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 11:07:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 11:07:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:07:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:07:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:07:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:07:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:07:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:07:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:07:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:07:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:07:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:07:40 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:07:40 [DEBUG   ] Finished updating board flags in 1.793 seconds
2016-04-22 11:07:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 11:08:10 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2016-04-22 11:08:29 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2016-04-22 11:08:34 [DEBUG   ] Got command RPT from MCS: ref #678834
2016-04-22 11:08:34 [DEBUG   ] summary = ERROR
2016-04-22 11:08:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678834  13 57500 40114418 A  ERRORERROR'
2016-04-22 11:08:34 [DEBUG   ] Got command RPT from MCS: ref #678835
2016-04-22 11:08:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:08:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678835  77 57500 40114610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:08:34 [DEBUG   ] Got command RPT from MCS: ref #678836
2016-04-22 11:08:34 [DEBUG   ] summary = ERROR
2016-04-22 11:08:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678836  13 57500 40114814 A  ERRORERROR'
2016-04-22 11:08:35 [DEBUG   ] Got command RPT from MCS: ref #678837
2016-04-22 11:08:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678837  77 57500 40115018 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:08:35 [DEBUG   ] Got command RPT from MCS: ref #678838
2016-04-22 11:08:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 11:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678838  12 57500 40115222 A  ERRORB”™š'
2016-04-22 11:08:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:08:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:08:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:08:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:08:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:08:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:08:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:08:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:08:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:08:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:08:40 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 11:08:40 [DEBUG   ] Finished updating board flags in 1.601 seconds
2016-04-22 11:08:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2016-04-22 11:09:10 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2016-04-22 11:09:30 [DEBUG   ] Got command RPT from MCS: ref #678844
2016-04-22 11:09:30 [DEBUG   ] summary = ERROR
2016-04-22 11:09:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678844  13 57500 40170058 A  ERRORERROR'
2016-04-22 11:09:30 [DEBUG   ] Got command RPT from MCS: ref #678845
2016-04-22 11:09:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:09:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678845  77 57500 40170058 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:09:30 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2016-04-22 11:09:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:09:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:09:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:09:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:09:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:09:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:09:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:09:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:09:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:09:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:09:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:09:40 [DEBUG   ] Finished updating board flags in 1.613 seconds
2016-04-22 11:09:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 11:10:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-22 11:10:30 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-22 11:10:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:10:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:10:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:10:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:10:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:10:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2016-04-22 11:10:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:10:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:10:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:10:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:10:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:10:40 [DEBUG   ] Finished updating board flags in 1.586 seconds
2016-04-22 11:10:50 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2016-04-22 11:11:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 11:11:30 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 11:11:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:11:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:11:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:11:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:11:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:11:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:11:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:11:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:11:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:11:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:11:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:11:40 [DEBUG   ] Finished updating board flags in 1.413 seconds
2016-04-22 11:11:50 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2016-04-22 11:12:11 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2016-04-22 11:12:31 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2016-04-22 11:12:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:12:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:12:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:12:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:12:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:12:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:12:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:12:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:12:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:12:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:12:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 11:12:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2016-04-22 11:12:40 [DEBUG   ] Finished updating board flags in 1.387 seconds
2016-04-22 11:12:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 11:13:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 11:13:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 11:13:34 [DEBUG   ] Got command RPT from MCS: ref #678864
2016-04-22 11:13:34 [DEBUG   ] summary = ERROR
2016-04-22 11:13:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678864  13 57500 40414498 A  ERRORERROR'
2016-04-22 11:13:34 [DEBUG   ] Got command RPT from MCS: ref #678865
2016-04-22 11:13:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:13:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678865  77 57500 40414702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:13:34 [DEBUG   ] Got command RPT from MCS: ref #678866
2016-04-22 11:13:34 [DEBUG   ] summary = ERROR
2016-04-22 11:13:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678866  13 57500 40414906 A  ERRORERROR'
2016-04-22 11:13:35 [DEBUG   ] Got command RPT from MCS: ref #678867
2016-04-22 11:13:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:13:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678867  77 57500 40415110 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:13:35 [DEBUG   ] Got command RPT from MCS: ref #678868
2016-04-22 11:13:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 11:13:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678868  12 57500 40415302 A  ERRORB•™š'
2016-04-22 11:13:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:13:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:13:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:13:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:13:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:13:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:13:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:13:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:13:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:13:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:13:40 [DEBUG   ] Finished updating board flags in 1.356 seconds
2016-04-22 11:13:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 11:14:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 11:14:30 [DEBUG   ] Got command RPT from MCS: ref #678872
2016-04-22 11:14:30 [DEBUG   ] summary = ERROR
2016-04-22 11:14:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678872  13 57500 40470062 A  ERRORERROR'
2016-04-22 11:14:30 [DEBUG   ] Got command RPT from MCS: ref #678873
2016-04-22 11:14:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:14:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678873  77 57500 40470062 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:14:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 11:14:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:14:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:14:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:14:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:14:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:14:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 11:14:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:14:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:14:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:14:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:14:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:14:41 [DEBUG   ] Finished updating board flags in 2.109 seconds
2016-04-22 11:14:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 11:15:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 11:15:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 11:15:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:15:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:15:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:15:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:15:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:15:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:15:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:15:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:15:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:15:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:15:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:15:41 [DEBUG   ] Finished updating board flags in 1.971 seconds
2016-04-22 11:15:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 11:16:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 11:16:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 11:16:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:16:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:16:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:16:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:16:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:16:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 11:16:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 11:16:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:16:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:16:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:16:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:16:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:16:41 [DEBUG   ] Finished updating board flags in 1.826 seconds
2016-04-22 11:16:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 11:17:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 11:17:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 11:17:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:17:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:17:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:17:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:17:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:17:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 11:17:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:17:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:17:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:17:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:17:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:17:41 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:17:41 [DEBUG   ] Finished updating board flags in 1.846 seconds
2016-04-22 11:17:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 11:18:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 11:18:31 [DEBUG   ] Finished updating ant stats in 1.113 seconds
2016-04-22 11:18:34 [DEBUG   ] Got command RPT from MCS: ref #678893
2016-04-22 11:18:34 [DEBUG   ] summary = ERROR
2016-04-22 11:18:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678893  13 57500 40714590 A  ERRORERROR'
2016-04-22 11:18:34 [DEBUG   ] Got command RPT from MCS: ref #678894
2016-04-22 11:18:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:18:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678894  77 57500 40714782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:18:34 [DEBUG   ] Got command RPT from MCS: ref #678895
2016-04-22 11:18:34 [DEBUG   ] summary = ERROR
2016-04-22 11:18:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678895  13 57500 40714986 A  ERRORERROR'
2016-04-22 11:18:35 [DEBUG   ] Got command RPT from MCS: ref #678896
2016-04-22 11:18:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:18:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678896  77 57500 40715190 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:18:35 [DEBUG   ] Got command RPT from MCS: ref #678897
2016-04-22 11:18:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 11:18:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678897  12 57500 40715394 A  ERRORB”™š'
2016-04-22 11:18:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:18:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:18:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:18:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:18:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:18:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:18:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:18:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:18:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:18:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:18:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:18:41 [DEBUG   ] Finished updating board flags in 1.715 seconds
2016-04-22 11:18:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 11:19:11 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-22 11:19:30 [DEBUG   ] Got command RPT from MCS: ref #678903
2016-04-22 11:19:30 [DEBUG   ] summary = ERROR
2016-04-22 11:19:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678903  13 57500 40770058 A  ERRORERROR'
2016-04-22 11:19:30 [DEBUG   ] Got command RPT from MCS: ref #678904
2016-04-22 11:19:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:19:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678904  77 57500 40770058 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:19:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 11:19:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:19:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:19:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:19:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:19:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:19:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:19:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:19:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:19:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:19:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:19:41 [DEBUG   ] Finished updating board flags in 1.608 seconds
2016-04-22 11:19:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 11:20:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 11:20:31 [DEBUG   ] Finished updating ant stats in 0.473 seconds
2016-04-22 11:20:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:20:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:20:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:20:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:20:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:20:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:20:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:20:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:20:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:20:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:20:41 [DEBUG   ] Finished updating board flags in 1.592 seconds
2016-04-22 11:20:52 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2016-04-22 11:21:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 11:21:32 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2016-04-22 11:21:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:21:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:21:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:21:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:21:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:21:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:21:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:21:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:21:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:21:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:21:41 [DEBUG   ] Finished updating board flags in 1.420 seconds
2016-04-22 11:21:51 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-22 11:22:12 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2016-04-22 11:22:31 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-22 11:22:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:22:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:22:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:22:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:22:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:22:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:22:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:22:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:22:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:22:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:22:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 11:22:41 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:22:41 [DEBUG   ] Finished updating board flags in 1.466 seconds
2016-04-22 11:22:51 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-22 11:23:11 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 11:23:32 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 11:23:34 [DEBUG   ] Got command RPT from MCS: ref #678926
2016-04-22 11:23:34 [DEBUG   ] summary = ERROR
2016-04-22 11:23:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678926  13 57500 41014670 A  ERRORERROR'
2016-04-22 11:23:34 [DEBUG   ] Got command RPT from MCS: ref #678927
2016-04-22 11:23:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:23:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678927  77 57500 41014874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:23:35 [DEBUG   ] Got command RPT from MCS: ref #678928
2016-04-22 11:23:35 [DEBUG   ] summary = ERROR
2016-04-22 11:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678928  13 57500 41015078 A  ERRORERROR'
2016-04-22 11:23:35 [DEBUG   ] Got command RPT from MCS: ref #678929
2016-04-22 11:23:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678929  77 57500 41015277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:23:35 [DEBUG   ] Got command RPT from MCS: ref #678930
2016-04-22 11:23:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 11:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678930  12 57500 41015478 A  ERRORB•™š'
2016-04-22 11:23:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:23:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:23:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:23:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:23:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:23:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:23:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:23:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:23:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:23:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:23:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:23:41 [DEBUG   ] Finished updating board flags in 1.466 seconds
2016-04-22 11:23:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-22 11:24:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 11:24:30 [DEBUG   ] Got command RPT from MCS: ref #678931
2016-04-22 11:24:30 [DEBUG   ] summary = ERROR
2016-04-22 11:24:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678931  13 57500 41070054 A  ERRORERROR'
2016-04-22 11:24:30 [DEBUG   ] Got command RPT from MCS: ref #678932
2016-04-22 11:24:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:24:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678932  77 57500 41070054 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:24:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 11:24:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:24:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:24:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:24:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:24:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:24:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 11:24:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:24:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:24:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:24:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:24:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:24:41 [DEBUG   ] Finished updating board flags in 1.470 seconds
2016-04-22 11:24:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 11:25:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 11:25:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 11:25:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:25:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:25:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:25:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:25:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:25:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 11:25:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 11:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:25:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:25:42 [DEBUG   ] Finished updating board flags in 2.244 seconds
2016-04-22 11:25:52 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2016-04-22 11:26:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 11:26:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 11:26:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:26:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:26:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:26:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:26:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:26:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:26:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:26:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:26:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:26:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:26:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:26:42 [DEBUG   ] Finished updating board flags in 2.306 seconds
2016-04-22 11:26:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 11:27:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 11:27:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 11:27:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:27:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:27:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:27:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:27:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:27:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:27:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:27:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:27:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:27:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:27:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:27:42 [DEBUG   ] Finished updating board flags in 2.042 seconds
2016-04-22 11:27:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 11:28:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 11:28:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 11:28:34 [DEBUG   ] Got command RPT from MCS: ref #678952
2016-04-22 11:28:34 [DEBUG   ] summary = ERROR
2016-04-22 11:28:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678952  13 57500 41314762 A  ERRORERROR'
2016-04-22 11:28:34 [DEBUG   ] Got command RPT from MCS: ref #678953
2016-04-22 11:28:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:28:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678953  77 57500 41314966 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:28:35 [DEBUG   ] Got command RPT from MCS: ref #678954
2016-04-22 11:28:35 [DEBUG   ] summary = ERROR
2016-04-22 11:28:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678954  13 57500 41315158 A  ERRORERROR'
2016-04-22 11:28:35 [DEBUG   ] Got command RPT from MCS: ref #678955
2016-04-22 11:28:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:28:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678955  77 57500 41315362 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:28:35 [DEBUG   ] Got command RPT from MCS: ref #678956
2016-04-22 11:28:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 11:28:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678956  12 57500 41315566 A  ERRORB”™š'
2016-04-22 11:28:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:28:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:28:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:28:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:28:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:28:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:28:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:28:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:28:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:28:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:28:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 11:28:42 [DEBUG   ] Finished updating board flags in 2.020 seconds
2016-04-22 11:28:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 11:29:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 11:29:30 [DEBUG   ] Got command RPT from MCS: ref #678965
2016-04-22 11:29:30 [DEBUG   ] summary = ERROR
2016-04-22 11:29:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678965  13 57500 41370066 A  ERRORERROR'
2016-04-22 11:29:30 [DEBUG   ] Got command RPT from MCS: ref #678966
2016-04-22 11:29:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:29:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678966  77 57500 41370066 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:29:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 11:29:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:29:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:29:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:29:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:29:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:29:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 11:29:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:29:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:29:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:29:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:29:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:29:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 11:29:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2016-04-22 11:29:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:29:42 [DEBUG   ] Finished updating board flags in 1.979 seconds
2016-04-22 11:29:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 11:30:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 11:30:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 11:30:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:30:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:30:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:30:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:30:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:30:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 11:30:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 11:30:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:30:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:30:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:30:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:30:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:30:42 [DEBUG   ] Finished updating board flags in 1.820 seconds
2016-04-22 11:30:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 11:31:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 11:31:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 11:31:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:31:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:31:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:31:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:31:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:31:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2016-04-22 11:31:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 11:31:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:31:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:31:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:31:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:31:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:31:42 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:31:42 [DEBUG   ] Finished updating board flags in 1.850 seconds
2016-04-22 11:31:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 11:32:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 11:32:32 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2016-04-22 11:32:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:32:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:32:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:32:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:32:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:32:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:32:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:32:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:32:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:32:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:32:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:32:42 [DEBUG   ] Finished updating board flags in 1.830 seconds
2016-04-22 11:32:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 11:33:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 11:33:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 11:33:34 [DEBUG   ] Got command RPT from MCS: ref #678985
2016-04-22 11:33:34 [DEBUG   ] summary = ERROR
2016-04-22 11:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678985  13 57500 41614846 A  ERRORERROR'
2016-04-22 11:33:35 [DEBUG   ] Got command RPT from MCS: ref #678986
2016-04-22 11:33:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:33:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678986  77 57500 41615038 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:33:35 [DEBUG   ] Got command RPT from MCS: ref #678987
2016-04-22 11:33:35 [DEBUG   ] summary = ERROR
2016-04-22 11:33:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678987  13 57500 41615242 A  ERRORERROR'
2016-04-22 11:33:35 [DEBUG   ] Got command RPT from MCS: ref #678988
2016-04-22 11:33:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:33:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678988  77 57500 41615446 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:33:35 [DEBUG   ] Got command RPT from MCS: ref #678989
2016-04-22 11:33:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 11:33:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678989  12 57500 41615650 A  ERRORB”™š'
2016-04-22 11:33:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:33:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:33:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:33:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:33:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:33:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:33:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:33:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:33:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:33:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:33:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 11:33:42 [DEBUG   ] Finished updating board flags in 1.706 seconds
2016-04-22 11:33:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 11:34:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 11:34:30 [DEBUG   ] Got command RPT from MCS: ref #678990
2016-04-22 11:34:30 [DEBUG   ] summary = ERROR
2016-04-22 11:34:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678990  13 57500 41670058 A  ERRORERROR'
2016-04-22 11:34:30 [DEBUG   ] Got command RPT from MCS: ref #678991
2016-04-22 11:34:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:34:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   678991  77 57500 41670058 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:34:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 11:34:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:34:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:34:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:34:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:34:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:34:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:34:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:34:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:34:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:34:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:34:42 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:34:42 [DEBUG   ] Finished updating board flags in 1.716 seconds
2016-04-22 11:34:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 11:35:12 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 11:35:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 11:35:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:35:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:35:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:35:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:35:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:35:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:35:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:35:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:35:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:35:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:35:42 [DEBUG   ] Finished updating board flags in 1.493 seconds
2016-04-22 11:35:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 11:36:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 11:36:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 11:36:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:36:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:36:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:36:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:36:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:36:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:36:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:36:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:36:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:36:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:36:42 [DEBUG   ] Finished updating board flags in 1.418 seconds
2016-04-22 11:36:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 11:37:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 11:37:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 11:37:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:37:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:37:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:37:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:37:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:37:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:37:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:37:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:37:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:37:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:37:42 [DEBUG   ] Finished updating board flags in 1.505 seconds
2016-04-22 11:37:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 11:38:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 11:38:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 11:38:34 [DEBUG   ] Got command RPT from MCS: ref #679014
2016-04-22 11:38:34 [DEBUG   ] summary = ERROR
2016-04-22 11:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679014  13 57500 41914950 A  ERRORERROR'
2016-04-22 11:38:35 [DEBUG   ] Got command RPT from MCS: ref #679015
2016-04-22 11:38:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679015  77 57500 41915154 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:38:35 [DEBUG   ] Got command RPT from MCS: ref #679016
2016-04-22 11:38:35 [DEBUG   ] summary = ERROR
2016-04-22 11:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679016  13 57500 41915358 A  ERRORERROR'
2016-04-22 11:38:35 [DEBUG   ] Got command RPT from MCS: ref #679017
2016-04-22 11:38:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679017  77 57500 41915562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:38:35 [DEBUG   ] Got command RPT from MCS: ref #679018
2016-04-22 11:38:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 11:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679018  12 57500 41915754 A  ERRORB•™š'
2016-04-22 11:38:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:38:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:38:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:38:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:38:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:38:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:38:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:38:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:38:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:38:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:38:42 [DEBUG   ] Finished updating board flags in 1.504 seconds
2016-04-22 11:38:52 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-22 11:39:12 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 11:39:30 [DEBUG   ] Got command RPT from MCS: ref #679024
2016-04-22 11:39:30 [DEBUG   ] summary = ERROR
2016-04-22 11:39:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679024  13 57500 41970066 A  ERRORERROR'
2016-04-22 11:39:30 [DEBUG   ] Got command RPT from MCS: ref #679025
2016-04-22 11:39:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:39:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679025  77 57500 41970066 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:39:33 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2016-04-22 11:39:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:39:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:39:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:39:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:39:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:39:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 11:39:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:39:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:39:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:39:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:39:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:39:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 11:39:43 [DEBUG   ] Finished updating board flags in 2.255 seconds
2016-04-22 11:39:53 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2016-04-22 11:40:13 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2016-04-22 11:40:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2016-04-22 11:40:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:40:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:40:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:40:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:40:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:40:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:40:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:40:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:40:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:40:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:40:43 [DEBUG   ] Finished updating board flags in 2.142 seconds
2016-04-22 11:40:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 11:41:13 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-22 11:41:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 11:41:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:41:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:41:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:41:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:41:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:41:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:41:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:41:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:41:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:41:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:41:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:41:43 [DEBUG   ] Finished updating board flags in 1.991 seconds
2016-04-22 11:41:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 11:42:13 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2016-04-22 11:42:33 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-22 11:42:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:42:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:42:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:42:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:42:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:42:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:42:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:42:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:42:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:42:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:42:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:42:43 [DEBUG   ] Finished updating board flags in 1.797 seconds
2016-04-22 11:42:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 11:43:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2016-04-22 11:43:33 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-22 11:43:35 [DEBUG   ] Got command RPT from MCS: ref #679044
2016-04-22 11:43:35 [DEBUG   ] summary = ERROR
2016-04-22 11:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679044  13 57500 42215070 A  ERRORERROR'
2016-04-22 11:43:35 [DEBUG   ] Got command RPT from MCS: ref #679045
2016-04-22 11:43:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679045  77 57500 42215276 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:43:35 [DEBUG   ] Got command RPT from MCS: ref #679046
2016-04-22 11:43:35 [DEBUG   ] summary = ERROR
2016-04-22 11:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679046  13 57500 42215466 A  ERRORERROR'
2016-04-22 11:43:35 [DEBUG   ] Got command RPT from MCS: ref #679047
2016-04-22 11:43:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679047  77 57500 42215670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:43:35 [DEBUG   ] Got command RPT from MCS: ref #679048
2016-04-22 11:43:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 11:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679048  12 57500 42215874 A  ERRORB”™š'
2016-04-22 11:43:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:43:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:43:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:43:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:43:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:43:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 11:43:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:43:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:43:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:43:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:43:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:43:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 11:43:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:43:43 [DEBUG   ] Finished updating board flags in 1.644 seconds
2016-04-22 11:43:54 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2016-04-22 11:44:13 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2016-04-22 11:44:30 [DEBUG   ] Got command RPT from MCS: ref #679052
2016-04-22 11:44:30 [DEBUG   ] summary = ERROR
2016-04-22 11:44:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679052  13 57500 42270070 A  ERRORERROR'
2016-04-22 11:44:30 [DEBUG   ] Got command RPT from MCS: ref #679053
2016-04-22 11:44:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:44:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679053  77 57500 42270070 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:44:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 11:44:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:44:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:44:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:44:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:44:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:44:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:44:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:44:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:44:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:44:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:44:43 [DEBUG   ] Finished updating board flags in 1.562 seconds
2016-04-22 11:44:54 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2016-04-22 11:45:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 11:45:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 11:45:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:45:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:45:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:45:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:45:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:45:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:45:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:45:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:45:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:45:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:45:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 11:45:43 [DEBUG   ] Finished updating board flags in 1.417 seconds
2016-04-22 11:45:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-22 11:46:14 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-22 11:46:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 11:46:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:46:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:46:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:46:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:46:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:46:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 11:46:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:46:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:46:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:46:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:46:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:46:43 [DEBUG   ] Finished updating board flags in 1.391 seconds
2016-04-22 11:46:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-22 11:47:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2016-04-22 11:47:34 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-22 11:47:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:47:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:47:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:47:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:47:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:47:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:47:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:47:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:47:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:47:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:47:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:47:43 [DEBUG   ] Finished updating board flags in 1.379 seconds
2016-04-22 11:47:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 11:48:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 11:48:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 11:48:35 [DEBUG   ] Got command RPT from MCS: ref #679073
2016-04-22 11:48:35 [DEBUG   ] summary = ERROR
2016-04-22 11:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679073  13 57500 42515198 A  ERRORERROR'
2016-04-22 11:48:35 [DEBUG   ] Got command RPT from MCS: ref #679074
2016-04-22 11:48:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679074  77 57500 42515402 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:48:35 [DEBUG   ] Got command RPT from MCS: ref #679075
2016-04-22 11:48:35 [DEBUG   ] summary = ERROR
2016-04-22 11:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679075  13 57500 42515594 A  ERRORERROR'
2016-04-22 11:48:35 [DEBUG   ] Got command RPT from MCS: ref #679076
2016-04-22 11:48:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679076  77 57500 42515798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:48:36 [DEBUG   ] Got command RPT from MCS: ref #679077
2016-04-22 11:48:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 11:48:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679077  12 57500 42516002 A  ERRORB”™š'
2016-04-22 11:48:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:48:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:48:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:48:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:48:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:48:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:48:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:48:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:48:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:48:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:48:44 [DEBUG   ] Finished updating board flags in 2.039 seconds
2016-04-22 11:48:55 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2016-04-22 11:49:15 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2016-04-22 11:49:30 [DEBUG   ] Got command RPT from MCS: ref #679083
2016-04-22 11:49:30 [DEBUG   ] summary = ERROR
2016-04-22 11:49:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679083  13 57500 42570062 A  ERRORERROR'
2016-04-22 11:49:30 [DEBUG   ] Got command RPT from MCS: ref #679084
2016-04-22 11:49:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:49:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679084  77 57500 42570062 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:49:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 11:49:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:49:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:49:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:49:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:49:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:49:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:49:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:49:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:49:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:49:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:49:44 [DEBUG   ] Finished updating board flags in 1.991 seconds
2016-04-22 11:49:55 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2016-04-22 11:50:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 11:50:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2016-04-22 11:50:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:50:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:50:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:50:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:50:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:50:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:50:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:50:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:50:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:50:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:50:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 11:50:44 [DEBUG   ] Finished updating board flags in 1.820 seconds
2016-04-22 11:50:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 11:51:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 11:51:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 11:51:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:51:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:51:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:51:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:51:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:51:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:51:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:51:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:51:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:51:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:51:44 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 11:51:44 [DEBUG   ] Finished updating board flags in 1.783 seconds
2016-04-22 11:51:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-22 11:52:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 11:52:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 11:52:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:52:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:52:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:52:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:52:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:52:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:52:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:52:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:52:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:52:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:52:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 11:52:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:52:44 [DEBUG   ] Finished updating board flags in 1.617 seconds
2016-04-22 11:52:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 11:53:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 11:53:35 [DEBUG   ] Got command RPT from MCS: ref #679106
2016-04-22 11:53:35 [DEBUG   ] summary = ERROR
2016-04-22 11:53:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679106  13 57500 42815298 A  ERRORERROR'
2016-04-22 11:53:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 11:53:35 [DEBUG   ] Got command RPT from MCS: ref #679107
2016-04-22 11:53:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:53:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679107  77 57500 42815490 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:53:35 [DEBUG   ] Got command RPT from MCS: ref #679108
2016-04-22 11:53:35 [DEBUG   ] summary = ERROR
2016-04-22 11:53:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679108  13 57500 42815694 A  ERRORERROR'
2016-04-22 11:53:35 [DEBUG   ] Got command RPT from MCS: ref #679109
2016-04-22 11:53:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:53:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679109  77 57500 42815898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:53:36 [DEBUG   ] Got command RPT from MCS: ref #679110
2016-04-22 11:53:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 11:53:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679110  12 57500 42816102 A  ERRORB•™š'
2016-04-22 11:53:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:53:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:53:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:53:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:53:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:53:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:53:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:53:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:53:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:53:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:53:44 [DEBUG   ] Finished updating board flags in 1.634 seconds
2016-04-22 11:53:56 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2016-04-22 11:54:16 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2016-04-22 11:54:30 [DEBUG   ] Got command RPT from MCS: ref #679111
2016-04-22 11:54:30 [DEBUG   ] summary = ERROR
2016-04-22 11:54:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679111  13 57500 42870070 A  ERRORERROR'
2016-04-22 11:54:30 [DEBUG   ] Got command RPT from MCS: ref #679112
2016-04-22 11:54:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:54:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679112  77 57500 42870070 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:54:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 11:54:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:54:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:54:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:54:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:54:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:54:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 11:54:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:54:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:54:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:54:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:54:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:54:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:54:44 [DEBUG   ] Finished updating board flags in 1.556 seconds
2016-04-22 11:54:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 11:55:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 11:55:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2016-04-22 11:55:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:55:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:55:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:55:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:55:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:55:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 11:55:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 11:55:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:55:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:55:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:55:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:55:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:55:44 [DEBUG   ] Finished updating board flags in 1.532 seconds
2016-04-22 11:55:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 11:56:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 11:56:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 11:56:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2016-04-22 11:56:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2016-04-22 11:56:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2016-04-22 11:56:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2016-04-22 11:56:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2016-04-22 11:56:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 11:56:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2016-04-22 11:56:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2016-04-22 11:56:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2016-04-22 11:56:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2016-04-22 11:56:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2016-04-22 11:56:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:56:44 [DEBUG   ] Finished updating board flags in 1.534 seconds
2016-04-22 11:56:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 11:57:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 11:57:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2016-04-22 11:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2016-04-22 11:57:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 11:57:45 [DEBUG   ] Finished updating board flags in 2.226 seconds
2016-04-22 11:57:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 11:58:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 11:58:35 [DEBUG   ] Got command RPT from MCS: ref #679132
2016-04-22 11:58:35 [DEBUG   ] summary = ERROR
2016-04-22 11:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679132  13 57500 43115370 A  ERRORERROR'
2016-04-22 11:58:35 [DEBUG   ] Got command RPT from MCS: ref #679133
2016-04-22 11:58:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679133  77 57500 43115574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:58:35 [DEBUG   ] Got command RPT from MCS: ref #679134
2016-04-22 11:58:35 [DEBUG   ] summary = ERROR
2016-04-22 11:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679134  13 57500 43115778 A  ERRORERROR'
2016-04-22 11:58:35 [DEBUG   ] Got command RPT from MCS: ref #679135
2016-04-22 11:58:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679135  77 57500 43115970 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:58:36 [DEBUG   ] Got command RPT from MCS: ref #679136
2016-04-22 11:58:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 11:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679136  12 57500 43116174 A  ERRORB•™š'
2016-04-22 11:58:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2016-04-22 11:58:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2016-04-22 11:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2016-04-22 11:58:45 [DEBUG   ] Finished updating board flags in 2.241 seconds
2016-04-22 11:58:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 11:59:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 11:59:30 [DEBUG   ] Got command RPT from MCS: ref #679145
2016-04-22 11:59:30 [DEBUG   ] summary = ERROR
2016-04-22 11:59:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679145  13 57500 43170074 A  ERRORERROR'
2016-04-22 11:59:30 [DEBUG   ] Got command RPT from MCS: ref #679146
2016-04-22 11:59:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 11:59:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679146  77 57500 43170074 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 11:59:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 11:59:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2016-04-22 11:59:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2016-04-22 11:59:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2016-04-22 11:59:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2016-04-22 11:59:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2016-04-22 11:59:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2016-04-22 11:59:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2016-04-22 11:59:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2016-04-22 11:59:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2016-04-22 11:59:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2016-04-22 11:59:45 [DEBUG   ] Finished updating board flags in 2.071 seconds
2016-04-22 11:59:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2016-04-22 12:00:16 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-22 12:00:37 [DEBUG   ] Finished updating ant stats in 1.390 seconds
2016-04-22 12:00:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2016-04-22 12:00:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2016-04-22 12:00:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2016-04-22 12:00:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2016-04-22 12:00:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2016-04-22 12:00:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2016-04-22 12:00:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2016-04-22 12:00:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2016-04-22 12:00:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2016-04-22 12:00:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2016-04-22 12:00:45 [DEBUG   ] Finished updating board flags in 2.009 seconds
2016-04-22 12:00:57 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2016-04-22 12:01:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 12:01:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2016-04-22 12:01:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2016-04-22 12:01:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2016-04-22 12:01:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2016-04-22 12:01:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2016-04-22 12:01:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2016-04-22 12:01:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 12:01:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2016-04-22 12:01:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 12:01:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2016-04-22 12:01:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2016-04-22 12:01:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2016-04-22 12:01:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2016-04-22 12:01:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2016-04-22 12:01:45 [DEBUG   ] Finished updating board flags in 2.014 seconds
2016-04-22 12:01:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2016-04-22 12:02:17 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2016-04-22 12:02:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 12:02:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2016-04-22 12:02:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2016-04-22 12:02:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2016-04-22 12:02:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2016-04-22 12:02:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2016-04-22 12:02:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2016-04-22 12:02:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2016-04-22 12:02:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2016-04-22 12:02:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2016-04-22 12:02:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2016-04-22 12:02:45 [DEBUG   ] Finished updating board flags in 1.994 seconds
2016-04-22 12:02:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2016-04-22 12:03:17 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2016-04-22 12:03:35 [DEBUG   ] Got command RPT from MCS: ref #679165
2016-04-22 12:03:35 [DEBUG   ] summary = ERROR
2016-04-22 12:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679165  13 57500 43415446 A  ERRORERROR'
2016-04-22 12:03:35 [DEBUG   ] Got command RPT from MCS: ref #679166
2016-04-22 12:03:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 12:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679166  77 57500 43415650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 12:03:35 [DEBUG   ] Got command RPT from MCS: ref #679167
2016-04-22 12:03:35 [DEBUG   ] summary = ERROR
2016-04-22 12:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679167  13 57500 43415854 A  ERRORERROR'
2016-04-22 12:03:36 [DEBUG   ] Got command RPT from MCS: ref #679168
2016-04-22 12:03:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 12:03:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679168  77 57500 43416058 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 12:03:36 [DEBUG   ] Got command RPT from MCS: ref #679169
2016-04-22 12:03:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 12:03:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679169  12 57500 43416250 A  ERRORB”™š'
2016-04-22 12:03:37 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2016-04-22 12:03:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2016-04-22 12:03:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2016-04-22 12:03:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2016-04-22 12:03:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2016-04-22 12:03:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2016-04-22 12:03:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2016-04-22 12:03:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2016-04-22 12:03:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2016-04-22 12:03:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2016-04-22 12:03:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2016-04-22 12:03:45 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2016-04-22 12:03:45 [DEBUG   ] Finished updating board flags in 1.815 seconds
2016-04-22 12:03:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:04:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2016-04-22 12:04:30 [DEBUG   ] Got command RPT from MCS: ref #679170
2016-04-22 12:04:30 [DEBUG   ] summary = ERROR
2016-04-22 12:04:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679170  13 57500 43470078 A  ERRORERROR'
2016-04-22 12:04:30 [DEBUG   ] Got command RPT from MCS: ref #679171
2016-04-22 12:04:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 12:04:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679171  77 57500 43470078 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 12:04:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 12:04:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2016-04-22 12:04:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2016-04-22 12:04:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2016-04-22 12:04:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2016-04-22 12:04:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2016-04-22 12:04:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2016-04-22 12:04:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2016-04-22 12:04:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2016-04-22 12:04:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2016-04-22 12:04:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2016-04-22 12:04:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2016-04-22 12:04:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 12:04:45 [DEBUG   ] Finished updating board flags in 1.785 seconds
2016-04-22 12:04:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:05:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 12:05:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 12:05:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2016-04-22 12:05:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2016-04-22 12:05:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2016-04-22 12:05:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2016-04-22 12:05:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2016-04-22 12:05:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2016-04-22 12:05:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 12:05:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2016-04-22 12:05:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2016-04-22 12:05:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2016-04-22 12:05:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2016-04-22 12:05:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2016-04-22 12:05:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2016-04-22 12:05:45 [DEBUG   ] Finished updating board flags in 1.626 seconds
2016-04-22 12:05:57 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2016-04-22 12:06:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2016-04-22 12:06:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 12:06:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2016-04-22 12:06:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2016-04-22 12:06:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2016-04-22 12:06:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2016-04-22 12:06:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2016-04-22 12:06:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2016-04-22 12:06:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2016-04-22 12:06:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2016-04-22 12:06:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2016-04-22 12:06:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2016-04-22 12:06:45 [DEBUG   ] Finished updating board flags in 1.578 seconds
2016-04-22 12:06:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2016-04-22 12:07:18 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2016-04-22 12:07:38 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2016-04-22 12:07:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2016-04-22 12:07:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2016-04-22 12:07:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2016-04-22 12:07:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2016-04-22 12:07:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2016-04-22 12:07:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2016-04-22 12:07:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2016-04-22 12:07:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2016-04-22 12:07:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2016-04-22 12:07:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2016-04-22 12:07:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2016-04-22 12:07:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 12:07:45 [DEBUG   ] Finished updating board flags in 1.403 seconds
2016-04-22 12:07:58 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2016-04-22 12:08:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2016-04-22 12:08:35 [DEBUG   ] Got command RPT from MCS: ref #679194
2016-04-22 12:08:35 [DEBUG   ] summary = ERROR
2016-04-22 12:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679194  13 57500 43715538 A  ERRORERROR'
2016-04-22 12:08:35 [DEBUG   ] Got command RPT from MCS: ref #679195
2016-04-22 12:08:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 12:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679195  77 57500 43715742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 12:08:35 [DEBUG   ] Got command RPT from MCS: ref #679196
2016-04-22 12:08:35 [DEBUG   ] summary = ERROR
2016-04-22 12:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679196  13 57500 43715946 A  ERRORERROR'
2016-04-22 12:08:36 [DEBUG   ] Got command RPT from MCS: ref #679197
2016-04-22 12:08:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 12:08:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679197  77 57500 43716138 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 12:08:36 [DEBUG   ] Got command RPT from MCS: ref #679198
2016-04-22 12:08:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2016-04-22 12:08:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679198  12 57500 43716546 A  ERRORB•™š'
2016-04-22 12:08:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2016-04-22 12:08:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2016-04-22 12:08:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2016-04-22 12:08:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2016-04-22 12:08:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2016-04-22 12:08:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2016-04-22 12:08:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2016-04-22 12:08:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2016-04-22 12:08:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2016-04-22 12:08:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2016-04-22 12:08:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2016-04-22 12:08:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2016-04-22 12:08:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2016-04-22 12:08:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 12:08:45 [DEBUG   ] Finished updating board flags in 1.406 seconds
2016-04-22 12:08:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2016-04-22 12:09:00 [DEBUG   ] Got command STP from MCS: ref #679206
2016-04-22 12:09:00 [INFO    ] Finished processing BAM request
2016-04-22 12:09:00 [INFO    ] Shutdown the adder chain on beam #4
2016-04-22 12:09:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   679206   8 57500 43740662 A  ERROR'
2016-04-22 12:09:00 [DEBUG   ] Got command STP from MCS: ref #679204
2016-04-22 12:09:00 [INFO    ] Finished processing BAM request
2016-04-22 12:09:00 [INFO    ] Shutdown the adder chain on beam #2
2016-04-22 12:09:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   679204   8 57500 43740666 A  ERROR'
2016-04-22 12:09:00 [DEBUG   ] Got command STP from MCS: ref #679205
2016-04-22 12:09:00 [INFO    ] Finished processing BAM request
2016-04-22 12:09:00 [INFO    ] Shutdown the adder chain on beam #3
2016-04-22 12:09:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   679205   8 57500 43740670 A  ERROR'
2016-04-22 12:09:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2016-04-22 12:09:00 [DEBUG   ] spawn_process: at 2016-04-22 12:09:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2016-04-22 12:09:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2016-04-22 12:09:01 [DEBUG   ] spawn_process: at 2016-04-22 12:09:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2016-04-22 12:09:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2016-04-22 12:09:30 [DEBUG   ] Got command RPT from MCS: ref #679207
2016-04-22 12:09:30 [DEBUG   ] summary = ERROR
2016-04-22 12:09:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679207  13 57500 43770078 A  ERRORERROR'
2016-04-22 12:09:30 [DEBUG   ] Got command RPT from MCS: ref #679208
2016-04-22 12:09:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2016-04-22 12:09:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679208  77 57500 43770078 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2016-04-22 12:09:38 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2016-04-22 12:09:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2016-04-22 12:09:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2016-04-22 12:09:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2016-04-22 12:09:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2016-04-22 12:09:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2016-04-22 12:09:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2016-04-22 12:09:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2016-04-22 12:09:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2016-04-22 12:09:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2016-04-22 12:09:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2016-04-22 12:09:45 [DEBUG   ] Finished updating board flags in 1.391 seconds
2016-04-22 12:09:58 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2016-04-22 12:10:18 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2016-04-22 12:10:39 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2016-04-22 12:10:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2016-04-22 12:10:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2016-04-22 12:10:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2016-04-22 12:10:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2016-04-22 12:10:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2016-04-22 12:10:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 12:10:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2016-04-22 12:10:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2016-04-22 12:10:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2016-04-22 12:10:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2016-04-22 12:10:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2016-04-22 12:10:45 [DEBUG   ] Finished updating board flags in 1.353 seconds
2016-04-22 12:10:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2016-04-22 12:11:00 [DEBUG   ] Got command INI from MCS: ref #679228
2016-04-22 12:11:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2016-04-22 12:11:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   679228   8 57500 43860346 ABOOTING'
2016-04-22 12:11:24 [INFO    ] -------------------
2016-04-22 12:11:24 [INFO    ]  LWA board status
2016-04-22 12:11:24 [INFO    ] -------------------
2016-04-22 12:11:24 [INFO    ] DP 1: 2 lwa27
2016-04-22 12:11:24 [INFO    ] DP 1: 3 lwa24
2016-04-22 12:11:24 [INFO    ] DP 1: 4 lwa23
2016-04-22 12:11:24 [INFO    ] DP 1: 5 lwa18
2016-04-22 12:11:24 [INFO    ] DP 1: 6 lwa10
2016-04-22 12:11:24 [INFO    ] DP 1: 7 lwa32
2016-04-22 12:11:24 [INFO    ] DP 1: 8 lwa11
2016-04-22 12:11:24 [INFO    ] DP 1: 9 lwa30
2016-04-22 12:11:24 [INFO    ] DP 1: 10 lwa12
2016-04-22 12:11:24 [INFO    ] DP 1: 11 lwa8
2016-04-22 12:11:24 [INFO    ] DP 1: 12 lwa13
2016-04-22 12:11:24 [INFO    ] DP 1: 13 lwa26
2016-04-22 12:11:24 [INFO    ] DP 1: 14 lwa14
2016-04-22 12:11:24 [INFO    ] DP 1: 16 lwa22
2016-04-22 12:11:24 [INFO    ] DP 1: 17 lwa20
2016-04-22 12:11:24 [INFO    ] DP 1: 18 lwa1
2016-04-22 12:11:24 [INFO    ] DP 1: 19 lwa5
2016-04-22 12:11:24 [INFO    ] DP 1: 20 lwa25
2016-04-22 12:11:24 [INFO    ] DP 1: 21 lwa35
2016-04-22 12:11:24 [INFO    ] DP 1: 22 lwa19
2016-04-22 12:11:24 [INFO    ] DP 1: 23 lwa21
2016-04-22 12:11:24 [INFO    ] DP 1: 24 lwa6
2016-04-22 12:11:24 [INFO    ] DP 1: 25 lwa7
2016-04-22 12:11:24 [INFO    ] DP 1: 26 lwa33
2016-04-22 12:11:24 [INFO    ] DP 1: 27 lwa15
2016-04-22 12:11:24 [INFO    ] DP 1: 28 lwa28
2016-04-22 12:11:24 [INFO    ] DP 2: 1 lwa16
2016-04-22 12:11:24 [INFO    ] DP 2: 15 lwa34
2016-04-22 12:11:24 [INFO    ] Total of 28 boards
2016-04-22 12:11:24 [INFO    ] Total of 260 stands
2016-04-22 12:11:24 [INFO    ] -------------------
2016-04-22 12:11:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31032
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31033
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31034
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31035
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31036
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31037
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31038
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31039
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31040
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31041
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31042
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31043
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31044
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31045
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31046
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31047
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31048
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31049
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31050
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31051
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31052
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31053
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31054
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31055
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31056
2016-04-22 12:11:31 [DEBUG   ] 2016-04-22 12:11:31 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31057
2016-04-22 12:11:43 [DEBUG   ] 2016-04-22 12:11:43 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31032 exited with status 0
2016-04-22 12:11:43 [DEBUG   ] 2016-04-22 12:11:43 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31033 exited with status 0
2016-04-22 12:11:43 [DEBUG   ] 2016-04-22 12:11:43 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31034 exited with status 0
2016-04-22 12:11:43 [DEBUG   ] 2016-04-22 12:11:43 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31035 exited with status 0
2016-04-22 12:11:43 [DEBUG   ] 2016-04-22 12:11:43 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31036 exited with status 0
2016-04-22 12:11:43 [DEBUG   ] 2016-04-22 12:11:43 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31037 exited with status 0
2016-04-22 12:11:43 [DEBUG   ] 2016-04-22 12:11:43 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31038 exited with status 0
2016-04-22 12:11:44 [DEBUG   ] 2016-04-22 12:11:44 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31039 exited with status 0
2016-04-22 12:11:44 [DEBUG   ] 2016-04-22 12:11:44 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31040 exited with status 0
2016-04-22 12:11:44 [DEBUG   ] 2016-04-22 12:11:44 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31041 exited with status 0
2016-04-22 12:11:44 [DEBUG   ] 2016-04-22 12:11:44 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31042 exited with status 0
2016-04-22 12:11:44 [DEBUG   ] 2016-04-22 12:11:44 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31043 exited with status 0
2016-04-22 12:11:44 [DEBUG   ] 2016-04-22 12:11:44 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31044 exited with status 0
2016-04-22 12:11:44 [DEBUG   ] 2016-04-22 12:11:44 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31045 exited with status 0
2016-04-22 12:11:44 [DEBUG   ] 2016-04-22 12:11:44 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31046 exited with status 0
2016-04-22 12:11:44 [DEBUG   ] 2016-04-22 12:11:44 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31047 exited with status 0
2016-04-22 12:11:44 [DEBUG   ] 2016-04-22 12:11:44 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31048 exited with status 0
2016-04-22 12:11:44 [DEBUG   ] 2016-04-22 12:11:44 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31049 exited with status 0
2016-04-22 12:11:44 [DEBUG   ] 2016-04-22 12:11:44 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31050 exited with status 0
2016-04-22 12:11:44 [DEBUG   ] 2016-04-22 12:11:44 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31051 exited with status 0
2016-04-22 12:11:44 [DEBUG   ] 2016-04-22 12:11:44 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31052 exited with status 0
2016-04-22 12:11:44 [DEBUG   ] 2016-04-22 12:11:44 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31053 exited with status 0
2016-04-22 12:11:44 [DEBUG   ] 2016-04-22 12:11:44 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31054 exited with status 0
2016-04-22 12:11:44 [DEBUG   ] 2016-04-22 12:11:44 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31055 exited with status 0
2016-04-22 12:11:44 [DEBUG   ] 2016-04-22 12:11:44 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31056 exited with status 0
2016-04-22 12:11:44 [DEBUG   ] 2016-04-22 12:11:44 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31057 exited with status 0
2016-04-22 12:11:44 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] spawn_process: at 2016-04-22 12:11:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2016-04-22 12:11:44 [DEBUG   ] 2016-04-22 12:11:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 31084
2016-04-22 12:11:44 [DEBUG   ] 2016-04-22 12:11:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 31085
2016-04-22 12:11:49 [DEBUG   ] 2016-04-22 12:11:49 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 31084 exited with status 0
2016-04-22 12:11:49 [DEBUG   ] 2016-04-22 12:11:49 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 31085 exited with status 0
2016-04-22 12:11:49 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2016-04-22 12:11:49 [DEBUG   ] spawn_process: at 2016-04-22 12:11:49 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2016-04-22 12:11:49 [DEBUG   ] spawn_process: at 2016-04-22 12:11:49 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2016-04-22 12:11:49 [INFO    ] Setting Beam 1 xbars
2016-04-22 12:11:49 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2016-04-22 12:11:49 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2016-04-22 12:11:49 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2016-04-22 12:11:50 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2016-04-22 12:11:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2016-04-22 12:11:50 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2016-04-22 12:11:50 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2016-04-22 12:11:50 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2016-04-22 12:11:50 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2016-04-22 12:11:50 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2016-04-22 12:11:50 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2016-04-22 12:11:50 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2016-04-22 12:11:50 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2016-04-22 12:11:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2016-04-22 12:11:51 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2016-04-22 12:11:51 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2016-04-22 12:11:51 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2016-04-22 12:11:51 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2016-04-22 12:11:51 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2016-04-22 12:11:51 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2016-04-22 12:11:51 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2016-04-22 12:11:51 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2016-04-22 12:11:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2016-04-22 12:11:52 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2016-04-22 12:11:52 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2016-04-22 12:11:52 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2016-04-22 12:11:52 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2016-04-22 12:11:52 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2016-04-22 12:11:52 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2016-04-22 12:11:52 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2016-04-22 12:11:52 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2016-04-22 12:11:53 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2016-04-22 12:11:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2016-04-22 12:11:53 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2016-04-22 12:11:53 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2016-04-22 12:11:53 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2016-04-22 12:11:53 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2016-04-22 12:11:53 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2016-04-22 12:11:53 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2016-04-22 12:11:53 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2016-04-22 12:11:54 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2016-04-22 12:11:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2016-04-22 12:11:54 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2016-04-22 12:11:54 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2016-04-22 12:11:54 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2016-04-22 12:11:54 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2016-04-22 12:11:54 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2016-04-22 12:11:54 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2016-04-22 12:11:54 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2016-04-22 12:11:54 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2016-04-22 12:11:55 [INFO    ] Setting Beam 2 xbars
2016-04-22 12:11:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2016-04-22 12:11:55 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2016-04-22 12:11:55 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2016-04-22 12:11:55 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2016-04-22 12:11:55 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2016-04-22 12:11:55 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2016-04-22 12:11:55 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2016-04-22 12:11:55 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2016-04-22 12:11:55 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2016-04-22 12:11:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2016-04-22 12:11:56 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2016-04-22 12:11:56 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2016-04-22 12:11:56 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2016-04-22 12:11:56 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2016-04-22 12:11:56 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2016-04-22 12:11:56 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2016-04-22 12:11:56 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2016-04-22 12:11:56 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2016-04-22 12:11:57 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2016-04-22 12:11:57 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2016-04-22 12:11:57 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2016-04-22 12:11:57 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2016-04-22 12:11:57 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2016-04-22 12:11:57 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2016-04-22 12:11:57 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2016-04-22 12:11:57 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2016-04-22 12:11:57 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2016-04-22 12:11:58 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2016-04-22 12:11:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2016-04-22 12:11:58 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2016-04-22 12:11:58 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2016-04-22 12:11:58 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2016-04-22 12:11:58 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2016-04-22 12:11:58 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2016-04-22 12:11:58 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2016-04-22 12:11:58 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2016-04-22 12:11:59 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2016-04-22 12:11:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2016-04-22 12:11:59 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2016-04-22 12:11:59 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2016-04-22 12:11:59 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2016-04-22 12:11:59 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2016-04-22 12:11:59 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2016-04-22 12:11:59 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2016-04-22 12:11:59 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2016-04-22 12:11:59 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2016-04-22 12:12:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2016-04-22 12:12:00 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2016-04-22 12:12:00 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2016-04-22 12:12:00 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2016-04-22 12:12:00 [INFO    ] Setting Beam 3 xbars
2016-04-22 12:12:00 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2016-04-22 12:12:00 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2016-04-22 12:12:00 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2016-04-22 12:12:00 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2016-04-22 12:12:00 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2016-04-22 12:12:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2016-04-22 12:12:01 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2016-04-22 12:12:01 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2016-04-22 12:12:01 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2016-04-22 12:12:01 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2016-04-22 12:12:01 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2016-04-22 12:12:01 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2016-04-22 12:12:01 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2016-04-22 12:12:01 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2016-04-22 12:12:02 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2016-04-22 12:12:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2016-04-22 12:12:02 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2016-04-22 12:12:02 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2016-04-22 12:12:02 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2016-04-22 12:12:02 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2016-04-22 12:12:02 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2016-04-22 12:12:02 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2016-04-22 12:12:03 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2016-04-22 12:12:03 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2016-04-22 12:12:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2016-04-22 12:12:03 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2016-04-22 12:12:03 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2016-04-22 12:12:03 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2016-04-22 12:12:03 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2016-04-22 12:12:03 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2016-04-22 12:12:03 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2016-04-22 12:12:03 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2016-04-22 12:12:04 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2016-04-22 12:12:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2016-04-22 12:12:04 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2016-04-22 12:12:04 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2016-04-22 12:12:04 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2016-04-22 12:12:04 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2016-04-22 12:12:04 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2016-04-22 12:12:04 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2016-04-22 12:12:04 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2016-04-22 12:12:05 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2016-04-22 12:12:05 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2016-04-22 12:12:05 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2016-04-22 12:12:05 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2016-04-22 12:12:05 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2016-04-22 12:12:05 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2016-04-22 12:12:05 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2016-04-22 12:12:05 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2016-04-22 12:12:05 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2016-04-22 12:12:06 [INFO    ] Setting Beam 4 xbars
2016-04-22 12:12:06 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2016-04-22 12:12:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2016-04-22 12:12:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2016-04-22 12:12:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2016-04-22 12:12:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2016-04-22 12:12:06 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2016-04-22 12:12:06 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2016-04-22 12:12:06 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2016-04-22 12:12:06 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2016-04-22 12:12:07 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2016-04-22 12:12:07 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2016-04-22 12:12:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2016-04-22 12:12:07 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2016-04-22 12:12:07 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2016-04-22 12:12:07 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2016-04-22 12:12:07 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2016-04-22 12:12:07 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2016-04-22 12:12:07 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2016-04-22 12:12:08 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2016-04-22 12:12:08 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2016-04-22 12:12:08 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2016-04-22 12:12:08 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2016-04-22 12:12:08 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2016-04-22 12:12:08 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2016-04-22 12:12:08 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2016-04-22 12:12:08 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2016-04-22 12:12:08 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2016-04-22 12:12:08 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2016-04-22 12:12:09 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2016-04-22 12:12:09 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2016-04-22 12:12:09 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2016-04-22 12:12:09 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2016-04-22 12:12:09 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2016-04-22 12:12:09 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2016-04-22 12:12:09 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2016-04-22 12:12:09 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2016-04-22 12:12:09 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2016-04-22 12:12:10 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2016-04-22 12:12:10 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2016-04-22 12:12:10 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2016-04-22 12:12:10 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2016-04-22 12:12:10 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2016-04-22 12:12:10 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2016-04-22 12:12:10 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2016-04-22 12:12:10 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2016-04-22 12:12:10 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2016-04-22 12:12:11 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2016-04-22 12:12:11 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2016-04-22 12:12:12 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2016-04-22 12:12:12 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2016-04-22 12:12:12 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2016-04-22 12:12:12 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2016-04-22 12:12:12 [INFO    ] All xbars set
2016-04-22 12:12:12 [INFO    ] Setting adder chain routing for all beams
2016-04-22 12:12:17 [INFO    ] Setting beam ids
2016-04-22 12:12:27 [INFO    ] Starting beam delay calibration
2016-04-22 12:12:39 [INFO    ] Beam 1 latency is 5734
2016-04-22 12:12:39 [INFO    ] Beam 2 latency is 5747
2016-04-22 12:12:39 [INFO    ] Beam 3 latency is 5740
2016-04-22 12:12:39 [INFO    ] Beam 4 latency is 5736
2016-04-22 12:12:39 [INFO    ] Stop calibration
2016-04-22 12:12:47 [INFO    ] Beam delay calibration successful
2016-04-22 12:12:47 [INFO    ] Calibration passed
2016-04-22 12:12:47 [DEBUG   ] spawn_process: at 2016-04-22 12:12:47 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2016-04-22 12:12:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2016-04-22 12:12:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2016-04-22 12:12:47 [DEBUG   ] spawn_process: at 2016-04-22 12:12:47 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2016-04-22 12:12:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2016-04-22 12:12:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2016-04-22 12:12:47 [DEBUG   ] spawn_process: at 2016-04-22 12:12:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2016-04-22 12:12:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2016-04-22 12:12:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2016-04-22 12:12:47 [DEBUG   ] spawn_process: at 2016-04-22 12:12:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2016-04-22 12:12:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2016-04-22 12:12:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2016-04-22 12:12:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2016-04-22 12:12:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 263 ms (1461327168.265 s) with PID 32664 and time 1461327169
2016-04-22 12:12:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2016-04-22 12:12:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 352 ms (1461327168.354 s) with PID 32667 and time 1461327169
2016-04-22 12:12:49 [DEBUG   ] Finished updating ant stats in 0.893 seconds
2016-04-22 12:12:49 [INFO    ] Started antennas statistics background thread
2016-04-22 12:12:49 [INFO    ] Started board flags background thread
2016-04-22 12:12:49 [INFO    ] Started BAM background thread
2016-04-22 12:12:49 [INFO    ] Finished the INI process (ref. #679228) in 109.129 s
2016-04-22 12:12:50 [DEBUG   ] Finished updating board flags in 1.081 seconds
2016-04-22 12:13:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:13:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:13:30 [DEBUG   ] Got command RPT from MCS: ref #679235
2016-04-22 12:13:30 [DEBUG   ] summary = NORMAL
2016-04-22 12:13:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679235  14 57500 44010354 A NORMALNORMAL'
2016-04-22 12:13:30 [DEBUG   ] Got command RPT from MCS: ref #679236
2016-04-22 12:13:30 [DEBUG   ] info = System calibrated and operating normally
2016-04-22 12:13:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679236  48 57500 44010354 A NORMALSystem calibrated and operating normally'
2016-04-22 12:13:35 [DEBUG   ] Got command RPT from MCS: ref #679237
2016-04-22 12:13:35 [DEBUG   ] summary = NORMAL
2016-04-22 12:13:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679237  14 57500 44015622 A NORMALNORMAL'
2016-04-22 12:13:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2016-04-22 12:13:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2016-04-22 12:13:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 12:13:50 [DEBUG   ] Finished updating board flags in 1.017 seconds
2016-04-22 12:14:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:14:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:14:30 [DEBUG   ] Got command RPT from MCS: ref #679241
2016-04-22 12:14:30 [DEBUG   ] summary = NORMAL
2016-04-22 12:14:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679241  14 57500 44070074 A NORMALNORMAL'
2016-04-22 12:14:30 [DEBUG   ] Got command RPT from MCS: ref #679242
2016-04-22 12:14:30 [DEBUG   ] info = System calibrated and operating normally
2016-04-22 12:14:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679242  48 57500 44070074 A NORMALSystem calibrated and operating normally'
2016-04-22 12:14:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2016-04-22 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2016-04-22 12:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2016-04-22 12:14:50 [DEBUG   ] Finished updating board flags in 1.052 seconds
2016-04-22 12:15:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:15:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:15:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:15:51 [DEBUG   ] Finished updating board flags in 1.863 seconds
2016-04-22 12:16:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:16:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:16:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:16:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 12:16:51 [DEBUG   ] Finished updating board flags in 1.719 seconds
2016-04-22 12:17:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:17:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:17:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:17:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 12:17:50 [DEBUG   ] Finished updating board flags in 1.062 seconds
2016-04-22 12:18:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 12:18:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:18:35 [DEBUG   ] Got command RPT from MCS: ref #679262
2016-04-22 12:18:35 [DEBUG   ] summary = NORMAL
2016-04-22 12:18:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679262  14 57500 44315706 A NORMALNORMAL'
2016-04-22 12:18:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 12:18:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 12:18:50 [DEBUG   ] Finished updating board flags in 1.016 seconds
2016-04-22 12:19:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:19:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:19:30 [DEBUG   ] Got command RPT from MCS: ref #679268
2016-04-22 12:19:30 [DEBUG   ] summary = NORMAL
2016-04-22 12:19:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679268  14 57500 44370074 A NORMALNORMAL'
2016-04-22 12:19:30 [DEBUG   ] Got command RPT from MCS: ref #679269
2016-04-22 12:19:30 [DEBUG   ] info = System calibrated and operating normally
2016-04-22 12:19:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679269  48 57500 44370074 A NORMALSystem calibrated and operating normally'
2016-04-22 12:19:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2016-04-22 12:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2016-04-22 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2016-04-22 12:19:51 [DEBUG   ] Finished updating board flags in 1.568 seconds
2016-04-22 12:20:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2016-04-22 12:20:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:20:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2016-04-22 12:20:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2016-04-22 12:20:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2016-04-22 12:20:51 [DEBUG   ] Finished updating board flags in 1.371 seconds
2016-04-22 12:21:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:21:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:21:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2016-04-22 12:21:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 12:21:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 12:21:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 12:21:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 12:21:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 12:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 12:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 12:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 12:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 12:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 12:21:51 [DEBUG   ] Finished updating board flags in 1.260 seconds
2016-04-22 12:22:09 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2016-04-22 12:22:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 12:22:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2016-04-22 12:22:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 12:22:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 12:22:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 12:22:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 12:22:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 12:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 12:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 12:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 12:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 12:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 12:22:51 [DEBUG   ] Finished updating board flags in 1.212 seconds
2016-04-22 12:23:09 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2016-04-22 12:23:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2016-04-22 12:23:35 [DEBUG   ] Got command RPT from MCS: ref #679291
2016-04-22 12:23:35 [DEBUG   ] summary = NORMAL
2016-04-22 12:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679291  14 57500 44615798 A NORMALNORMAL'
2016-04-22 12:23:49 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 12:23:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 12:23:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 12:23:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 12:23:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 12:23:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 12:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 12:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 12:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 12:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 12:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 12:23:51 [DEBUG   ] Finished updating board flags in 1.131 seconds
2016-04-22 12:24:09 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-22 12:24:29 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2016-04-22 12:24:30 [DEBUG   ] Got command RPT from MCS: ref #679292
2016-04-22 12:24:30 [DEBUG   ] summary = NORMAL
2016-04-22 12:24:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679292  14 57500 44670082 A NORMALNORMAL'
2016-04-22 12:24:30 [DEBUG   ] Got command RPT from MCS: ref #679293
2016-04-22 12:24:30 [DEBUG   ] info = System calibrated and operating normally
2016-04-22 12:24:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   679293  48 57500 44670082 A NORMALSystem calibrated and operating normally'
2016-04-22 12:24:49 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2016-04-22 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2016-04-22 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2016-04-22 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2016-04-22 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2016-04-22 12:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2016-04-22 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2016-04-22 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2016-04-22 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2016-04-22 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2016-04-22 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2016-04-22 12:24:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2016-04-22 12:24:51 [DEBUG   ] Finished updating board flags in 1.017 seconds
