2014-03-18 12:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:25:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:25:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:25:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:25:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:25:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:25:04 [DEBUG   ] Finished updating board flags in 1.594 seconds
2014-03-18 12:25:11 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-18 12:25:31 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 12:25:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 12:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:26:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:26:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:26:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:26:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:26:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:26:04 [DEBUG   ] Finished updating board flags in 1.462 seconds
2014-03-18 12:26:11 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 12:26:31 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 12:26:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 12:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:27:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:27:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:27:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:27:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:27:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:27:04 [DEBUG   ] Finished updating board flags in 1.470 seconds
2014-03-18 12:27:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 12:27:31 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 12:27:43 [DEBUG   ] Got command RPT from MCS: ref #401960
2014-03-18 12:27:43 [DEBUG   ] summary = ERROR
2014-03-18 12:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   401960  13 56734 44863385 A  ERRORERROR'
2014-03-18 12:27:43 [DEBUG   ] Got command RPT from MCS: ref #401961
2014-03-18 12:27:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 12:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   401961  77 56734 44863386 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 12:27:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 12:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:28:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:28:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:28:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:28:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:28:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:28:04 [DEBUG   ] Finished updating board flags in 1.454 seconds
2014-03-18 12:28:12 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-18 12:28:32 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 12:28:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 12:29:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:29:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:29:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:29:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:29:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:29:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:29:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:29:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:29:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:29:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:29:05 [DEBUG   ] Finished updating board flags in 2.210 seconds
2014-03-18 12:29:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 12:29:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 12:29:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 12:30:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:30:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:30:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:30:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:30:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:30:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:30:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:30:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:30:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:30:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:30:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-03-18 12:30:05 [DEBUG   ] Finished updating board flags in 2.195 seconds
2014-03-18 12:30:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 12:30:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 12:30:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 12:31:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:31:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:31:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:31:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:31:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:31:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:31:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:31:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:31:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:31:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:31:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 12:31:05 [DEBUG   ] Finished updating board flags in 2.018 seconds
2014-03-18 12:31:12 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2014-03-18 12:31:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 12:31:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 12:32:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:32:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:32:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:32:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:32:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:32:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:32:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:32:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:32:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:32:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:32:05 [DEBUG   ] Finished updating board flags in 1.983 seconds
2014-03-18 12:32:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 12:32:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 12:32:43 [DEBUG   ] Got command RPT from MCS: ref #401977
2014-03-18 12:32:43 [DEBUG   ] summary = ERROR
2014-03-18 12:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   401977  13 56734 45163393 A  ERRORERROR'
2014-03-18 12:32:43 [DEBUG   ] Got command RPT from MCS: ref #401978
2014-03-18 12:32:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 12:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   401978  77 56734 45163394 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 12:32:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 12:33:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:33:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:33:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:33:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:33:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:33:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:33:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:33:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:33:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:33:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:33:05 [DEBUG   ] Finished updating board flags in 1.819 seconds
2014-03-18 12:33:12 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-18 12:33:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 12:33:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 12:34:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:34:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:34:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:34:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:34:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:34:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:34:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:34:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:34:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:34:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:34:05 [DEBUG   ] Finished updating board flags in 1.884 seconds
2014-03-18 12:34:12 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2014-03-18 12:34:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 12:34:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 12:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:35:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:35:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:35:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:35:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:35:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:35:05 [DEBUG   ] Finished updating board flags in 1.708 seconds
2014-03-18 12:35:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 12:35:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 12:35:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 12:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:36:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:36:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:36:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:36:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:36:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:36:05 [DEBUG   ] Finished updating board flags in 1.611 seconds
2014-03-18 12:36:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 12:36:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 12:36:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 12:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:37:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:37:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:37:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:37:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:37:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:37:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 12:37:05 [DEBUG   ] Finished updating board flags in 1.598 seconds
2014-03-18 12:37:12 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 12:37:33 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-18 12:37:43 [DEBUG   ] Got command RPT from MCS: ref #401994
2014-03-18 12:37:43 [DEBUG   ] summary = ERROR
2014-03-18 12:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   401994  13 56734 45463397 A  ERRORERROR'
2014-03-18 12:37:43 [DEBUG   ] Got command RPT from MCS: ref #401995
2014-03-18 12:37:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 12:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   401995  77 56734 45463398 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 12:37:53 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-18 12:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:38:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:38:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:38:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:38:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:38:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:38:05 [DEBUG   ] Finished updating board flags in 1.392 seconds
2014-03-18 12:38:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 12:38:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 12:38:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 12:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:39:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:39:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:39:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:39:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:39:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:39:05 [DEBUG   ] Finished updating board flags in 1.364 seconds
2014-03-18 12:39:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 12:39:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 12:39:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 12:40:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:40:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:40:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:40:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:40:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:40:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:40:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:40:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:40:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:40:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:40:06 [DEBUG   ] Finished updating board flags in 2.046 seconds
2014-03-18 12:40:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 12:40:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 12:40:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 12:41:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:41:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:41:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:41:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:41:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:41:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:41:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:41:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:41:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:41:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:41:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 12:41:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-18 12:41:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-03-18 12:41:06 [DEBUG   ] Finished updating board flags in 2.102 seconds
2014-03-18 12:41:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 12:41:33 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 12:41:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 12:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:42:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:42:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:42:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:42:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:42:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:42:06 [DEBUG   ] Finished updating board flags in 2.015 seconds
2014-03-18 12:42:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 12:42:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 12:42:43 [DEBUG   ] Got command RPT from MCS: ref #402011
2014-03-18 12:42:43 [DEBUG   ] summary = ERROR
2014-03-18 12:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402011  13 56734 45763398 A  ERRORERROR'
2014-03-18 12:42:43 [DEBUG   ] Got command RPT from MCS: ref #402012
2014-03-18 12:42:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 12:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402012  77 56734 45763398 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 12:42:53 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 12:43:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:43:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:43:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:43:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:43:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:43:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:43:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:43:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:43:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:43:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:43:06 [DEBUG   ] Finished updating board flags in 1.880 seconds
2014-03-18 12:43:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 12:43:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 12:43:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 12:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:44:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:44:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:44:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:44:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:44:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:44:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-18 12:44:06 [DEBUG   ] Finished updating board flags in 1.815 seconds
2014-03-18 12:44:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 12:44:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 12:44:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 12:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:45:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:45:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:45:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:45:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:45:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:45:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-18 12:45:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 12:45:06 [DEBUG   ] Finished updating board flags in 1.810 seconds
2014-03-18 12:45:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-18 12:45:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 12:45:53 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-03-18 12:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:46:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:46:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:46:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:46:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:46:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:46:06 [DEBUG   ] Finished updating board flags in 1.782 seconds
2014-03-18 12:46:14 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-18 12:46:34 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-18 12:46:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 12:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:47:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:47:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:47:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:47:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:47:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:47:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 12:47:06 [DEBUG   ] Finished updating board flags in 1.611 seconds
2014-03-18 12:47:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 12:47:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 12:47:43 [DEBUG   ] Got command RPT from MCS: ref #402028
2014-03-18 12:47:43 [DEBUG   ] summary = ERROR
2014-03-18 12:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402028  13 56734 46063397 A  ERRORERROR'
2014-03-18 12:47:43 [DEBUG   ] Got command RPT from MCS: ref #402029
2014-03-18 12:47:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 12:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402029  77 56734 46063398 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 12:47:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 12:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:48:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:48:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:48:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:48:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:48:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:48:06 [DEBUG   ] Finished updating board flags in 1.601 seconds
2014-03-18 12:48:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 12:48:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 12:48:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 12:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:49:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:49:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:49:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:49:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:49:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:49:06 [DEBUG   ] Finished updating board flags in 1.614 seconds
2014-03-18 12:49:14 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-18 12:49:34 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-18 12:49:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 12:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:50:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:50:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:50:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:50:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:50:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:50:06 [DEBUG   ] Finished updating board flags in 1.427 seconds
2014-03-18 12:50:15 [DEBUG   ] Finished updating ant stats in 1.298 seconds
2014-03-18 12:50:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 12:50:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 12:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:51:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:51:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:51:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:51:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:51:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:51:06 [DEBUG   ] Finished updating board flags in 1.413 seconds
2014-03-18 12:51:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 12:51:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 12:51:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 12:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:52:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:52:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:52:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:52:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:52:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:52:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 12:52:06 [DEBUG   ] Finished updating board flags in 1.401 seconds
2014-03-18 12:52:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 12:52:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 12:52:43 [DEBUG   ] Got command RPT from MCS: ref #402045
2014-03-18 12:52:43 [DEBUG   ] summary = ERROR
2014-03-18 12:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402045  13 56734 46363401 A  ERRORERROR'
2014-03-18 12:52:43 [DEBUG   ] Got command RPT from MCS: ref #402046
2014-03-18 12:52:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 12:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402046  77 56734 46363402 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 12:52:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 12:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:53:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:53:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:53:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:53:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:53:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:53:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 12:53:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-03-18 12:53:06 [CRITICAL] MGT underflow detected on beam(s) 1
2014-03-18 12:53:06 [DEBUG   ] Finished updating board flags in 1.415 seconds
2014-03-18 12:53:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 12:53:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 12:53:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 12:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:54:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:54:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:54:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:54:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:54:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:54:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 12:54:06 [DEBUG   ] Finished updating board flags in 1.541 seconds
2014-03-18 12:54:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 12:54:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 12:54:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 12:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:55:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-18 12:55:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:55:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:55:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:55:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:55:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:55:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 12:55:06 [DEBUG   ] Finished updating board flags in 1.567 seconds
2014-03-18 12:55:15 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 12:55:35 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-03-18 12:55:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 12:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:56:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 12:56:07 [DEBUG   ] Finished updating board flags in 2.189 seconds
2014-03-18 12:56:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 12:56:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 12:56:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 12:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:57:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 12:57:07 [DEBUG   ] Finished updating board flags in 1.904 seconds
2014-03-18 12:57:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 12:57:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 12:57:43 [DEBUG   ] Got command RPT from MCS: ref #402062
2014-03-18 12:57:43 [DEBUG   ] summary = ERROR
2014-03-18 12:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402062  13 56734 46663397 A  ERRORERROR'
2014-03-18 12:57:43 [DEBUG   ] Got command RPT from MCS: ref #402063
2014-03-18 12:57:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 12:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402063  77 56734 46663398 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 12:57:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 12:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:58:07 [DEBUG   ] Finished updating board flags in 1.827 seconds
2014-03-18 12:58:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 12:58:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 12:58:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 12:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 12:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 12:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 12:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 12:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 12:59:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 12:59:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 12:59:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 12:59:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 12:59:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 12:59:07 [DEBUG   ] Finished updating board flags in 1.779 seconds
2014-03-18 12:59:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 12:59:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 12:59:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 13:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:00:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:00:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:00:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:00:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:00:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:00:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 13:00:07 [DEBUG   ] Finished updating board flags in 1.622 seconds
2014-03-18 13:00:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-18 13:00:35 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 13:00:56 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-18 13:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:01:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:01:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:01:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:01:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:01:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:01:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 13:01:07 [DEBUG   ] Finished updating board flags in 1.578 seconds
2014-03-18 13:01:16 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-18 13:01:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 13:01:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 13:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:02:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:02:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:02:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:02:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:02:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:02:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 13:02:07 [DEBUG   ] Finished updating board flags in 1.404 seconds
2014-03-18 13:02:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 13:02:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 13:02:43 [DEBUG   ] Got command RPT from MCS: ref #402079
2014-03-18 13:02:43 [DEBUG   ] summary = ERROR
2014-03-18 13:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402079  13 56734 46963401 A  ERRORERROR'
2014-03-18 13:02:43 [DEBUG   ] Got command RPT from MCS: ref #402080
2014-03-18 13:02:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 13:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402080  77 56734 46963402 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 13:02:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 13:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:03:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:03:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:03:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:03:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:03:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:03:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 13:03:07 [DEBUG   ] Finished updating board flags in 1.530 seconds
2014-03-18 13:03:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 13:03:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 13:03:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 13:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:04:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 13:04:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:04:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:04:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:04:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:04:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:04:07 [DEBUG   ] Finished updating board flags in 1.562 seconds
2014-03-18 13:04:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 13:04:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 13:04:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 13:05:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:05:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:05:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:05:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:05:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:05:08 [DEBUG   ] Finished updating board flags in 2.210 seconds
2014-03-18 13:05:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 13:05:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 13:05:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 13:06:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:06:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:06:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:06:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:06:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:06:08 [DEBUG   ] Finished updating board flags in 2.098 seconds
2014-03-18 13:06:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 13:06:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 13:06:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 13:07:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:07:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:07:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:07:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:07:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:07:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 13:07:08 [DEBUG   ] Finished updating board flags in 2.038 seconds
2014-03-18 13:07:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 13:07:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 13:07:43 [DEBUG   ] Got command RPT from MCS: ref #402096
2014-03-18 13:07:43 [DEBUG   ] summary = ERROR
2014-03-18 13:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402096  13 56734 47263393 A  ERRORERROR'
2014-03-18 13:07:43 [DEBUG   ] Got command RPT from MCS: ref #402097
2014-03-18 13:07:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 13:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402097  77 56734 47263394 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 13:07:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 13:08:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:08:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:08:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:08:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:08:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:08:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:08:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:08:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:08:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:08:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:08:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 13:08:08 [DEBUG   ] Finished updating board flags in 1.965 seconds
2014-03-18 13:08:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 13:08:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 13:08:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 13:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:09:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:09:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:09:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:09:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:09:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:09:08 [DEBUG   ] Finished updating board flags in 1.820 seconds
2014-03-18 13:09:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 13:09:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 13:09:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 13:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:10:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:10:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:10:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:10:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:10:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:10:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 13:10:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-18 13:10:08 [DEBUG   ] Finished updating board flags in 1.882 seconds
2014-03-18 13:10:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 13:10:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 13:10:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 13:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:11:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:11:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:11:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:11:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:11:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:11:08 [DEBUG   ] Finished updating board flags in 1.723 seconds
2014-03-18 13:11:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 13:11:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 13:11:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 13:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:12:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:12:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:12:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:12:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:12:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:12:08 [DEBUG   ] Finished updating board flags in 1.619 seconds
2014-03-18 13:12:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 13:12:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 13:12:43 [DEBUG   ] Got command RPT from MCS: ref #402113
2014-03-18 13:12:43 [DEBUG   ] summary = ERROR
2014-03-18 13:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402113  13 56734 47563397 A  ERRORERROR'
2014-03-18 13:12:43 [DEBUG   ] Got command RPT from MCS: ref #402114
2014-03-18 13:12:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 13:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402114  77 56734 47563398 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 13:12:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 13:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:13:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:13:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:13:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:13:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:13:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:13:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 13:13:08 [DEBUG   ] Finished updating board flags in 1.588 seconds
2014-03-18 13:13:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 13:13:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 13:13:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 13:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:14:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:14:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:14:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:14:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:14:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:14:08 [DEBUG   ] Finished updating board flags in 1.488 seconds
2014-03-18 13:14:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 13:14:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 13:14:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 13:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:15:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:15:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:15:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:15:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:15:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:15:08 [DEBUG   ] Finished updating board flags in 1.492 seconds
2014-03-18 13:15:17 [DEBUG   ] Finished updating ant stats in 1.386 seconds
2014-03-18 13:15:37 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-18 13:15:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 13:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:16:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:16:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:16:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:16:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:16:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:16:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-03-18 13:16:08 [DEBUG   ] Finished updating board flags in 1.493 seconds
2014-03-18 13:16:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 13:16:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 13:16:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 13:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:17:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:17:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:17:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:17:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:17:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:17:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-18 13:17:09 [DEBUG   ] Finished updating board flags in 2.152 seconds
2014-03-18 13:17:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 13:17:37 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-18 13:17:43 [DEBUG   ] Got command RPT from MCS: ref #402130
2014-03-18 13:17:43 [DEBUG   ] summary = ERROR
2014-03-18 13:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402130  13 56734 47863405 A  ERRORERROR'
2014-03-18 13:17:43 [DEBUG   ] Got command RPT from MCS: ref #402131
2014-03-18 13:17:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 13:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402131  77 56734 47863406 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 13:17:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 13:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:18:09 [DEBUG   ] Finished updating board flags in 1.979 seconds
2014-03-18 13:18:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 13:18:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 13:18:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 13:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:19:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:19:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:19:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:19:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:19:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:19:09 [DEBUG   ] Finished updating board flags in 1.849 seconds
2014-03-18 13:19:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 13:19:37 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2014-03-18 13:19:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 13:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:20:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 13:20:09 [DEBUG   ] Finished updating board flags in 1.741 seconds
2014-03-18 13:20:17 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-18 13:20:38 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-18 13:20:58 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-18 13:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:21:09 [DEBUG   ] Finished updating board flags in 1.609 seconds
2014-03-18 13:21:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 13:21:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 13:21:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 13:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:22:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 13:22:09 [DEBUG   ] Finished updating board flags in 1.607 seconds
2014-03-18 13:22:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 13:22:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 13:22:43 [DEBUG   ] Got command RPT from MCS: ref #402147
2014-03-18 13:22:43 [DEBUG   ] summary = ERROR
2014-03-18 13:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402147  13 56734 48163405 A  ERRORERROR'
2014-03-18 13:22:43 [DEBUG   ] Got command RPT from MCS: ref #402148
2014-03-18 13:22:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 13:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402148  77 56734 48163406 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 13:22:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 13:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 13:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 13:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 13:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 13:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 13:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 13:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 13:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 13:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 13:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 13:23:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-18 13:23:09 [DEBUG   ] Finished updating board flags in 1.588 seconds
2014-03-18 13:23:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 13:23:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 13:23:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2014-03-18 13:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2014-03-18 13:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2014-03-18 13:24:09 [DEBUG   ] Finished updating board flags in 1.441 seconds
2014-03-18 13:24:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 13:24:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 13:24:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-18 13:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-18 13:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-18 13:25:09 [DEBUG   ] Finished updating board flags in 1.597 seconds
2014-03-18 13:25:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 13:25:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 13:25:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 13:26:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:26:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:26:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:26:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:26:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:26:10 [DEBUG   ] Finished updating board flags in 2.294 seconds
2014-03-18 13:26:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 13:26:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 13:26:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 13:27:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:27:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:27:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:27:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:27:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:27:10 [DEBUG   ] Finished updating board flags in 2.083 seconds
2014-03-18 13:27:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 13:27:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 13:27:43 [DEBUG   ] Got command RPT from MCS: ref #402164
2014-03-18 13:27:43 [DEBUG   ] summary = ERROR
2014-03-18 13:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402164  13 56734 48463401 A  ERRORERROR'
2014-03-18 13:27:43 [DEBUG   ] Got command RPT from MCS: ref #402165
2014-03-18 13:27:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 13:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402165  77 56734 48463402 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 13:27:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 13:28:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:28:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:28:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:28:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:28:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:28:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 13:28:10 [DEBUG   ] Finished updating board flags in 2.024 seconds
2014-03-18 13:28:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 13:28:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 13:28:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 13:29:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:29:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:29:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:29:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:29:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:29:10 [DEBUG   ] Finished updating board flags in 1.977 seconds
2014-03-18 13:29:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 13:29:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 13:29:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 13:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:30:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 13:30:10 [DEBUG   ] Finished updating board flags in 1.829 seconds
2014-03-18 13:30:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 13:30:38 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 13:30:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 13:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:31:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:31:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:31:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:31:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:31:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:31:10 [DEBUG   ] Finished updating board flags in 1.801 seconds
2014-03-18 13:31:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 13:31:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 13:31:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 13:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:32:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:32:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:32:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:32:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:32:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:32:10 [DEBUG   ] Finished updating board flags in 1.780 seconds
2014-03-18 13:32:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 13:32:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 13:32:43 [DEBUG   ] Got command RPT from MCS: ref #402181
2014-03-18 13:32:43 [DEBUG   ] summary = ERROR
2014-03-18 13:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402181  13 56734 48763405 A  ERRORERROR'
2014-03-18 13:32:43 [DEBUG   ] Got command RPT from MCS: ref #402182
2014-03-18 13:32:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 13:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402182  77 56734 48763406 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 13:32:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 13:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:33:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:33:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:33:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:33:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:33:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:33:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-18 13:33:10 [DEBUG   ] Finished updating board flags in 1.615 seconds
2014-03-18 13:33:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 13:33:38 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2014-03-18 13:33:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 13:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:34:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:34:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:34:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:34:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:34:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:34:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 13:34:10 [DEBUG   ] Finished updating board flags in 1.578 seconds
2014-03-18 13:34:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 13:34:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 13:34:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 13:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:35:10 [DEBUG   ] Finished updating board flags in 1.482 seconds
2014-03-18 13:35:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 13:35:39 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-18 13:35:59 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-18 13:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:36:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:36:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:36:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:36:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:36:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:36:10 [DEBUG   ] Finished updating board flags in 1.491 seconds
2014-03-18 13:36:19 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 13:36:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 13:36:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 13:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:37:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:37:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:37:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:37:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:37:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:37:10 [DEBUG   ] Finished updating board flags in 1.478 seconds
2014-03-18 13:37:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 13:37:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 13:37:43 [DEBUG   ] Got command RPT from MCS: ref #402198
2014-03-18 13:37:43 [DEBUG   ] summary = ERROR
2014-03-18 13:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402198  13 56734 49063401 A  ERRORERROR'
2014-03-18 13:37:43 [DEBUG   ] Got command RPT from MCS: ref #402199
2014-03-18 13:37:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 13:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402199  77 56734 49063402 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 13:37:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 13:38:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:38:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:38:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:38:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:38:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:38:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:38:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:38:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:38:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:38:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:38:11 [DEBUG   ] Finished updating board flags in 2.203 seconds
2014-03-18 13:38:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 13:38:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 13:38:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 13:39:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:39:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:39:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:39:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:39:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:39:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-03-18 13:39:11 [DEBUG   ] Finished updating board flags in 2.254 seconds
2014-03-18 13:39:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 13:39:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 13:39:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 13:40:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:40:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:40:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:40:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:40:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:40:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:40:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:40:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:40:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:40:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:40:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 13:40:11 [DEBUG   ] Finished updating board flags in 2.208 seconds
2014-03-18 13:40:19 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 13:40:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 13:40:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 13:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:41:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:41:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:41:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:41:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:41:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:41:11 [DEBUG   ] Finished updating board flags in 2.111 seconds
2014-03-18 13:41:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 13:41:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 13:41:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 13:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:42:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-18 13:42:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:42:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:42:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:42:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:42:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:42:11 [DEBUG   ] Finished updating board flags in 2.007 seconds
2014-03-18 13:42:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 13:42:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 13:42:43 [DEBUG   ] Got command RPT from MCS: ref #402215
2014-03-18 13:42:43 [DEBUG   ] summary = ERROR
2014-03-18 13:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402215  13 56734 49363413 A  ERRORERROR'
2014-03-18 13:42:43 [DEBUG   ] Got command RPT from MCS: ref #402216
2014-03-18 13:42:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 13:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402216  77 56734 49363414 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 13:42:59 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 13:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:43:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:43:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:43:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:43:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:43:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:43:11 [DEBUG   ] Finished updating board flags in 1.986 seconds
2014-03-18 13:43:20 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-18 13:43:40 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 13:44:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 13:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:44:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-18 13:44:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:44:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:44:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:44:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:44:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:44:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 13:44:11 [DEBUG   ] Finished updating board flags in 1.819 seconds
2014-03-18 13:44:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 13:44:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 13:45:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 13:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:45:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-18 13:45:11 [DEBUG   ] Finished updating board flags in 1.793 seconds
2014-03-18 13:45:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 13:45:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 13:46:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 13:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:46:11 [DEBUG   ] Finished updating board flags in 1.625 seconds
2014-03-18 13:46:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 13:46:40 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 13:47:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 13:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:47:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-03-18 13:47:11 [DEBUG   ] Finished updating board flags in 1.588 seconds
2014-03-18 13:47:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 13:47:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 13:47:43 [DEBUG   ] Got command RPT from MCS: ref #402232
2014-03-18 13:47:43 [DEBUG   ] summary = ERROR
2014-03-18 13:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402232  13 56734 49663413 A  ERRORERROR'
2014-03-18 13:47:43 [DEBUG   ] Got command RPT from MCS: ref #402233
2014-03-18 13:47:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 13:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402233  77 56734 49663414 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 13:48:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 13:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:48:11 [DEBUG   ] Finished updating board flags in 1.411 seconds
2014-03-18 13:48:20 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-18 13:48:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 13:49:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 13:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:49:11 [DEBUG   ] Finished updating board flags in 1.382 seconds
2014-03-18 13:49:20 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-18 13:49:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 13:50:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 13:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:50:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-03-18 13:50:11 [DEBUG   ] Finished updating board flags in 1.394 seconds
2014-03-18 13:50:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 13:50:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 13:51:01 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-18 13:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:51:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 13:51:12 [DEBUG   ] Finished updating board flags in 2.018 seconds
2014-03-18 13:51:21 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 13:51:41 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 13:52:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 13:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:52:12 [DEBUG   ] Finished updating board flags in 2.008 seconds
2014-03-18 13:52:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 13:52:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 13:52:43 [DEBUG   ] Got command RPT from MCS: ref #402249
2014-03-18 13:52:43 [DEBUG   ] summary = ERROR
2014-03-18 13:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402249  13 56734 49963405 A  ERRORERROR'
2014-03-18 13:52:43 [DEBUG   ] Got command RPT from MCS: ref #402250
2014-03-18 13:52:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 13:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402250  77 56734 49963406 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 13:53:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 13:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:53:12 [DEBUG   ] Finished updating board flags in 2.062 seconds
2014-03-18 13:53:21 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-18 13:53:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 13:54:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 13:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:54:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:54:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:54:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:54:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:54:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:54:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-03-18 13:54:12 [DEBUG   ] Finished updating board flags in 1.923 seconds
2014-03-18 13:54:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 13:54:41 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-03-18 13:55:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 13:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:55:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:55:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:55:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:55:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:55:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:55:12 [DEBUG   ] Finished updating board flags in 1.820 seconds
2014-03-18 13:55:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 13:55:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 13:56:01 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-18 13:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:56:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:56:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:56:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:56:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:56:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:56:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 13:56:12 [DEBUG   ] Finished updating board flags in 1.802 seconds
2014-03-18 13:56:22 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-18 13:56:42 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-18 13:57:02 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 13:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:57:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 13:57:12 [DEBUG   ] Finished updating board flags in 1.822 seconds
2014-03-18 13:57:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 13:57:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 13:57:43 [DEBUG   ] Got command RPT from MCS: ref #402266
2014-03-18 13:57:43 [DEBUG   ] summary = ERROR
2014-03-18 13:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402266  13 56734 50263413 A  ERRORERROR'
2014-03-18 13:57:43 [DEBUG   ] Got command RPT from MCS: ref #402267
2014-03-18 13:57:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 13:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402267  77 56734 50263414 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 13:58:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 13:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:58:12 [DEBUG   ] Finished updating board flags in 1.769 seconds
2014-03-18 13:58:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 13:58:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 13:59:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 13:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 13:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 13:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 13:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 13:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 13:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 13:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 13:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 13:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 13:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 13:59:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 13:59:12 [DEBUG   ] Finished updating board flags in 1.613 seconds
2014-03-18 13:59:22 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-18 13:59:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 14:00:02 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-18 14:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:00:12 [DEBUG   ] Finished updating board flags in 1.573 seconds
2014-03-18 14:00:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 14:00:43 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-18 14:01:03 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 14:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:01:12 [DEBUG   ] Finished updating board flags in 1.420 seconds
2014-03-18 14:01:23 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 14:01:43 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-18 14:02:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 14:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:02:12 [DEBUG   ] Finished updating board flags in 1.391 seconds
2014-03-18 14:02:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 14:02:43 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-18 14:02:43 [DEBUG   ] Got command RPT from MCS: ref #402283
2014-03-18 14:02:43 [DEBUG   ] summary = ERROR
2014-03-18 14:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402283  13 56734 50563413 A  ERRORERROR'
2014-03-18 14:02:43 [DEBUG   ] Got command RPT from MCS: ref #402284
2014-03-18 14:02:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 14:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402284  77 56734 50563414 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 14:03:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 14:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:03:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-03-18 14:03:12 [DEBUG   ] Finished updating board flags in 1.372 seconds
2014-03-18 14:03:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 14:03:43 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 14:04:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 14:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:04:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:04:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:04:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:04:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:04:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:04:13 [DEBUG   ] Finished updating board flags in 2.041 seconds
2014-03-18 14:04:23 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-03-18 14:04:44 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-18 14:05:04 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 14:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:05:13 [DEBUG   ] Finished updating board flags in 2.012 seconds
2014-03-18 14:05:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 14:05:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 14:06:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 14:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:06:13 [DEBUG   ] Finished updating board flags in 1.996 seconds
2014-03-18 14:06:24 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2014-03-18 14:06:44 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-18 14:07:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 14:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:07:13 [DEBUG   ] Finished updating board flags in 1.814 seconds
2014-03-18 14:07:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 14:07:43 [DEBUG   ] Got command RPT from MCS: ref #402300
2014-03-18 14:07:43 [DEBUG   ] summary = ERROR
2014-03-18 14:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402300  13 56734 50863417 A  ERRORERROR'
2014-03-18 14:07:43 [DEBUG   ] Got command RPT from MCS: ref #402301
2014-03-18 14:07:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 14:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402301  77 56734 50863418 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 14:07:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 14:08:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 14:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:08:13 [DEBUG   ] Finished updating board flags in 1.785 seconds
2014-03-18 14:08:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 14:08:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 14:09:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 14:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:09:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 14:09:13 [DEBUG   ] Finished updating board flags in 1.607 seconds
2014-03-18 14:09:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 14:09:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 14:10:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 14:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:10:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:10:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:10:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:10:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:10:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:10:13 [DEBUG   ] Finished updating board flags in 1.643 seconds
2014-03-18 14:10:25 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-03-18 14:10:45 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 14:11:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 14:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:11:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:11:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:11:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:11:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:11:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:11:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 14:11:13 [DEBUG   ] Finished updating board flags in 1.551 seconds
2014-03-18 14:11:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 14:11:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 14:12:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 14:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:12:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:12:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:12:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:12:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:12:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:12:13 [DEBUG   ] Finished updating board flags in 1.495 seconds
2014-03-18 14:12:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 14:12:43 [DEBUG   ] Got command RPT from MCS: ref #402317
2014-03-18 14:12:43 [DEBUG   ] summary = ERROR
2014-03-18 14:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402317  13 56734 51163413 A  ERRORERROR'
2014-03-18 14:12:43 [DEBUG   ] Got command RPT from MCS: ref #402318
2014-03-18 14:12:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 14:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402318  77 56734 51163414 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 14:12:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 14:13:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 14:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:13:13 [DEBUG   ] Finished updating board flags in 1.489 seconds
2014-03-18 14:13:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 14:13:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 14:14:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 14:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:14:13 [DEBUG   ] Finished updating board flags in 1.502 seconds
2014-03-18 14:14:25 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-18 14:14:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 14:15:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 14:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:15:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:15:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:15:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:15:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:15:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:15:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-03-18 14:15:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 14:15:14 [DEBUG   ] Finished updating board flags in 2.218 seconds
2014-03-18 14:15:25 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 14:15:45 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-03-18 14:16:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 14:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:16:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:16:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:16:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:16:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:16:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:16:14 [DEBUG   ] Finished updating board flags in 2.111 seconds
2014-03-18 14:16:26 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-18 14:16:46 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-18 14:17:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 14:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:17:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:17:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:17:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:17:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:17:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2014-03-18 14:17:14 [DEBUG   ] Finished updating board flags in 2.018 seconds
2014-03-18 14:17:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 14:17:43 [DEBUG   ] Got command RPT from MCS: ref #402334
2014-03-18 14:17:43 [DEBUG   ] summary = ERROR
2014-03-18 14:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402334  13 56734 51463414 A  ERRORERROR'
2014-03-18 14:17:43 [DEBUG   ] Got command RPT from MCS: ref #402335
2014-03-18 14:17:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 14:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402335  77 56734 51463414 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 14:17:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 14:18:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 14:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:18:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:18:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:18:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:18:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:18:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:18:14 [DEBUG   ] Finished updating board flags in 2.009 seconds
2014-03-18 14:18:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 14:18:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 14:19:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 14:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:19:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:19:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:19:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:19:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:19:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:19:14 [DEBUG   ] Finished updating board flags in 2.022 seconds
2014-03-18 14:19:26 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-03-18 14:19:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 14:20:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 14:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:20:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:20:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:20:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:20:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:20:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:20:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 14:20:14 [DEBUG   ] Finished updating board flags in 1.977 seconds
2014-03-18 14:20:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 14:20:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 14:21:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 14:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:21:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:21:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:21:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:21:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:21:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:21:14 [DEBUG   ] Finished updating board flags in 1.799 seconds
2014-03-18 14:21:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 14:21:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 14:22:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 14:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:22:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:22:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:22:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:22:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:22:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:22:14 [DEBUG   ] Finished updating board flags in 1.596 seconds
2014-03-18 14:22:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 14:22:43 [DEBUG   ] Got command RPT from MCS: ref #402351
2014-03-18 14:22:43 [DEBUG   ] summary = ERROR
2014-03-18 14:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402351  13 56734 51763414 A  ERRORERROR'
2014-03-18 14:22:43 [DEBUG   ] Got command RPT from MCS: ref #402352
2014-03-18 14:22:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 14:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402352  77 56734 51763414 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 14:22:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 14:23:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 14:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:23:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:23:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:23:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:23:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:23:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:23:14 [DEBUG   ] Finished updating board flags in 1.495 seconds
2014-03-18 14:23:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 14:23:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 14:24:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 14:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:24:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:24:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:24:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:24:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:24:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:24:14 [DEBUG   ] Finished updating board flags in 1.507 seconds
2014-03-18 14:24:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 14:24:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 14:25:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 14:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:25:15 [DEBUG   ] Finished updating board flags in 1.580 seconds
2014-03-18 14:25:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 14:25:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 14:26:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 14:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:26:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:26:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:26:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:26:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:26:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:26:15 [DEBUG   ] Finished updating board flags in 2.147 seconds
2014-03-18 14:26:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 14:26:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 14:27:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 14:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:27:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:27:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:27:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:27:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:27:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:27:15 [DEBUG   ] Finished updating board flags in 1.877 seconds
2014-03-18 14:27:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 14:27:43 [DEBUG   ] Got command RPT from MCS: ref #402368
2014-03-18 14:27:43 [DEBUG   ] summary = ERROR
2014-03-18 14:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402368  13 56734 52063421 A  ERRORERROR'
2014-03-18 14:27:43 [DEBUG   ] Got command RPT from MCS: ref #402369
2014-03-18 14:27:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 14:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402369  77 56734 52063422 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 14:27:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 14:28:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 14:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:28:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:28:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:28:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:28:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:28:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:28:15 [DEBUG   ] Finished updating board flags in 1.828 seconds
2014-03-18 14:28:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 14:28:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 14:29:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 14:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:29:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:29:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:29:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:29:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:29:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 14:29:15 [DEBUG   ] Finished updating board flags in 1.773 seconds
2014-03-18 14:29:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 14:29:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 14:30:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 14:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:30:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:30:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:30:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:30:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:30:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:30:15 [DEBUG   ] Finished updating board flags in 1.627 seconds
2014-03-18 14:30:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 14:30:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 14:31:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 14:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:31:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:31:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:31:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:31:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:31:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:31:15 [DEBUG   ] Finished updating board flags in 1.679 seconds
2014-03-18 14:31:26 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-03-18 14:31:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 14:32:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 14:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:32:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:32:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:32:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:32:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:32:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:32:15 [DEBUG   ] Finished updating board flags in 1.500 seconds
2014-03-18 14:32:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 14:32:43 [DEBUG   ] Got command RPT from MCS: ref #402385
2014-03-18 14:32:43 [DEBUG   ] summary = ERROR
2014-03-18 14:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402385  13 56734 52363418 A  ERRORERROR'
2014-03-18 14:32:43 [DEBUG   ] Got command RPT from MCS: ref #402386
2014-03-18 14:32:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 14:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402386  77 56734 52363418 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 14:32:46 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-18 14:33:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 14:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:33:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:33:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:33:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:33:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:33:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:33:15 [DEBUG   ] Finished updating board flags in 1.453 seconds
2014-03-18 14:33:27 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-18 14:33:47 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 14:34:07 [DEBUG   ] Finished updating ant stats in 1.151 seconds
2014-03-18 14:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:34:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:34:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:34:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:34:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:34:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:34:15 [DEBUG   ] Finished updating board flags in 1.453 seconds
2014-03-18 14:34:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 14:34:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 14:35:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 14:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:35:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:35:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:35:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:35:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:35:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:35:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 14:35:15 [DEBUG   ] Finished updating board flags in 1.456 seconds
2014-03-18 14:35:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 14:35:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 14:36:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 14:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:36:15 [DEBUG   ] Finished updating board flags in 1.505 seconds
2014-03-18 14:36:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 14:36:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 14:37:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 14:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:37:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:37:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:37:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:37:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:37:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:37:16 [DEBUG   ] Finished updating board flags in 2.181 seconds
2014-03-18 14:37:27 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-18 14:37:43 [DEBUG   ] Got command RPT from MCS: ref #402402
2014-03-18 14:37:43 [DEBUG   ] summary = ERROR
2014-03-18 14:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402402  13 56734 52663421 A  ERRORERROR'
2014-03-18 14:37:43 [DEBUG   ] Got command RPT from MCS: ref #402403
2014-03-18 14:37:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 14:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402403  77 56734 52663422 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 14:37:48 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2014-03-18 14:38:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 14:38:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:38:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:38:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:38:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:38:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:38:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 14:38:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:38:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:38:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:38:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:38:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:38:16 [DEBUG   ] Finished updating board flags in 1.960 seconds
2014-03-18 14:38:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 14:38:47 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-03-18 14:39:08 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2014-03-18 14:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:39:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:39:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:39:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:39:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:39:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:39:16 [DEBUG   ] Finished updating board flags in 1.809 seconds
2014-03-18 14:39:28 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-18 14:39:48 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-18 14:40:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 14:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:40:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:40:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:40:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:40:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:40:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:40:16 [DEBUG   ] Finished updating board flags in 1.910 seconds
2014-03-18 14:40:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 14:40:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 14:41:08 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-03-18 14:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:41:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:41:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:41:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:41:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:41:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:41:16 [DEBUG   ] Finished updating board flags in 1.678 seconds
2014-03-18 14:41:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 14:41:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 14:42:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 14:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:42:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:42:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:42:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:42:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:42:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:42:16 [DEBUG   ] Finished updating board flags in 1.629 seconds
2014-03-18 14:42:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 14:42:43 [DEBUG   ] Got command RPT from MCS: ref #402419
2014-03-18 14:42:43 [DEBUG   ] summary = ERROR
2014-03-18 14:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402419  13 56734 52963417 A  ERRORERROR'
2014-03-18 14:42:43 [DEBUG   ] Got command RPT from MCS: ref #402420
2014-03-18 14:42:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 14:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402420  77 56734 52963418 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 14:42:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 14:43:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 14:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:43:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:43:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:43:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:43:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:43:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:43:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-03-18 14:43:16 [DEBUG   ] Finished updating board flags in 1.581 seconds
2014-03-18 14:43:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 14:43:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 14:44:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 14:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:44:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:44:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:44:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:44:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:44:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:44:16 [DEBUG   ] Finished updating board flags in 1.503 seconds
2014-03-18 14:44:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 14:44:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 14:45:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 14:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:45:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:45:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:45:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:45:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:45:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:45:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 14:45:16 [DEBUG   ] Finished updating board flags in 1.496 seconds
2014-03-18 14:45:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 14:45:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 14:46:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 14:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:46:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 14:46:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:46:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:46:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:46:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:46:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:46:16 [DEBUG   ] Finished updating board flags in 1.498 seconds
2014-03-18 14:46:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 14:46:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 14:47:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 14:47:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:47:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:47:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:47:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:47:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:47:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:47:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:47:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:47:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:47:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:47:17 [DEBUG   ] Finished updating board flags in 2.203 seconds
2014-03-18 14:47:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 14:47:43 [DEBUG   ] Got command RPT from MCS: ref #402436
2014-03-18 14:47:43 [DEBUG   ] summary = ERROR
2014-03-18 14:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402436  13 56734 53263421 A  ERRORERROR'
2014-03-18 14:47:43 [DEBUG   ] Got command RPT from MCS: ref #402437
2014-03-18 14:47:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 14:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402437  77 56734 53263422 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 14:47:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-18 14:48:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 14:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:48:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:48:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:48:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:48:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:48:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:48:17 [DEBUG   ] Finished updating board flags in 2.129 seconds
2014-03-18 14:48:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 14:48:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 14:49:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 14:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:49:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:49:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:49:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:49:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:49:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:49:17 [DEBUG   ] Finished updating board flags in 2.016 seconds
2014-03-18 14:49:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 14:49:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 14:50:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 14:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:50:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:50:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:50:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:50:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:50:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:50:17 [DEBUG   ] Finished updating board flags in 1.977 seconds
2014-03-18 14:50:28 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-18 14:50:49 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-18 14:51:09 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-18 14:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:51:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:51:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:51:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:51:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:51:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:51:17 [DEBUG   ] Finished updating board flags in 1.831 seconds
2014-03-18 14:51:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 14:51:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 14:52:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 14:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:52:17 [DEBUG   ] Finished updating board flags in 1.762 seconds
2014-03-18 14:52:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 14:52:43 [DEBUG   ] Got command RPT from MCS: ref #402453
2014-03-18 14:52:43 [DEBUG   ] summary = ERROR
2014-03-18 14:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402453  13 56734 53563422 A  ERRORERROR'
2014-03-18 14:52:43 [DEBUG   ] Got command RPT from MCS: ref #402454
2014-03-18 14:52:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 14:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402454  77 56734 53563422 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 14:52:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 14:53:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 14:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:53:17 [DEBUG   ] Finished updating board flags in 1.614 seconds
2014-03-18 14:53:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 14:53:49 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 14:54:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 14:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:54:17 [DEBUG   ] Finished updating board flags in 1.591 seconds
2014-03-18 14:54:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 14:54:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 14:55:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 14:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:55:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:55:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:55:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:55:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:55:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:55:17 [DEBUG   ] Finished updating board flags in 1.543 seconds
2014-03-18 14:55:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 14:55:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 14:56:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 14:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:56:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:56:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:56:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:56:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:56:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:56:17 [DEBUG   ] Finished updating board flags in 1.553 seconds
2014-03-18 14:56:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 14:56:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 14:57:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 14:57:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:57:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:57:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:57:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:57:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:57:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:57:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:57:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:57:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:57:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:57:18 [DEBUG   ] Finished updating board flags in 2.228 seconds
2014-03-18 14:57:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 14:57:43 [DEBUG   ] Got command RPT from MCS: ref #402470
2014-03-18 14:57:43 [DEBUG   ] summary = ERROR
2014-03-18 14:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402470  13 56734 53863429 A  ERRORERROR'
2014-03-18 14:57:43 [DEBUG   ] Got command RPT from MCS: ref #402471
2014-03-18 14:57:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 14:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402471  77 56734 53863430 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 14:57:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 14:58:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 14:58:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:58:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:58:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:58:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:58:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:58:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:58:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:58:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:58:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:58:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:58:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 14:58:18 [DEBUG   ] Finished updating board flags in 2.052 seconds
2014-03-18 14:58:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 14:58:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 14:59:09 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-03-18 14:59:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 14:59:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 14:59:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 14:59:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 14:59:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 14:59:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 14:59:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 14:59:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 14:59:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 14:59:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 14:59:18 [DEBUG   ] Finished updating board flags in 2.009 seconds
2014-03-18 14:59:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-18 14:59:50 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 15:00:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 15:00:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:00:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:00:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:00:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:00:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:00:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:00:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:00:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:00:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:00:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:00:18 [DEBUG   ] Finished updating board flags in 1.996 seconds
2014-03-18 15:00:30 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-03-18 15:00:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 15:01:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 15:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:01:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:01:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:01:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:01:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:01:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:01:18 [DEBUG   ] Finished updating board flags in 1.805 seconds
2014-03-18 15:01:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 15:01:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 15:02:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 15:02:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:02:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:02:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:02:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:02:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:02:18 [DEBUG   ] Finished updating board flags in 1.803 seconds
2014-03-18 15:02:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 15:02:43 [DEBUG   ] Got command RPT from MCS: ref #402487
2014-03-18 15:02:43 [DEBUG   ] summary = ERROR
2014-03-18 15:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402487  13 56734 54163425 A  ERRORERROR'
2014-03-18 15:02:43 [DEBUG   ] Got command RPT from MCS: ref #402488
2014-03-18 15:02:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 15:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402488  77 56734 54163426 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 15:02:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 15:03:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 15:03:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:03:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:03:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:03:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:03:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:03:18 [DEBUG   ] Finished updating board flags in 1.824 seconds
2014-03-18 15:03:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 15:03:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 15:04:10 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-18 15:04:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:04:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:04:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:04:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:04:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:04:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:04:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:04:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:04:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:04:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:04:18 [DEBUG   ] Finished updating board flags in 1.780 seconds
2014-03-18 15:04:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 15:04:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 15:05:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 15:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:05:18 [DEBUG   ] Finished updating board flags in 1.632 seconds
2014-03-18 15:05:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 15:05:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 15:06:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 15:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:06:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 15:06:18 [DEBUG   ] Finished updating board flags in 1.652 seconds
2014-03-18 15:06:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 15:06:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 15:07:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 15:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:07:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:07:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:07:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:07:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:07:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:07:18 [DEBUG   ] Finished updating board flags in 1.627 seconds
2014-03-18 15:07:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 15:07:43 [DEBUG   ] Got command RPT from MCS: ref #402504
2014-03-18 15:07:43 [DEBUG   ] summary = ERROR
2014-03-18 15:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402504  13 56734 54463429 A  ERRORERROR'
2014-03-18 15:07:43 [DEBUG   ] Got command RPT from MCS: ref #402505
2014-03-18 15:07:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 15:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402505  77 56734 54463430 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 15:07:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 15:08:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 15:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:08:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:08:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:08:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:08:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:08:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:08:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 15:08:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 15:08:18 [DEBUG   ] Finished updating board flags in 1.516 seconds
2014-03-18 15:08:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 15:08:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 15:09:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 15:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:09:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 15:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:09:18 [DEBUG   ] Finished updating board flags in 1.517 seconds
2014-03-18 15:09:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 15:09:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 15:10:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-18 15:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:10:18 [DEBUG   ] Finished updating board flags in 1.521 seconds
2014-03-18 15:10:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 15:10:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 15:11:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 15:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:11:19 [DEBUG   ] Finished updating board flags in 2.174 seconds
2014-03-18 15:11:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 15:11:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 15:12:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-18 15:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:12:19 [DEBUG   ] Finished updating board flags in 2.014 seconds
2014-03-18 15:12:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 15:12:43 [DEBUG   ] Got command RPT from MCS: ref #402521
2014-03-18 15:12:43 [DEBUG   ] summary = ERROR
2014-03-18 15:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402521  13 56734 54763430 A  ERRORERROR'
2014-03-18 15:12:43 [DEBUG   ] Got command RPT from MCS: ref #402522
2014-03-18 15:12:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 15:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402522  77 56734 54763430 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 15:12:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 15:13:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 15:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:13:19 [DEBUG   ] Finished updating board flags in 2.089 seconds
2014-03-18 15:13:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 15:13:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 15:14:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 15:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:14:19 [DEBUG   ] Finished updating board flags in 1.869 seconds
2014-03-18 15:14:30 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 15:14:51 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-03-18 15:15:11 [DEBUG   ] Finished updating ant stats in 1.211 seconds
2014-03-18 15:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:15:19 [DEBUG   ] Finished updating board flags in 1.825 seconds
2014-03-18 15:15:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 15:15:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 15:16:11 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 15:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:16:19 [DEBUG   ] Finished updating board flags in 1.780 seconds
2014-03-18 15:16:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 15:16:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 15:17:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 15:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:17:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:17:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:17:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:17:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:17:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:17:19 [DEBUG   ] Finished updating board flags in 1.607 seconds
2014-03-18 15:17:31 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2014-03-18 15:17:43 [DEBUG   ] Got command RPT from MCS: ref #402538
2014-03-18 15:17:43 [DEBUG   ] summary = ERROR
2014-03-18 15:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402538  13 56734 55063429 A  ERRORERROR'
2014-03-18 15:17:43 [DEBUG   ] Got command RPT from MCS: ref #402539
2014-03-18 15:17:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 15:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402539  77 56734 55063430 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 15:17:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 15:18:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 15:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:18:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:18:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:18:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:18:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:18:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:18:19 [DEBUG   ] Finished updating board flags in 1.592 seconds
2014-03-18 15:18:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 15:18:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 15:19:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 15:19:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:19:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:19:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:19:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:19:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:19:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:19:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:19:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:19:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:19:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:19:19 [DEBUG   ] Finished updating board flags in 1.449 seconds
2014-03-18 15:19:31 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-18 15:19:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 15:20:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 15:20:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:20:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:20:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:20:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:20:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:20:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:20:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:20:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:20:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:20:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:20:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 15:20:19 [DEBUG   ] Finished updating board flags in 1.451 seconds
2014-03-18 15:20:31 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2014-03-18 15:20:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 15:21:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 15:21:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:21:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:21:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:21:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:21:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:21:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:21:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:21:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:21:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:21:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:21:19 [DEBUG   ] Finished updating board flags in 1.447 seconds
2014-03-18 15:21:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 15:21:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 15:22:11 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-18 15:22:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:22:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:22:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:22:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:22:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:22:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:22:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:22:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:22:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:22:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:22:19 [DEBUG   ] Finished updating board flags in 1.461 seconds
2014-03-18 15:22:31 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-03-18 15:22:43 [DEBUG   ] Got command RPT from MCS: ref #402555
2014-03-18 15:22:43 [DEBUG   ] summary = ERROR
2014-03-18 15:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402555  13 56734 55363438 A  ERRORERROR'
2014-03-18 15:22:43 [DEBUG   ] Got command RPT from MCS: ref #402556
2014-03-18 15:22:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 15:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402556  77 56734 55363438 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 15:22:52 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-18 15:23:12 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-18 15:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:23:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:23:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:23:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:23:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:23:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:23:19 [DEBUG   ] Finished updating board flags in 1.463 seconds
2014-03-18 15:23:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 15:23:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 15:24:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 15:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:24:20 [DEBUG   ] Finished updating board flags in 2.254 seconds
2014-03-18 15:24:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 15:24:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 15:25:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 15:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:25:20 [DEBUG   ] Finished updating board flags in 2.093 seconds
2014-03-18 15:25:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 15:25:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 15:26:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 15:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:26:20 [DEBUG   ] Finished updating board flags in 2.033 seconds
2014-03-18 15:26:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 15:26:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 15:27:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 15:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:27:20 [DEBUG   ] Finished updating board flags in 1.974 seconds
2014-03-18 15:27:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 15:27:43 [DEBUG   ] Got command RPT from MCS: ref #402572
2014-03-18 15:27:43 [DEBUG   ] summary = ERROR
2014-03-18 15:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402572  13 56734 55663433 A  ERRORERROR'
2014-03-18 15:27:43 [DEBUG   ] Got command RPT from MCS: ref #402573
2014-03-18 15:27:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 15:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402573  77 56734 55663434 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 15:27:52 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 15:28:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 15:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:28:20 [DEBUG   ] Finished updating board flags in 1.812 seconds
2014-03-18 15:28:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 15:28:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 15:29:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 15:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:29:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:29:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:29:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:29:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:29:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:29:20 [DEBUG   ] Finished updating board flags in 1.819 seconds
2014-03-18 15:29:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 15:29:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 15:30:12 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 15:30:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:30:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:30:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:30:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:30:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:30:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:30:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:30:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:30:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:30:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:30:20 [DEBUG   ] Finished updating board flags in 1.781 seconds
2014-03-18 15:30:32 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-18 15:30:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 15:31:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 15:31:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:31:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:31:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:31:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:31:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:31:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:31:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:31:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:31:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:31:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:31:20 [DEBUG   ] Finished updating board flags in 1.605 seconds
2014-03-18 15:31:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 15:31:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 15:32:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 15:32:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:32:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:32:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:32:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:32:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:32:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:32:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:32:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:32:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:32:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:32:20 [DEBUG   ] Finished updating board flags in 1.611 seconds
2014-03-18 15:32:32 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 15:32:43 [DEBUG   ] Got command RPT from MCS: ref #402589
2014-03-18 15:32:43 [DEBUG   ] summary = ERROR
2014-03-18 15:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402589  13 56734 55963429 A  ERRORERROR'
2014-03-18 15:32:43 [DEBUG   ] Got command RPT from MCS: ref #402590
2014-03-18 15:32:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 15:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402590  77 56734 55963430 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 15:32:53 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-03-18 15:33:13 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-18 15:33:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:33:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:33:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:33:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:33:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:33:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 15:33:20 [DEBUG   ] Finished updating board flags in 1.585 seconds
2014-03-18 15:33:33 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-18 15:33:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 15:34:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 15:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:34:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-18 15:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:34:20 [DEBUG   ] Finished updating board flags in 1.413 seconds
2014-03-18 15:34:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 15:34:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 15:35:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 15:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:35:20 [DEBUG   ] Finished updating board flags in 1.554 seconds
2014-03-18 15:35:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 15:35:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 15:36:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 15:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:36:20 [DEBUG   ] Finished updating board flags in 1.554 seconds
2014-03-18 15:36:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 15:36:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 15:37:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 15:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:37:21 [DEBUG   ] Finished updating board flags in 2.234 seconds
2014-03-18 15:37:33 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 15:37:43 [DEBUG   ] Got command RPT from MCS: ref #402606
2014-03-18 15:37:43 [DEBUG   ] summary = ERROR
2014-03-18 15:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402606  13 56734 56263433 A  ERRORERROR'
2014-03-18 15:37:43 [DEBUG   ] Got command RPT from MCS: ref #402607
2014-03-18 15:37:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 15:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402607  77 56734 56263434 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 15:37:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 15:38:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 15:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:38:21 [DEBUG   ] Finished updating board flags in 2.050 seconds
2014-03-18 15:38:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 15:38:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 15:39:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 15:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:39:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:39:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:39:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:39:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:39:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:39:21 [DEBUG   ] Finished updating board flags in 2.017 seconds
2014-03-18 15:39:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 15:39:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 15:40:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 15:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 15:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 15:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 15:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 15:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 15:40:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 15:40:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 15:40:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 15:40:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 15:40:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 15:40:21 [DEBUG   ] Finished updating board flags in 1.991 seconds
2014-03-18 15:40:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 15:40:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 15:41:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2014-03-18 15:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2014-03-18 15:41:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 15:41:21 [DEBUG   ] Finished updating board flags in 1.828 seconds
2014-03-18 15:41:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 15:41:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-18 15:42:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-18 15:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-18 15:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-18 15:42:21 [DEBUG   ] Finished updating board flags in 1.781 seconds
2014-03-18 15:42:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 15:42:43 [DEBUG   ] Got command RPT from MCS: ref #402623
2014-03-18 15:42:43 [DEBUG   ] summary = ERROR
2014-03-18 15:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402623  13 56734 56563437 A  ERRORERROR'
2014-03-18 15:42:43 [DEBUG   ] Got command RPT from MCS: ref #402624
2014-03-18 15:42:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 15:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402624  77 56734 56563438 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 15:42:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 15:43:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-18 15:43:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 15:43:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 15:43:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 15:43:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 15:43:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 15:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 15:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 15:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 15:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 15:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 15:43:21 [DEBUG   ] Finished updating board flags in 1.696 seconds
2014-03-18 15:43:33 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 15:43:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 15:44:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 15:44:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 15:44:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 15:44:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 15:44:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 15:44:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 15:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 15:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 15:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 15:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 15:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 15:44:21 [DEBUG   ] Finished updating board flags in 1.501 seconds
2014-03-18 15:44:34 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-18 15:44:54 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-18 15:45:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 15:45:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 15:45:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 15:45:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 15:45:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 15:45:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 15:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 15:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 15:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 15:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 15:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 15:45:21 [DEBUG   ] Finished updating board flags in 1.456 seconds
2014-03-18 15:45:34 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-03-18 15:45:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 15:46:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 15:46:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 15:46:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 15:46:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 15:46:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 15:46:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 15:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 15:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 15:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 15:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 15:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 15:46:21 [DEBUG   ] Finished updating board flags in 1.458 seconds
2014-03-18 15:46:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 15:46:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 15:47:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 15:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 15:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 15:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 15:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 15:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 15:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 15:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 15:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 15:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 15:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 15:47:21 [DEBUG   ] Finished updating board flags in 1.498 seconds
2014-03-18 15:47:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 15:47:43 [DEBUG   ] Got command RPT from MCS: ref #402640
2014-03-18 15:47:43 [DEBUG   ] summary = ERROR
2014-03-18 15:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402640  13 56734 56863441 A  ERRORERROR'
2014-03-18 15:47:43 [DEBUG   ] Got command RPT from MCS: ref #402641
2014-03-18 15:47:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 15:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402641  77 56734 56863442 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 15:47:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 15:48:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 15:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 15:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 15:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 15:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 15:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 15:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 15:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 15:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 15:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 15:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 15:48:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 15:48:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 15:48:22 [DEBUG   ] Finished updating board flags in 2.301 seconds
2014-03-18 15:48:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 15:48:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 15:49:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 15:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 15:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 15:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 15:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 15:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 15:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 15:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 15:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 15:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 15:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 15:49:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 15:49:22 [DEBUG   ] Finished updating board flags in 2.094 seconds
2014-03-18 15:49:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 15:49:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 15:50:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 15:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 15:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 15:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 15:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 15:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 15:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 15:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 15:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 15:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 15:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 15:50:22 [DEBUG   ] Finished updating board flags in 2.074 seconds
2014-03-18 15:50:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 15:50:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 15:51:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 15:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 15:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 15:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 15:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 15:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 15:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 15:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 15:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 15:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 15:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 15:51:22 [DEBUG   ] Finished updating board flags in 2.021 seconds
2014-03-18 15:51:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 15:51:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 15:52:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 15:52:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 15:52:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 15:52:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 15:52:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 15:52:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 15:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 15:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 15:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 15:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 15:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 15:52:22 [DEBUG   ] Finished updating board flags in 1.915 seconds
2014-03-18 15:52:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 15:52:43 [DEBUG   ] Got command RPT from MCS: ref #402657
2014-03-18 15:52:43 [DEBUG   ] summary = ERROR
2014-03-18 15:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402657  13 56734 57163433 A  ERRORERROR'
2014-03-18 15:52:43 [DEBUG   ] Got command RPT from MCS: ref #402658
2014-03-18 15:52:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 15:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402658  77 56734 57163434 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 15:52:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 15:53:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 15:53:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 15:53:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 15:53:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 15:53:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 15:53:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 15:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 15:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 15:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 15:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 15:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 15:53:22 [DEBUG   ] Finished updating board flags in 1.843 seconds
2014-03-18 15:53:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 15:53:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 15:54:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 15:54:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 15:54:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 15:54:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 15:54:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 15:54:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 15:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 15:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 15:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 15:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 15:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 15:54:22 [DEBUG   ] Finished updating board flags in 1.760 seconds
2014-03-18 15:54:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 15:54:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 15:55:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 15:55:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 15:55:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 15:55:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 15:55:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 15:55:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 15:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 15:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 15:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 15:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 15:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 15:55:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 15:55:22 [DEBUG   ] Finished updating board flags in 1.631 seconds
2014-03-18 15:55:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 15:55:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 15:56:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 15:56:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 15:56:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 15:56:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 15:56:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 15:56:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 15:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 15:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 15:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 15:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 15:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 15:56:22 [DEBUG   ] Finished updating board flags in 1.662 seconds
2014-03-18 15:56:34 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 15:56:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 15:57:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 15:57:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 15:57:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 15:57:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 15:57:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 15:57:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 15:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 15:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 15:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 15:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 15:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 15:57:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 15:57:22 [DEBUG   ] Finished updating board flags in 1.513 seconds
2014-03-18 15:57:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 15:57:43 [DEBUG   ] Got command RPT from MCS: ref #402674
2014-03-18 15:57:43 [DEBUG   ] summary = ERROR
2014-03-18 15:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402674  13 56734 57463433 A  ERRORERROR'
2014-03-18 15:57:43 [DEBUG   ] Got command RPT from MCS: ref #402675
2014-03-18 15:57:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 15:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402675  77 56734 57463434 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 15:57:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 15:58:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 15:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 15:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 15:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 15:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 15:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 15:58:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 15:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 15:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 15:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 15:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 15:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 15:58:22 [DEBUG   ] Finished updating board flags in 1.403 seconds
2014-03-18 15:58:34 [DEBUG   ] Finished updating ant stats in 0.792 seconds
2014-03-18 15:58:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 15:59:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 15:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 15:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 15:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 15:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 15:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 15:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 15:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 15:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 15:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 15:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 15:59:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 15:59:22 [DEBUG   ] Finished updating board flags in 1.415 seconds
2014-03-18 15:59:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 15:59:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 16:00:14 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-18 16:00:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:00:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:00:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:00:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:00:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:00:22 [DEBUG   ] Finished updating board flags in 1.424 seconds
2014-03-18 16:00:35 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-18 16:00:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 16:01:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 16:01:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:01:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:01:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:01:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:01:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:01:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 16:01:22 [DEBUG   ] Finished updating board flags in 1.416 seconds
2014-03-18 16:01:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 16:01:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 16:02:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 16:02:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:02:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:02:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:02:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:02:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:02:22 [DEBUG   ] Finished updating board flags in 1.500 seconds
2014-03-18 16:02:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 16:02:43 [DEBUG   ] Got command RPT from MCS: ref #402691
2014-03-18 16:02:43 [DEBUG   ] summary = ERROR
2014-03-18 16:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402691  13 56734 57763445 A  ERRORERROR'
2014-03-18 16:02:43 [DEBUG   ] Got command RPT from MCS: ref #402692
2014-03-18 16:02:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 16:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402692  77 56734 57763446 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 16:02:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 16:03:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 16:03:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:03:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:03:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:03:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:03:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:03:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:03:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:03:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:03:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:03:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:03:22 [DEBUG   ] Finished updating board flags in 1.507 seconds
2014-03-18 16:03:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 16:03:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 16:04:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 16:04:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:04:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:04:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:04:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:04:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:04:23 [DEBUG   ] Finished updating board flags in 2.186 seconds
2014-03-18 16:04:35 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 16:04:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 16:05:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 16:05:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:05:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:05:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:05:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:05:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:05:23 [DEBUG   ] Finished updating board flags in 2.011 seconds
2014-03-18 16:05:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 16:05:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 16:06:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 16:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:06:23 [DEBUG   ] Finished updating board flags in 1.953 seconds
2014-03-18 16:06:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 16:06:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 16:07:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 16:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:07:23 [DEBUG   ] Finished updating board flags in 1.884 seconds
2014-03-18 16:07:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 16:07:43 [DEBUG   ] Got command RPT from MCS: ref #402708
2014-03-18 16:07:43 [DEBUG   ] summary = ERROR
2014-03-18 16:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402708  13 56734 58063441 A  ERRORERROR'
2014-03-18 16:07:43 [DEBUG   ] Got command RPT from MCS: ref #402709
2014-03-18 16:07:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 16:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402709  77 56734 58063442 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 16:07:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 16:08:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 16:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:08:23 [DEBUG   ] Finished updating board flags in 1.711 seconds
2014-03-18 16:08:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 16:08:55 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2014-03-18 16:09:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 16:09:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:09:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:09:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:09:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:09:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:09:23 [DEBUG   ] Finished updating board flags in 1.615 seconds
2014-03-18 16:09:36 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-03-18 16:09:56 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-18 16:10:16 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2014-03-18 16:10:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:10:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:10:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:10:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:10:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:10:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 16:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:10:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2014-03-18 16:10:23 [DEBUG   ] Finished updating board flags in 1.707 seconds
2014-03-18 16:10:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 16:10:56 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 16:11:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 16:11:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:11:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:11:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:11:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:11:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:11:23 [DEBUG   ] Finished updating board flags in 1.488 seconds
2014-03-18 16:11:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 16:11:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 16:12:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 16:12:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:12:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:12:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:12:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:12:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:12:23 [DEBUG   ] Finished updating board flags in 1.418 seconds
2014-03-18 16:12:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 16:12:43 [DEBUG   ] Got command RPT from MCS: ref #402725
2014-03-18 16:12:43 [DEBUG   ] summary = ERROR
2014-03-18 16:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402725  13 56734 58363445 A  ERRORERROR'
2014-03-18 16:12:43 [DEBUG   ] Got command RPT from MCS: ref #402726
2014-03-18 16:12:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 16:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402726  77 56734 58363446 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 16:12:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 16:13:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 16:13:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:13:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:13:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:13:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:13:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:13:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:13:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:13:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:13:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:13:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:13:23 [DEBUG   ] Finished updating board flags in 1.385 seconds
2014-03-18 16:13:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 16:13:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 16:14:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 16:14:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:14:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:14:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:14:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:14:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:14:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:14:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:14:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:14:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:14:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:14:23 [DEBUG   ] Finished updating board flags in 1.512 seconds
2014-03-18 16:14:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 16:14:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 16:15:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 16:15:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:15:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:15:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:15:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:15:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:15:24 [DEBUG   ] Finished updating board flags in 2.146 seconds
2014-03-18 16:15:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 16:15:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 16:16:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 16:16:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:16:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:16:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:16:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:16:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:16:24 [DEBUG   ] Finished updating board flags in 2.068 seconds
2014-03-18 16:16:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 16:16:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 16:17:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 16:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:17:24 [DEBUG   ] Finished updating board flags in 2.016 seconds
2014-03-18 16:17:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 16:17:43 [DEBUG   ] Got command RPT from MCS: ref #402742
2014-03-18 16:17:43 [DEBUG   ] summary = ERROR
2014-03-18 16:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402742  13 56734 58663445 A  ERRORERROR'
2014-03-18 16:17:43 [DEBUG   ] Got command RPT from MCS: ref #402743
2014-03-18 16:17:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 16:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402743  77 56734 58663446 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 16:17:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 16:18:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 16:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:18:24 [DEBUG   ] Finished updating board flags in 1.871 seconds
2014-03-18 16:18:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 16:18:56 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-18 16:19:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 16:19:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:19:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:19:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:19:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:19:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:19:24 [DEBUG   ] Finished updating board flags in 1.816 seconds
2014-03-18 16:19:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:19:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 16:20:16 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 16:20:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:20:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:20:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:20:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:20:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:20:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 16:20:24 [DEBUG   ] Finished updating board flags in 1.787 seconds
2014-03-18 16:20:37 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-18 16:20:57 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 16:21:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 16:21:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:21:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:21:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:21:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:21:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:21:24 [DEBUG   ] Finished updating board flags in 1.616 seconds
2014-03-18 16:21:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 16:21:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 16:22:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 16:22:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:22:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:22:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:22:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:22:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:22:24 [DEBUG   ] Finished updating board flags in 1.593 seconds
2014-03-18 16:22:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 16:22:43 [DEBUG   ] Got command RPT from MCS: ref #402759
2014-03-18 16:22:43 [DEBUG   ] summary = ERROR
2014-03-18 16:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402759  13 56734 58963441 A  ERRORERROR'
2014-03-18 16:22:43 [DEBUG   ] Got command RPT from MCS: ref #402760
2014-03-18 16:22:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 16:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402760  77 56734 58963442 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 16:22:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 16:23:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 16:23:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:23:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:23:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:23:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:23:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:23:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 16:23:24 [DEBUG   ] Finished updating board flags in 1.414 seconds
2014-03-18 16:23:37 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2014-03-18 16:23:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 16:24:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 16:24:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:24:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:24:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:24:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:24:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:24:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 16:24:24 [DEBUG   ] Finished updating board flags in 1.386 seconds
2014-03-18 16:24:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 16:24:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 16:25:17 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 16:25:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:25:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:25:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:25:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:25:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:25:24 [DEBUG   ] Finished updating board flags in 1.364 seconds
2014-03-18 16:25:37 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-03-18 16:25:58 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-03-18 16:26:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 16:26:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:26:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:26:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:26:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:26:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:26:25 [DEBUG   ] Finished updating board flags in 2.058 seconds
2014-03-18 16:26:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 16:26:57 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-03-18 16:27:18 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-18 16:27:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:27:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:27:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:27:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:27:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:27:25 [DEBUG   ] Finished updating board flags in 1.990 seconds
2014-03-18 16:27:38 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-18 16:27:43 [DEBUG   ] Got command RPT from MCS: ref #402776
2014-03-18 16:27:43 [DEBUG   ] summary = ERROR
2014-03-18 16:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402776  13 56734 59263445 A  ERRORERROR'
2014-03-18 16:27:43 [DEBUG   ] Got command RPT from MCS: ref #402777
2014-03-18 16:27:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 16:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402777  77 56734 59263446 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 16:27:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 16:28:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 16:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:28:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 16:28:25 [DEBUG   ] Finished updating board flags in 1.817 seconds
2014-03-18 16:28:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 16:28:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 16:29:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 16:29:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:29:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:29:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:29:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:29:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:29:25 [DEBUG   ] Finished updating board flags in 1.891 seconds
2014-03-18 16:29:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 16:29:58 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2014-03-18 16:30:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 16:30:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:30:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:30:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:30:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:30:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:30:25 [DEBUG   ] Finished updating board flags in 1.757 seconds
2014-03-18 16:30:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 16:30:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 16:31:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 16:31:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:31:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:31:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:31:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:31:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:31:25 [DEBUG   ] Finished updating board flags in 1.550 seconds
2014-03-18 16:31:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 16:31:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 16:32:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 16:32:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:32:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:32:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:32:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:32:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:32:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 16:32:25 [DEBUG   ] Finished updating board flags in 1.400 seconds
2014-03-18 16:32:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 16:32:43 [DEBUG   ] Got command RPT from MCS: ref #402793
2014-03-18 16:32:43 [DEBUG   ] summary = ERROR
2014-03-18 16:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402793  13 56734 59563441 A  ERRORERROR'
2014-03-18 16:32:43 [DEBUG   ] Got command RPT from MCS: ref #402794
2014-03-18 16:32:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 16:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402794  77 56734 59563442 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 16:32:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:33:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:33:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:33:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:33:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:33:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:33:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:33:25 [DEBUG   ] Finished updating board flags in 1.357 seconds
2014-03-18 16:33:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:33:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 16:34:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 16:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 16:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 16:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 16:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 16:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 16:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 16:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 16:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 16:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 16:34:26 [DEBUG   ] Finished updating board flags in 2.050 seconds
2014-03-18 16:34:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 16:34:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 16:35:18 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999235
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-03-18 16:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-03-18 16:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-03-18 16:35:26 [DEBUG   ] Finished updating board flags in 2.006 seconds
2014-03-18 16:35:39 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-03-18 16:35:59 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-18 16:36:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-18 16:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-18 16:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-18 16:36:26 [DEBUG   ] Finished updating board flags in 2.010 seconds
2014-03-18 16:36:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 16:36:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 16:37:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 16:37:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-18 16:37:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 16:37:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 16:37:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 16:37:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 16:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 16:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 16:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 16:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 16:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 16:37:26 [DEBUG   ] Finished updating board flags in 1.983 seconds
2014-03-18 16:37:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 16:37:43 [DEBUG   ] Got command RPT from MCS: ref #402810
2014-03-18 16:37:43 [DEBUG   ] summary = ERROR
2014-03-18 16:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402810  13 56734 59863453 A  ERRORERROR'
2014-03-18 16:37:43 [DEBUG   ] Got command RPT from MCS: ref #402811
2014-03-18 16:37:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 16:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402811  77 56734 59863454 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 16:37:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 16:38:19 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 16:38:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-18 16:38:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 16:38:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 16:38:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 16:38:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 16:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 16:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 16:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 16:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 16:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 16:38:26 [DEBUG   ] Finished updating board flags in 1.805 seconds
2014-03-18 16:38:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 16:38:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 16:39:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 16:39:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-18 16:39:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 16:39:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 16:39:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 16:39:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 16:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 16:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 16:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 16:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 16:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 16:39:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 16:39:26 [DEBUG   ] Finished updating board flags in 1.821 seconds
2014-03-18 16:39:39 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2014-03-18 16:39:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 16:40:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 16:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-18 16:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 16:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 16:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 16:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 16:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 16:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 16:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 16:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 16:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 16:40:26 [DEBUG   ] Finished updating board flags in 1.776 seconds
2014-03-18 16:40:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 16:40:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 16:41:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 16:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-18 16:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 16:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 16:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 16:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 16:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 16:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 16:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 16:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 16:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 16:41:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2014-03-18 16:41:26 [DEBUG   ] Finished updating board flags in 1.696 seconds
2014-03-18 16:41:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 16:41:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 16:42:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 16:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-18 16:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 16:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 16:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 16:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 16:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 16:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 16:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 16:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 16:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 16:42:26 [DEBUG   ] Finished updating board flags in 1.493 seconds
2014-03-18 16:42:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 16:42:43 [DEBUG   ] Got command RPT from MCS: ref #402827
2014-03-18 16:42:43 [DEBUG   ] summary = ERROR
2014-03-18 16:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402827  13 56734 60163453 A  ERRORERROR'
2014-03-18 16:42:43 [DEBUG   ] Got command RPT from MCS: ref #402828
2014-03-18 16:42:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 16:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402828  77 56734 60163454 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 16:42:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 16:43:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 16:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-18 16:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 16:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 16:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 16:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 16:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 16:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 16:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 16:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 16:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 16:43:26 [DEBUG   ] Finished updating board flags in 1.410 seconds
2014-03-18 16:43:40 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-18 16:44:00 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 16:44:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 16:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-18 16:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 16:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 16:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 16:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 16:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 16:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 16:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 16:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 16:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 16:44:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 16:44:26 [DEBUG   ] Finished updating board flags in 1.393 seconds
2014-03-18 16:44:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 16:45:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 16:45:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 16:45:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-18 16:45:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 16:45:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 16:45:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 16:45:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 16:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 16:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 16:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 16:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 16:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 16:45:27 [DEBUG   ] Finished updating board flags in 1.600 seconds
2014-03-18 16:45:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 16:46:00 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-18 16:46:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 16:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-18 16:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 16:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 16:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 16:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 16:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 16:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 16:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 16:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 16:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 16:46:26 [DEBUG   ] Finished updating board flags in 1.319 seconds
2014-03-18 16:46:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 16:47:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 16:47:00 [DEBUG   ] Got command INI from MCS: ref #402844
2014-03-18 16:47:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2014-03-18 16:47:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   402844   8 56734 60420866 ABOOTING'
2014-03-18 16:47:24 [INFO    ] -------------------
2014-03-18 16:47:24 [INFO    ]  LWA board status
2014-03-18 16:47:24 [INFO    ] -------------------
2014-03-18 16:47:24 [INFO    ] DP 1: 2 lwa27
2014-03-18 16:47:24 [INFO    ] DP 1: 3 lwa24
2014-03-18 16:47:24 [INFO    ] DP 1: 4 lwa23
2014-03-18 16:47:24 [INFO    ] DP 1: 5 lwa18
2014-03-18 16:47:24 [INFO    ] DP 1: 6 lwa10
2014-03-18 16:47:24 [INFO    ] DP 1: 7 lwa32
2014-03-18 16:47:24 [INFO    ] DP 1: 8 lwa11
2014-03-18 16:47:24 [INFO    ] DP 1: 9 lwa30
2014-03-18 16:47:24 [INFO    ] DP 1: 10 lwa12
2014-03-18 16:47:24 [INFO    ] DP 1: 11 lwa8
2014-03-18 16:47:24 [INFO    ] DP 1: 12 lwa13
2014-03-18 16:47:24 [INFO    ] DP 1: 13 lwa26
2014-03-18 16:47:24 [INFO    ] DP 1: 14 lwa14
2014-03-18 16:47:24 [INFO    ] DP 1: 16 lwa22
2014-03-18 16:47:24 [INFO    ] DP 1: 17 lwa20
2014-03-18 16:47:24 [INFO    ] DP 1: 18 lwa1
2014-03-18 16:47:24 [INFO    ] DP 1: 19 lwa5
2014-03-18 16:47:24 [INFO    ] DP 1: 20 lwa25
2014-03-18 16:47:24 [INFO    ] DP 1: 21 lwa35
2014-03-18 16:47:24 [INFO    ] DP 1: 22 lwa19
2014-03-18 16:47:24 [INFO    ] DP 1: 23 lwa21
2014-03-18 16:47:24 [INFO    ] DP 1: 24 lwa6
2014-03-18 16:47:24 [INFO    ] DP 1: 25 lwa7
2014-03-18 16:47:24 [INFO    ] DP 1: 26 lwa33
2014-03-18 16:47:24 [INFO    ] DP 1: 27 lwa15
2014-03-18 16:47:24 [INFO    ] DP 1: 28 lwa28
2014-03-18 16:47:24 [INFO    ] DP 2: 1 lwa16
2014-03-18 16:47:24 [INFO    ] DP 2: 15 lwa34
2014-03-18 16:47:24 [INFO    ] Total of 28 boards
2014-03-18 16:47:24 [INFO    ] Total of 260 stands
2014-03-18 16:47:24 [INFO    ] -------------------
2014-03-18 16:47:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3125
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3126
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3127
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3128
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3129
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3130
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3131
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3132
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3133
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3134
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3135
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3136
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3137
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3138
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3139
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3140
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3141
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3142
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3143
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3144
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3145
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3146
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3147
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3148
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3149
2014-03-18 16:47:31 [DEBUG   ] 2014-03-18 16:47:31 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3150
2014-03-18 16:47:43 [DEBUG   ] Got command RPT from MCS: ref #402845
2014-03-18 16:47:43 [DEBUG   ] summary = BOOTING
2014-03-18 16:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402845  15 56734 60463450 ABOOTINGBOOTING'
2014-03-18 16:47:43 [DEBUG   ] Got command RPT from MCS: ref #402846
2014-03-18 16:47:43 [DEBUG   ] info = Running INI sequence
2014-03-18 16:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402846  28 56734 60463450 ABOOTINGRunning INI sequence'
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3125 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3126 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3127 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3128 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3129 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3130 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3131 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3132 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3133 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3134 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3135 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3136 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3137 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3138 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3139 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3140 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3141 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3142 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3143 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3144 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3145 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3146 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3147 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3148 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3149 exited with status 0
2014-03-18 16:47:43 [DEBUG   ] 2014-03-18 16:47:43 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3150 exited with status 0
2014-03-18 16:47:43 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2014-03-18 16:47:43 [DEBUG   ] spawn_process: at 2014-03-18 16:47:43 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:43 [DEBUG   ] spawn_process: at 2014-03-18 16:47:43 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:43 [DEBUG   ] spawn_process: at 2014-03-18 16:47:43 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:43 [DEBUG   ] spawn_process: at 2014-03-18 16:47:43 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:43 [DEBUG   ] spawn_process: at 2014-03-18 16:47:43 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:43 [DEBUG   ] spawn_process: at 2014-03-18 16:47:43 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:43 [DEBUG   ] spawn_process: at 2014-03-18 16:47:43 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:43 [DEBUG   ] spawn_process: at 2014-03-18 16:47:43 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:44 [DEBUG   ] spawn_process: at 2014-03-18 16:47:44 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:44 [DEBUG   ] spawn_process: at 2014-03-18 16:47:44 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:44 [DEBUG   ] spawn_process: at 2014-03-18 16:47:44 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:44 [DEBUG   ] spawn_process: at 2014-03-18 16:47:44 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:44 [DEBUG   ] spawn_process: at 2014-03-18 16:47:44 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:44 [DEBUG   ] spawn_process: at 2014-03-18 16:47:44 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:44 [DEBUG   ] spawn_process: at 2014-03-18 16:47:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:44 [DEBUG   ] spawn_process: at 2014-03-18 16:47:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:44 [DEBUG   ] spawn_process: at 2014-03-18 16:47:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:44 [DEBUG   ] spawn_process: at 2014-03-18 16:47:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:44 [DEBUG   ] spawn_process: at 2014-03-18 16:47:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:44 [DEBUG   ] spawn_process: at 2014-03-18 16:47:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:44 [DEBUG   ] spawn_process: at 2014-03-18 16:47:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:44 [DEBUG   ] spawn_process: at 2014-03-18 16:47:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:44 [DEBUG   ] spawn_process: at 2014-03-18 16:47:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:44 [DEBUG   ] spawn_process: at 2014-03-18 16:47:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:44 [DEBUG   ] spawn_process: at 2014-03-18 16:47:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:44 [DEBUG   ] spawn_process: at 2014-03-18 16:47:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2014-03-18 16:47:44 [DEBUG   ] 2014-03-18 16:47:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 3177
2014-03-18 16:47:44 [DEBUG   ] 2014-03-18 16:47:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 3178
2014-03-18 16:47:49 [DEBUG   ] 2014-03-18 16:47:49 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 3177 exited with status 0
2014-03-18 16:47:49 [DEBUG   ] 2014-03-18 16:47:49 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 3178 exited with status 0
2014-03-18 16:47:49 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2014-03-18 16:47:49 [DEBUG   ] spawn_process: at 2014-03-18 16:47:49 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2014-03-18 16:47:49 [DEBUG   ] spawn_process: at 2014-03-18 16:47:49 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2014-03-18 16:47:49 [INFO    ] Setting Beam 1 xbars
2014-03-18 16:47:49 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2014-03-18 16:47:49 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2014-03-18 16:47:49 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2014-03-18 16:47:49 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2014-03-18 16:47:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2014-03-18 16:47:50 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2014-03-18 16:47:50 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2014-03-18 16:47:50 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2014-03-18 16:47:50 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2014-03-18 16:47:50 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2014-03-18 16:47:50 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2014-03-18 16:47:50 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2014-03-18 16:47:50 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2014-03-18 16:47:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2014-03-18 16:47:51 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2014-03-18 16:47:51 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2014-03-18 16:47:51 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2014-03-18 16:47:51 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2014-03-18 16:47:51 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2014-03-18 16:47:51 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2014-03-18 16:47:51 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2014-03-18 16:47:51 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2014-03-18 16:47:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2014-03-18 16:47:52 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2014-03-18 16:47:52 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2014-03-18 16:47:52 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2014-03-18 16:47:52 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2014-03-18 16:47:52 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2014-03-18 16:47:52 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2014-03-18 16:47:52 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2014-03-18 16:47:52 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2014-03-18 16:47:52 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2014-03-18 16:47:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2014-03-18 16:47:53 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2014-03-18 16:47:53 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2014-03-18 16:47:53 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2014-03-18 16:47:53 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2014-03-18 16:47:53 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2014-03-18 16:47:53 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2014-03-18 16:47:53 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2014-03-18 16:47:53 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2014-03-18 16:47:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2014-03-18 16:47:54 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2014-03-18 16:47:54 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2014-03-18 16:47:54 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2014-03-18 16:47:54 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2014-03-18 16:47:54 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2014-03-18 16:47:54 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2014-03-18 16:47:54 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2014-03-18 16:47:54 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2014-03-18 16:47:55 [INFO    ] Setting Beam 2 xbars
2014-03-18 16:47:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2014-03-18 16:47:55 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2014-03-18 16:47:55 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2014-03-18 16:47:55 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2014-03-18 16:47:55 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2014-03-18 16:47:55 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2014-03-18 16:47:55 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2014-03-18 16:47:55 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2014-03-18 16:47:55 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2014-03-18 16:47:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2014-03-18 16:47:56 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2014-03-18 16:47:56 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2014-03-18 16:47:56 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2014-03-18 16:47:56 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2014-03-18 16:47:56 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2014-03-18 16:47:56 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2014-03-18 16:47:56 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2014-03-18 16:47:56 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2014-03-18 16:47:56 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2014-03-18 16:47:57 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2014-03-18 16:47:57 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2014-03-18 16:47:57 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2014-03-18 16:47:57 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2014-03-18 16:47:57 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2014-03-18 16:47:57 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2014-03-18 16:47:57 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2014-03-18 16:47:57 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2014-03-18 16:47:57 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2014-03-18 16:47:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2014-03-18 16:47:58 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2014-03-18 16:47:58 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2014-03-18 16:47:58 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2014-03-18 16:47:58 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2014-03-18 16:47:58 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2014-03-18 16:47:58 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2014-03-18 16:47:58 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2014-03-18 16:47:58 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2014-03-18 16:47:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2014-03-18 16:47:59 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2014-03-18 16:47:59 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2014-03-18 16:47:59 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2014-03-18 16:47:59 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2014-03-18 16:47:59 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2014-03-18 16:47:59 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2014-03-18 16:47:59 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2014-03-18 16:47:59 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2014-03-18 16:47:59 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2014-03-18 16:48:00 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2014-03-18 16:48:00 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2014-03-18 16:48:00 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2014-03-18 16:48:00 [INFO    ] Setting Beam 3 xbars
2014-03-18 16:48:00 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2014-03-18 16:48:00 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2014-03-18 16:48:00 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2014-03-18 16:48:00 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2014-03-18 16:48:00 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2014-03-18 16:48:00 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2014-03-18 16:48:01 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2014-03-18 16:48:01 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2014-03-18 16:48:01 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2014-03-18 16:48:01 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2014-03-18 16:48:01 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2014-03-18 16:48:01 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2014-03-18 16:48:01 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2014-03-18 16:48:01 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2014-03-18 16:48:01 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2014-03-18 16:48:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2014-03-18 16:48:02 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2014-03-18 16:48:02 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2014-03-18 16:48:02 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2014-03-18 16:48:02 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2014-03-18 16:48:02 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2014-03-18 16:48:02 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2014-03-18 16:48:02 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2014-03-18 16:48:02 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2014-03-18 16:48:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2014-03-18 16:48:03 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2014-03-18 16:48:03 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2014-03-18 16:48:03 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2014-03-18 16:48:03 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2014-03-18 16:48:03 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2014-03-18 16:48:03 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2014-03-18 16:48:03 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2014-03-18 16:48:03 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2014-03-18 16:48:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2014-03-18 16:48:04 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2014-03-18 16:48:04 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2014-03-18 16:48:04 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2014-03-18 16:48:04 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2014-03-18 16:48:04 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2014-03-18 16:48:04 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2014-03-18 16:48:04 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2014-03-18 16:48:04 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2014-03-18 16:48:04 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2014-03-18 16:48:05 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2014-03-18 16:48:05 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2014-03-18 16:48:05 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2014-03-18 16:48:05 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2014-03-18 16:48:05 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2014-03-18 16:48:05 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2014-03-18 16:48:05 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2014-03-18 16:48:05 [INFO    ] Setting Beam 4 xbars
2014-03-18 16:48:05 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2014-03-18 16:48:05 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2014-03-18 16:48:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2014-03-18 16:48:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2014-03-18 16:48:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2014-03-18 16:48:06 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2014-03-18 16:48:06 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2014-03-18 16:48:06 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2014-03-18 16:48:06 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2014-03-18 16:48:06 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2014-03-18 16:48:06 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2014-03-18 16:48:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2014-03-18 16:48:07 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2014-03-18 16:48:07 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2014-03-18 16:48:07 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2014-03-18 16:48:07 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2014-03-18 16:48:07 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2014-03-18 16:48:07 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2014-03-18 16:48:07 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2014-03-18 16:48:07 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2014-03-18 16:48:08 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2014-03-18 16:48:08 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2014-03-18 16:48:08 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2014-03-18 16:48:08 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2014-03-18 16:48:08 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2014-03-18 16:48:08 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2014-03-18 16:48:08 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2014-03-18 16:48:08 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2014-03-18 16:48:08 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2014-03-18 16:48:08 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2014-03-18 16:48:09 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2014-03-18 16:48:09 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2014-03-18 16:48:09 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2014-03-18 16:48:09 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2014-03-18 16:48:09 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2014-03-18 16:48:09 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2014-03-18 16:48:09 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2014-03-18 16:48:09 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2014-03-18 16:48:09 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2014-03-18 16:48:10 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2014-03-18 16:48:10 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2014-03-18 16:48:10 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2014-03-18 16:48:10 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2014-03-18 16:48:10 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2014-03-18 16:48:10 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2014-03-18 16:48:10 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2014-03-18 16:48:10 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2014-03-18 16:48:10 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2014-03-18 16:48:11 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2014-03-18 16:48:11 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2014-03-18 16:48:11 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2014-03-18 16:48:11 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2014-03-18 16:48:11 [INFO    ] All xbars set
2014-03-18 16:48:11 [INFO    ] Setting adder chain routing for all beams
2014-03-18 16:48:16 [INFO    ] Setting beam ids
2014-03-18 16:48:26 [INFO    ] Starting beam delay calibration
2014-03-18 16:48:38 [INFO    ] Beam 1 latency is 5740
2014-03-18 16:48:38 [INFO    ] Beam 2 latency is 5756
2014-03-18 16:48:38 [INFO    ] Beam 3 latency is 5752
2014-03-18 16:48:38 [INFO    ] Beam 4 latency is 5750
2014-03-18 16:48:38 [INFO    ] Stop calibration
2014-03-18 16:48:46 [INFO    ] Beam delay calibration successful
2014-03-18 16:48:46 [INFO    ] Calibration passed
2014-03-18 16:48:46 [DEBUG   ] spawn_process: at 2014-03-18 16:48:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2014-03-18 16:48:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2014-03-18 16:48:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2014-03-18 16:48:46 [DEBUG   ] spawn_process: at 2014-03-18 16:48:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2014-03-18 16:48:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2014-03-18 16:48:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2014-03-18 16:48:46 [DEBUG   ] spawn_process: at 2014-03-18 16:48:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2014-03-18 16:48:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2014-03-18 16:48:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2014-03-18 16:48:46 [DEBUG   ] spawn_process: at 2014-03-18 16:48:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2014-03-18 16:48:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2014-03-18 16:48:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2014-03-18 16:48:46 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2014-03-18 16:48:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 294 ms (1395161327.296 s) with PID 4762 and time 1395161328
2014-03-18 16:48:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2014-03-18 16:48:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 383 ms (1395161327.385 s) with PID 4765 and time 1395161328
2014-03-18 16:48:48 [DEBUG   ] Finished updating ant stats in 0.863 seconds
2014-03-18 16:48:48 [INFO    ] Started antennas statistics background thread
2014-03-18 16:48:48 [INFO    ] Started board flags background thread
2014-03-18 16:48:48 [INFO    ] Started BAM background thread
2014-03-18 16:48:48 [INFO    ] Finished the INI process (ref. #402844) in 107.640 s
2014-03-18 16:48:49 [DEBUG   ] Finished updating board flags in 1.050 seconds
2014-03-18 16:49:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 16:49:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 16:49:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 16:49:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 16:49:49 [DEBUG   ] Finished updating board flags in 0.997 seconds
2014-03-18 16:50:08 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-18 16:50:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:50:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:50:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 16:50:49 [DEBUG   ] Finished updating board flags in 1.270 seconds
2014-03-18 16:51:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:51:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:51:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:51:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 16:51:50 [DEBUG   ] Finished updating board flags in 1.803 seconds
2014-03-18 16:52:00 [DEBUG   ] Got command RPT from MCS: ref #402862
2014-03-18 16:52:00 [DEBUG   ] summary = NORMAL
2014-03-18 16:52:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402862  14 56734 60720865 A NORMALNORMAL'
2014-03-18 16:52:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:52:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:52:43 [DEBUG   ] Got command RPT from MCS: ref #402863
2014-03-18 16:52:43 [DEBUG   ] summary = NORMAL
2014-03-18 16:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402863  14 56734 60763457 A NORMALNORMAL'
2014-03-18 16:52:43 [DEBUG   ] Got command RPT from MCS: ref #402864
2014-03-18 16:52:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 16:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402864  48 56734 60763458 A NORMALSystem calibrated and operating normally'
2014-03-18 16:52:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:52:49 [DEBUG   ] Finished updating board flags in 1.208 seconds
2014-03-18 16:53:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:53:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:53:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 16:53:50 [DEBUG   ] Finished updating board flags in 1.752 seconds
2014-03-18 16:54:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:54:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:54:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:54:49 [DEBUG   ] Finished updating board flags in 1.023 seconds
2014-03-18 16:55:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:55:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:55:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 16:55:49 [DEBUG   ] Finished updating board flags in 1.040 seconds
2014-03-18 16:56:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:56:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 16:56:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:56:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 16:56:50 [DEBUG   ] Finished updating board flags in 1.608 seconds
2014-03-18 16:57:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:57:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:57:43 [DEBUG   ] Got command RPT from MCS: ref #402885
2014-03-18 16:57:43 [DEBUG   ] summary = NORMAL
2014-03-18 16:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402885  14 56734 61063453 A NORMALNORMAL'
2014-03-18 16:57:43 [DEBUG   ] Got command RPT from MCS: ref #402886
2014-03-18 16:57:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 16:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402886  48 56734 61063454 A NORMALSystem calibrated and operating normally'
2014-03-18 16:57:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 16:57:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-18 16:57:49 [DEBUG   ] Finished updating board flags in 0.959 seconds
2014-03-18 16:58:08 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 16:58:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 16:58:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 16:58:50 [DEBUG   ] Finished updating board flags in 1.371 seconds
2014-03-18 16:59:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 16:59:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 16:59:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 16:59:50 [DEBUG   ] Finished updating board flags in 1.215 seconds
2014-03-18 17:00:08 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 17:00:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 17:00:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 17:00:50 [DEBUG   ] Finished updating board flags in 1.181 seconds
2014-03-18 17:01:08 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-03-18 17:01:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 17:01:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 17:01:50 [DEBUG   ] Finished updating board flags in 1.012 seconds
2014-03-18 17:02:09 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 17:02:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 17:02:43 [DEBUG   ] Got command RPT from MCS: ref #402902
2014-03-18 17:02:43 [DEBUG   ] summary = NORMAL
2014-03-18 17:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402902  14 56734 61363461 A NORMALNORMAL'
2014-03-18 17:02:43 [DEBUG   ] Got command RPT from MCS: ref #402903
2014-03-18 17:02:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 17:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402903  48 56734 61363462 A NORMALSystem calibrated and operating normally'
2014-03-18 17:02:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:02:50 [DEBUG   ] Finished updating board flags in 0.992 seconds
2014-03-18 17:03:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:03:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:03:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 17:03:51 [DEBUG   ] Finished updating board flags in 1.811 seconds
2014-03-18 17:04:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:04:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:04:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:04:51 [DEBUG   ] Finished updating board flags in 1.896 seconds
2014-03-18 17:05:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 17:05:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:05:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:05:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:05:50 [DEBUG   ] Finished updating board flags in 1.140 seconds
2014-03-18 17:06:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 17:06:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:06:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:06:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 17:06:50 [DEBUG   ] Finished updating board flags in 1.034 seconds
2014-03-18 17:07:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:07:27 [DEBUG   ] Got command DRX from MCS: ref #402925
2014-03-18 17:07:27 [INFO    ] sending drx command to lwa16
2014-03-18 17:07:27 [DEBUG   ] run_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 58000000.0 7 13 99']
2014-03-18 17:07:27 [DEBUG   ] drx = exited with status True, code 0x00
2014-03-18 17:07:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   402925   8 56734 61647014 A NORMAL'
2014-03-18 17:07:27 [DEBUG   ] Got command DRX from MCS: ref #402926
2014-03-18 17:07:27 [INFO    ] sending drx command to lwa16
2014-03-18 17:07:27 [DEBUG   ] run_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 58000000.0 7 13 99']
2014-03-18 17:07:27 [DEBUG   ] drx = exited with status True, code 0x00
2014-03-18 17:07:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   402926   8 56734 61647018 A NORMAL'
2014-03-18 17:07:27 [DEBUG   ] Got command DRX from MCS: ref #402923
2014-03-18 17:07:27 [INFO    ] sending drx command to lwa34
2014-03-18 17:07:27 [DEBUG   ] run_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa34', '/lwa/software/drx 5 1 58000000.0 7 13 99']
2014-03-18 17:07:27 [DEBUG   ] drx = exited with status True, code 0x00
2014-03-18 17:07:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   402923   8 56734 61647022 A NORMAL'
2014-03-18 17:07:27 [DEBUG   ] Got command DRX from MCS: ref #402924
2014-03-18 17:07:27 [INFO    ] sending drx command to lwa34
2014-03-18 17:07:27 [DEBUG   ] run_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 58000000.0 7 13 99']
2014-03-18 17:07:27 [DEBUG   ] drx = exited with status True, code 0x00
2014-03-18 17:07:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   402924   8 56734 61647026 A NORMAL'
2014-03-18 17:07:27 [DEBUG   ] Got command DRX from MCS: ref #402927
2014-03-18 17:07:27 [INFO    ] sending drx command to lwa34
2014-03-18 17:07:27 [DEBUG   ] run_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa34', '/lwa/software/drx 5 2 74000000.0 7 13 99']
2014-03-18 17:07:27 [DEBUG   ] drx = exited with status True, code 0x00
2014-03-18 17:07:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   402927   8 56734 61647030 A NORMAL'
2014-03-18 17:07:27 [DEBUG   ] Got command DRX from MCS: ref #402928
2014-03-18 17:07:27 [INFO    ] sending drx command to lwa34
2014-03-18 17:07:27 [DEBUG   ] run_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 74000000.0 7 13 99']
2014-03-18 17:07:27 [DEBUG   ] drx = exited with status True, code 0x00
2014-03-18 17:07:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   402928   8 56734 61647034 A NORMAL'
2014-03-18 17:07:27 [DEBUG   ] Got command DRX from MCS: ref #402929
2014-03-18 17:07:27 [INFO    ] sending drx command to lwa16
2014-03-18 17:07:27 [DEBUG   ] run_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 74000000.0 7 13 99']
2014-03-18 17:07:27 [DEBUG   ] drx = exited with status True, code 0x00
2014-03-18 17:07:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   402929   8 56734 61647038 A NORMAL'
2014-03-18 17:07:27 [DEBUG   ] Got command DRX from MCS: ref #402930
2014-03-18 17:07:27 [INFO    ] sending drx command to lwa16
2014-03-18 17:07:27 [DEBUG   ] run_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 74000000.0 7 13 99']
2014-03-18 17:07:27 [DEBUG   ] drx = exited with status True, code 0x00
2014-03-18 17:07:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   402930   8 56734 61647042 A NORMAL'
2014-03-18 17:07:27 [INFO    ] Finished starting DRX
2014-03-18 17:07:27 [INFO    ] Finished starting DRX
2014-03-18 17:07:27 [INFO    ] Finished starting DRX
2014-03-18 17:07:27 [INFO    ] Finished starting DRX
2014-03-18 17:07:27 [INFO    ] Finished starting DRX
2014-03-18 17:07:27 [INFO    ] Finished starting DRX
2014-03-18 17:07:27 [INFO    ] Finished starting DRX
2014-03-18 17:07:27 [DEBUG   ] Got command BAM from MCS: ref #402931
2014-03-18 17:07:27 [INFO    ] Finished processing BAM request
2014-03-18 17:07:27 [INFO    ] Finished starting DRX
2014-03-18 17:07:27 [DEBUG   ] bam = exited with status True, code 0x00
2014-03-18 17:07:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   402931   8 56734 61647133 A NORMAL'
2014-03-18 17:07:27 [DEBUG   ] Got command BAM from MCS: ref #402932
2014-03-18 17:07:27 [INFO    ] Finished processing BAM request
2014-03-18 17:07:27 [DEBUG   ] bam = exited with status True, code 0x00
2014-03-18 17:07:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   402932   8 56734 61647229 A NORMAL'
2014-03-18 17:07:27 [DEBUG   ] Got command BAM from MCS: ref #402933
2014-03-18 17:07:27 [INFO    ] Finished processing BAM request
2014-03-18 17:07:27 [DEBUG   ] bam = exited with status True, code 0x00
2014-03-18 17:07:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   402933   8 56734 61647329 A NORMAL'
2014-03-18 17:07:27 [DEBUG   ] Got command BAM from MCS: ref #402934
2014-03-18 17:07:27 [INFO    ] Finished processing BAM request
2014-03-18 17:07:27 [DEBUG   ] bam = exited with status True, code 0x00
2014-03-18 17:07:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   402934   8 56734 61647441 A NORMAL'
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2014-03-18 17:07:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2014-03-18 17:07:27 [DEBUG   ] spawn_process: at 2014-03-18 17:07:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2014-03-18 17:07:29 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-18 17:07:43 [DEBUG   ] Got command RPT from MCS: ref #402939
2014-03-18 17:07:43 [DEBUG   ] summary = NORMAL
2014-03-18 17:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402939  14 56734 61663461 A NORMALNORMAL'
2014-03-18 17:07:43 [DEBUG   ] Got command RPT from MCS: ref #402940
2014-03-18 17:07:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 17:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402940  48 56734 61663462 A NORMALSystem calibrated and operating normally'
2014-03-18 17:07:49 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-18 17:07:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:07:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2014-03-18 17:07:50 [DEBUG   ] Finished updating board flags in 0.971 seconds
2014-03-18 17:08:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 17:08:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 17:08:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 17:08:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-18 17:08:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-18 17:08:51 [DEBUG   ] Finished updating board flags in 1.371 seconds
2014-03-18 17:09:09 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 17:09:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 17:09:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 17:09:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:09:51 [DEBUG   ] Finished updating board flags in 1.191 seconds
2014-03-18 17:10:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 17:10:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 17:10:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 17:10:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-18 17:10:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 1
2014-03-18 17:10:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-18 17:10:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 3
2014-03-18 17:10:51 [DEBUG   ] Finished updating board flags in 1.023 seconds
2014-03-18 17:11:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 17:11:29 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2014-03-18 17:11:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 17:11:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 17:11:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:11:51 [DEBUG   ] Finished updating board flags in 0.988 seconds
2014-03-18 17:12:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 17:12:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 17:12:43 [DEBUG   ] Got command RPT from MCS: ref #402956
2014-03-18 17:12:43 [DEBUG   ] summary = NORMAL
2014-03-18 17:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402956  14 56734 61963457 A NORMALNORMAL'
2014-03-18 17:12:43 [DEBUG   ] Got command RPT from MCS: ref #402957
2014-03-18 17:12:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 17:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402957  48 56734 61963458 A NORMALSystem calibrated and operating normally'
2014-03-18 17:12:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 17:12:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:12:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-18 17:12:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-18 17:12:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-18 17:12:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:12:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-18 17:12:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:12:52 [DEBUG   ] Finished updating board flags in 1.887 seconds
2014-03-18 17:13:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 17:13:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 17:13:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 17:13:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-18 17:13:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-18 17:13:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:13:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-18 17:13:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:13:51 [DEBUG   ] Finished updating board flags in 1.168 seconds
2014-03-18 17:14:10 [DEBUG   ] Finished updating ant stats in 1.171 seconds
2014-03-18 17:14:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:14:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:14:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:14:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-18 17:14:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-18 17:14:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:14:51 [DEBUG   ] Finished updating board flags in 1.029 seconds
2014-03-18 17:15:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:15:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:15:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:15:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-18 17:15:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:15:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-18 17:15:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:15:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-18 17:15:51 [DEBUG   ] Finished updating board flags in 1.009 seconds
2014-03-18 17:16:10 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 17:16:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:16:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:16:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-18 17:16:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-18 17:16:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:16:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-18 17:16:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:16:51 [DEBUG   ] Finished updating board flags in 0.957 seconds
2014-03-18 17:17:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:17:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:17:43 [DEBUG   ] Got command RPT from MCS: ref #402973
2014-03-18 17:17:43 [DEBUG   ] summary = NORMAL
2014-03-18 17:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402973  14 56734 62263461 A NORMALNORMAL'
2014-03-18 17:17:43 [DEBUG   ] Got command RPT from MCS: ref #402974
2014-03-18 17:17:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 17:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402974  48 56734 62263462 A NORMALSystem calibrated and operating normally'
2014-03-18 17:17:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:17:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-03-18 17:17:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-18 17:17:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:17:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:17:52 [DEBUG   ] Finished updating board flags in 1.368 seconds
2014-03-18 17:18:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:18:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:18:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 17:18:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:18:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2014-03-18 17:18:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-18 17:18:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-18 17:18:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 17:18:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:18:52 [DEBUG   ] Finished updating board flags in 1.200 seconds
2014-03-18 17:19:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:19:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:19:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 17:19:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-18 17:19:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:19:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-18 17:19:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:19:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:19:52 [DEBUG   ] Finished updating board flags in 1.197 seconds
2014-03-18 17:20:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 17:20:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:20:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:20:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2014-03-18 17:20:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 17:20:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:20:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:20:52 [DEBUG   ] Finished updating board flags in 1.030 seconds
2014-03-18 17:21:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:21:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:21:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:21:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:21:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 17:21:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-18 17:21:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:21:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-03-18 17:21:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-18 17:21:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:21:53 [DEBUG   ] Finished updating board flags in 2.041 seconds
2014-03-18 17:22:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 17:22:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:22:43 [DEBUG   ] Got command RPT from MCS: ref #402990
2014-03-18 17:22:43 [DEBUG   ] summary = NORMAL
2014-03-18 17:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402990  14 56734 62563457 A NORMALNORMAL'
2014-03-18 17:22:43 [DEBUG   ] Got command RPT from MCS: ref #402991
2014-03-18 17:22:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 17:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   402991  48 56734 62563458 A NORMALSystem calibrated and operating normally'
2014-03-18 17:22:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:22:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:22:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2014-03-18 17:22:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 17:22:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-18 17:22:53 [DEBUG   ] Finished updating board flags in 1.932 seconds
2014-03-18 17:23:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:23:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:23:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 17:23:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-18 17:23:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:23:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-18 17:23:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-18 17:23:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:23:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-18 17:23:52 [DEBUG   ] Finished updating board flags in 1.275 seconds
2014-03-18 17:24:10 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2014-03-18 17:24:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 17:24:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2014-03-18 17:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2014-03-18 17:24:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:24:53 [DEBUG   ] Finished updating board flags in 1.749 seconds
2014-03-18 17:25:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 17:25:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 17:25:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-18 17:25:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:25:52 [DEBUG   ] Finished updating board flags in 1.038 seconds
2014-03-18 17:26:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 17:26:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 17:26:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 17:26:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-18 17:26:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-18 17:26:52 [DEBUG   ] Finished updating board flags in 1.025 seconds
2014-03-18 17:27:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 17:27:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 17:27:43 [DEBUG   ] Got command RPT from MCS: ref #403007
2014-03-18 17:27:43 [DEBUG   ] summary = NORMAL
2014-03-18 17:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403007  14 56734 62863461 A NORMALNORMAL'
2014-03-18 17:27:43 [DEBUG   ] Got command RPT from MCS: ref #403008
2014-03-18 17:27:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 17:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403008  48 56734 62863462 A NORMALSystem calibrated and operating normally'
2014-03-18 17:27:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 17:27:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-18 17:27:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-18 17:27:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-18 17:27:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 17:27:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:27:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-18 17:27:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-18 17:27:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:27:52 [DEBUG   ] Finished updating board flags in 0.969 seconds
2014-03-18 17:28:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 17:28:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 17:28:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 17:28:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-03-18 17:28:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:28:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-18 17:28:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 17:28:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-18 17:28:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:28:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-18 17:28:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:28:53 [DEBUG   ] Finished updating board flags in 1.413 seconds
2014-03-18 17:29:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 17:29:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 17:29:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 17:29:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 17:29:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-18 17:29:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-18 17:29:53 [DEBUG   ] Finished updating board flags in 1.348 seconds
2014-03-18 17:30:10 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2014-03-18 17:30:30 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-03-18 17:30:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 17:30:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-18 17:30:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:30:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 17:30:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:30:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:30:53 [DEBUG   ] Finished updating board flags in 1.198 seconds
2014-03-18 17:31:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 17:31:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 17:31:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 17:31:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-03-18 17:31:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-18 17:31:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-18 17:31:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2014-03-18 17:31:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-18 17:31:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:31:53 [DEBUG   ] Finished updating board flags in 1.011 seconds
2014-03-18 17:32:11 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2014-03-18 17:32:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:32:43 [DEBUG   ] Got command RPT from MCS: ref #403024
2014-03-18 17:32:43 [DEBUG   ] summary = NORMAL
2014-03-18 17:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403024  14 56734 63163465 A NORMALNORMAL'
2014-03-18 17:32:43 [DEBUG   ] Got command RPT from MCS: ref #403025
2014-03-18 17:32:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 17:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403025  48 56734 63163466 A NORMALSystem calibrated and operating normally'
2014-03-18 17:32:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:32:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-18 17:32:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-18 17:32:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:32:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:32:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:32:53 [DEBUG   ] Finished updating board flags in 0.985 seconds
2014-03-18 17:33:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:33:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 17:33:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:33:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-18 17:33:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-18 17:33:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:33:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-18 17:33:54 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-18 17:33:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:33:54 [DEBUG   ] Finished updating board flags in 1.809 seconds
2014-03-18 17:34:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:34:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 17:34:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:34:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-18 17:34:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:34:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-18 17:34:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:34:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:34:53 [DEBUG   ] Finished updating board flags in 1.236 seconds
2014-03-18 17:35:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:35:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:35:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 17:35:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:35:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-18 17:35:53 [DEBUG   ] Finished updating board flags in 1.233 seconds
2014-03-18 17:36:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:36:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:36:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:36:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:36:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2014-03-18 17:36:53 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 17:36:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-18 17:36:53 [DEBUG   ] Finished updating board flags in 1.236 seconds
2014-03-18 17:37:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:37:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:37:43 [DEBUG   ] Got command RPT from MCS: ref #403041
2014-03-18 17:37:43 [DEBUG   ] summary = NORMAL
2014-03-18 17:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403041  14 56734 63463469 A NORMALNORMAL'
2014-03-18 17:37:43 [DEBUG   ] Got command RPT from MCS: ref #403042
2014-03-18 17:37:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 17:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403042  48 56734 63463470 A NORMALSystem calibrated and operating normally'
2014-03-18 17:37:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 17:37:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:37:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2014-03-18 17:37:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-03-18 17:37:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-18 17:37:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-18 17:37:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:37:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-18 17:37:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-18 17:37:53 [DEBUG   ] Finished updating board flags in 1.224 seconds
2014-03-18 17:38:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:38:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:38:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:38:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:38:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 17:38:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2014-03-18 17:38:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-03-18 17:38:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:38:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:38:54 [DEBUG   ] Finished updating board flags in 1.757 seconds
2014-03-18 17:39:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:39:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:39:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:39:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-18 17:39:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-18 17:39:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:39:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-03-18 17:39:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-18 17:39:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:39:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-18 17:39:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-18 17:39:54 [DEBUG   ] Finished updating board flags in 1.519 seconds
2014-03-18 17:40:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:40:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:40:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 17:40:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2014-03-18 17:40:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-18 17:40:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:40:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 17:40:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:40:54 [DEBUG   ] Finished updating board flags in 1.410 seconds
2014-03-18 17:41:11 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 17:41:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:41:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 17:41:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:41:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-18 17:41:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 17:41:54 [DEBUG   ] Finished updating board flags in 1.376 seconds
2014-03-18 17:42:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 17:42:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:42:43 [DEBUG   ] Got command RPT from MCS: ref #403058
2014-03-18 17:42:43 [DEBUG   ] summary = NORMAL
2014-03-18 17:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403058  14 56734 63763469 A NORMALNORMAL'
2014-03-18 17:42:43 [DEBUG   ] Got command RPT from MCS: ref #403059
2014-03-18 17:42:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 17:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403059  48 56734 63763470 A NORMALSystem calibrated and operating normally'
2014-03-18 17:42:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 17:42:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2014-03-18 17:42:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 1
2014-03-18 17:42:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-18 17:42:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-18 17:42:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:42:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-18 17:42:54 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:42:54 [DEBUG   ] Finished updating board flags in 1.213 seconds
2014-03-18 17:43:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 17:43:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 17:43:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 17:43:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2014-03-18 17:43:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2014-03-18 17:43:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-18 17:43:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:43:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-18 17:43:54 [DEBUG   ] Finished updating board flags in 1.205 seconds
2014-03-18 17:44:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:44:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 17:44:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 17:44:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-18 17:44:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-18 17:44:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-18 17:44:54 [DEBUG   ] Finished updating board flags in 1.188 seconds
2014-03-18 17:45:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:45:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 17:45:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 17:45:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-18 17:45:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:45:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2014-03-18 17:45:54 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 17:45:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:45:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-18 17:45:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2014-03-18 17:45:54 [DEBUG   ] Finished updating board flags in 1.070 seconds
2014-03-18 17:46:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:46:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:46:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 17:46:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:46:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-18 17:46:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-18 17:46:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:46:55 [DEBUG   ] Finished updating board flags in 2.015 seconds
2014-03-18 17:47:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 17:47:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:47:43 [DEBUG   ] Got command RPT from MCS: ref #403075
2014-03-18 17:47:43 [DEBUG   ] summary = NORMAL
2014-03-18 17:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403075  14 56734 64063473 A NORMALNORMAL'
2014-03-18 17:47:43 [DEBUG   ] Got command RPT from MCS: ref #403076
2014-03-18 17:47:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 17:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403076  48 56734 64063474 A NORMALSystem calibrated and operating normally'
2014-03-18 17:47:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 17:47:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-03-18 17:47:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-18 17:47:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-18 17:47:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:47:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2014-03-18 17:47:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-18 17:47:54 [DEBUG   ] Finished updating board flags in 1.370 seconds
2014-03-18 17:48:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 17:48:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:48:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 17:48:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 17:48:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-18 17:48:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:48:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 17:48:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-03-18 17:48:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2014-03-18 17:48:55 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:48:55 [DEBUG   ] Finished updating board flags in 1.767 seconds
2014-03-18 17:49:11 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-18 17:49:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 17:49:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 17:49:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-18 17:49:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:49:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-18 17:49:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-18 17:49:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-18 17:49:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:49:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-18 17:49:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:49:55 [DEBUG   ] Finished updating board flags in 1.586 seconds
2014-03-18 17:50:11 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 17:50:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 17:50:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 17:50:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:50:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-18 17:50:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-18 17:50:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:50:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-03-18 17:50:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-18 17:50:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:50:55 [DEBUG   ] Finished updating board flags in 1.413 seconds
2014-03-18 17:51:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 17:51:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 17:51:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 17:51:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 17:51:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:51:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:51:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-18 17:51:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:51:55 [DEBUG   ] Finished updating board flags in 1.406 seconds
2014-03-18 17:52:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 17:52:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 17:52:43 [DEBUG   ] Got command RPT from MCS: ref #403092
2014-03-18 17:52:43 [DEBUG   ] summary = NORMAL
2014-03-18 17:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403092  14 56734 64363473 A NORMALNORMAL'
2014-03-18 17:52:43 [DEBUG   ] Got command RPT from MCS: ref #403093
2014-03-18 17:52:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 17:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403093  48 56734 64363474 A NORMALSystem calibrated and operating normally'
2014-03-18 17:52:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 17:52:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2014-03-18 17:52:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:52:55 [DEBUG   ] Finished updating board flags in 1.390 seconds
2014-03-18 17:53:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 17:53:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 17:53:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 17:53:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:53:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-18 17:53:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:53:55 [DEBUG   ] Finished updating board flags in 1.225 seconds
2014-03-18 17:54:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 17:54:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 17:54:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 17:54:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:54:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-18 17:54:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 17:54:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2014-03-18 17:54:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-18 17:54:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:54:55 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:54:55 [DEBUG   ] Finished updating board flags in 1.246 seconds
2014-03-18 17:55:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 17:55:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 17:55:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 17:55:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 17:55:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-18 17:55:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:55:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-18 17:55:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-18 17:55:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:55:55 [DEBUG   ] Finished updating board flags in 1.171 seconds
2014-03-18 17:56:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 17:56:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 17:56:51 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-18 17:56:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-18 17:56:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:56:56 [DEBUG   ] Finished updating board flags in 2.019 seconds
2014-03-18 17:57:11 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-03-18 17:57:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 17:57:43 [DEBUG   ] Got command RPT from MCS: ref #403109
2014-03-18 17:57:43 [DEBUG   ] summary = NORMAL
2014-03-18 17:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403109  14 56734 64663473 A NORMALNORMAL'
2014-03-18 17:57:43 [DEBUG   ] Got command RPT from MCS: ref #403110
2014-03-18 17:57:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 17:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403110  48 56734 64663474 A NORMALSystem calibrated and operating normally'
2014-03-18 17:57:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 17:57:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2014-03-18 17:57:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:57:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:57:56 [DEBUG   ] Finished updating board flags in 1.964 seconds
2014-03-18 17:58:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 17:58:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 17:58:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 17:58:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 17:58:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-18 17:58:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 17:58:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:58:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-18 17:58:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-18 17:58:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 17:58:55 [DEBUG   ] Finished updating board flags in 1.244 seconds
2014-03-18 17:59:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 17:59:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 17:59:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 17:59:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-18 17:59:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 17:59:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-03-18 17:59:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 17:59:56 [DEBUG   ] Finished updating board flags in 1.789 seconds
2014-03-18 18:00:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:00:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 18:00:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:00:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 18:00:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-18 18:00:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2014-03-18 18:00:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 18:00:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-18 18:00:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 18:00:55 [DEBUG   ] Finished updating board flags in 1.005 seconds
2014-03-18 18:01:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:01:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:01:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:01:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 18:01:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-18 18:01:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 18:01:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 18:01:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 18:01:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-18 18:01:56 [DEBUG   ] Finished updating board flags in 1.619 seconds
2014-03-18 18:02:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:02:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:02:43 [DEBUG   ] Got command RPT from MCS: ref #403126
2014-03-18 18:02:43 [DEBUG   ] summary = NORMAL
2014-03-18 18:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403126  14 56734 64963473 A NORMALNORMAL'
2014-03-18 18:02:43 [DEBUG   ] Got command RPT from MCS: ref #403127
2014-03-18 18:02:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 18:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403127  48 56734 64963474 A NORMALSystem calibrated and operating normally'
2014-03-18 18:02:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:02:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-18 18:02:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 18:02:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-18 18:02:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-18 18:02:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 18:02:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-18 18:02:56 [DEBUG   ] Finished updating board flags in 1.547 seconds
2014-03-18 18:03:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:03:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:03:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:03:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 18:03:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-18 18:03:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2014-03-18 18:03:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-18 18:03:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 18:03:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2014-03-18 18:03:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-18 18:03:56 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 18:03:56 [DEBUG   ] Finished updating board flags in 1.421 seconds
2014-03-18 18:04:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:04:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:04:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:04:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-18 18:04:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-18 18:04:56 [DEBUG   ] Finished updating board flags in 1.378 seconds
2014-03-18 18:05:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:05:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:05:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:05:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 18:05:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-18 18:05:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-18 18:05:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2014-03-18 18:05:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 18:05:56 [DEBUG   ] Finished updating board flags in 1.239 seconds
2014-03-18 18:06:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:06:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:06:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 18:06:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2014-03-18 18:06:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2014-03-18 18:06:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2014-03-18 18:06:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-18 18:06:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 18:06:56 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 18:06:56 [DEBUG   ] Finished updating board flags in 1.179 seconds
2014-03-18 18:07:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 18:07:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:07:43 [DEBUG   ] Got command RPT from MCS: ref #403143
2014-03-18 18:07:43 [DEBUG   ] summary = NORMAL
2014-03-18 18:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403143  14 56734 65263473 A NORMALNORMAL'
2014-03-18 18:07:43 [DEBUG   ] Got command RPT from MCS: ref #403144
2014-03-18 18:07:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 18:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403144  48 56734 65263474 A NORMALSystem calibrated and operating normally'
2014-03-18 18:07:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 18:07:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 18:07:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2014-03-18 18:07:56 [DEBUG   ] Finished updating board flags in 1.033 seconds
2014-03-18 18:08:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 18:08:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:08:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:08:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 18:08:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-18 18:08:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-18 18:08:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 18:08:57 [DEBUG   ] Finished updating board flags in 2.025 seconds
2014-03-18 18:09:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 18:09:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 18:09:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 18:09:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2014-03-18 18:09:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-18 18:09:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-18 18:09:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 18:09:56 [DEBUG   ] Finished updating board flags in 1.389 seconds
2014-03-18 18:10:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 18:10:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 18:10:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 18:10:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-18 18:10:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 18:10:56 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 18:10:56 [DEBUG   ] Finished updating board flags in 1.215 seconds
2014-03-18 18:11:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 18:11:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 18:11:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 18:11:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-18 18:11:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-18 18:11:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-18 18:11:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 18:11:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-18 18:11:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-18 18:11:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 18:11:56 [DEBUG   ] Finished updating board flags in 1.175 seconds
2014-03-18 18:12:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 18:12:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 18:12:43 [DEBUG   ] Got command RPT from MCS: ref #403160
2014-03-18 18:12:43 [DEBUG   ] summary = NORMAL
2014-03-18 18:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403160  14 56734 65563477 A NORMALNORMAL'
2014-03-18 18:12:43 [DEBUG   ] Got command RPT from MCS: ref #403161
2014-03-18 18:12:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 18:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403161  48 56734 65563478 A NORMALSystem calibrated and operating normally'
2014-03-18 18:12:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 18:12:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 18:12:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-18 18:12:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-18 18:12:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-18 18:12:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-18 18:12:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 18:12:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-18 18:12:56 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 18:12:56 [DEBUG   ] Finished updating board flags in 1.035 seconds
2014-03-18 18:13:00 [DEBUG   ] Got command INI from MCS: ref #403177
2014-03-18 18:13:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2014-03-18 18:13:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   403177   8 56734 65580894 ABOOTING'
2014-03-18 18:13:21 [INFO    ] -------------------
2014-03-18 18:13:21 [INFO    ]  LWA board status
2014-03-18 18:13:21 [INFO    ] -------------------
2014-03-18 18:13:21 [INFO    ] DP 1: 2 lwa27
2014-03-18 18:13:21 [INFO    ] DP 1: 3 lwa24
2014-03-18 18:13:21 [INFO    ] DP 1: 4 lwa23
2014-03-18 18:13:21 [INFO    ] DP 1: 5 lwa18
2014-03-18 18:13:21 [INFO    ] DP 1: 6 lwa10
2014-03-18 18:13:21 [INFO    ] DP 1: 7 lwa32
2014-03-18 18:13:21 [INFO    ] DP 1: 8 lwa11
2014-03-18 18:13:21 [INFO    ] DP 1: 9 lwa30
2014-03-18 18:13:21 [INFO    ] DP 1: 10 lwa12
2014-03-18 18:13:21 [INFO    ] DP 1: 11 lwa8
2014-03-18 18:13:21 [INFO    ] DP 1: 12 lwa13
2014-03-18 18:13:21 [INFO    ] DP 1: 13 lwa26
2014-03-18 18:13:21 [INFO    ] DP 1: 14 lwa14
2014-03-18 18:13:21 [INFO    ] DP 1: 16 lwa22
2014-03-18 18:13:21 [INFO    ] DP 1: 17 lwa20
2014-03-18 18:13:21 [INFO    ] DP 1: 18 lwa1
2014-03-18 18:13:21 [INFO    ] DP 1: 19 lwa5
2014-03-18 18:13:21 [INFO    ] DP 1: 20 lwa25
2014-03-18 18:13:21 [INFO    ] DP 1: 21 lwa35
2014-03-18 18:13:21 [INFO    ] DP 1: 22 lwa19
2014-03-18 18:13:21 [INFO    ] DP 1: 23 lwa21
2014-03-18 18:13:21 [INFO    ] DP 1: 24 lwa6
2014-03-18 18:13:21 [INFO    ] DP 1: 25 lwa7
2014-03-18 18:13:21 [INFO    ] DP 1: 26 lwa33
2014-03-18 18:13:21 [INFO    ] DP 1: 27 lwa15
2014-03-18 18:13:21 [INFO    ] DP 1: 28 lwa28
2014-03-18 18:13:21 [INFO    ] DP 2: 1 lwa16
2014-03-18 18:13:21 [INFO    ] DP 2: 15 lwa34
2014-03-18 18:13:21 [INFO    ] Total of 28 boards
2014-03-18 18:13:21 [INFO    ] Total of 260 stands
2014-03-18 18:13:21 [INFO    ] -------------------
2014-03-18 18:13:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14504
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14505
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14506
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14507
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14508
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14509
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14510
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14511
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14512
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14513
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14514
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14515
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14516
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14517
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14518
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14519
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14520
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14521
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14522
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14523
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14524
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14525
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14526
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14527
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14528
2014-03-18 18:13:28 [DEBUG   ] 2014-03-18 18:13:28 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14529
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14504 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14505 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14506 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14507 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14508 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14509 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14510 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14511 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14512 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14513 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14514 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14515 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14516 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14517 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14518 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14519 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14520 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14521 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14522 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14523 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14524 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14525 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14526 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14527 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14528 exited with status 0
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14529 exited with status 0
2014-03-18 18:13:41 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] spawn_process: at 2014-03-18 18:13:41 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 14556
2014-03-18 18:13:41 [DEBUG   ] 2014-03-18 18:13:41 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 14557
2014-03-18 18:13:46 [DEBUG   ] 2014-03-18 18:13:46 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 14556 exited with status 0
2014-03-18 18:13:46 [DEBUG   ] 2014-03-18 18:13:46 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 14557 exited with status 0
2014-03-18 18:13:46 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2014-03-18 18:13:46 [DEBUG   ] spawn_process: at 2014-03-18 18:13:46 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2014-03-18 18:13:46 [DEBUG   ] spawn_process: at 2014-03-18 18:13:46 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2014-03-18 18:13:46 [INFO    ] Setting Beam 1 xbars
2014-03-18 18:13:46 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2014-03-18 18:13:46 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2014-03-18 18:13:46 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2014-03-18 18:13:47 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2014-03-18 18:13:47 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2014-03-18 18:13:47 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2014-03-18 18:13:47 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2014-03-18 18:13:47 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2014-03-18 18:13:47 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2014-03-18 18:13:47 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2014-03-18 18:13:47 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2014-03-18 18:13:47 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2014-03-18 18:13:48 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2014-03-18 18:13:48 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2014-03-18 18:13:48 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2014-03-18 18:13:48 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2014-03-18 18:13:48 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2014-03-18 18:13:48 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2014-03-18 18:13:48 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2014-03-18 18:13:48 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2014-03-18 18:13:48 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2014-03-18 18:13:48 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2014-03-18 18:13:49 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2014-03-18 18:13:49 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2014-03-18 18:13:49 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2014-03-18 18:13:49 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2014-03-18 18:13:49 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2014-03-18 18:13:49 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2014-03-18 18:13:49 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2014-03-18 18:13:49 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2014-03-18 18:13:49 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2014-03-18 18:13:50 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2014-03-18 18:13:50 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2014-03-18 18:13:50 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2014-03-18 18:13:50 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2014-03-18 18:13:50 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2014-03-18 18:13:50 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2014-03-18 18:13:50 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2014-03-18 18:13:50 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2014-03-18 18:13:50 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2014-03-18 18:13:51 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2014-03-18 18:13:51 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2014-03-18 18:13:51 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2014-03-18 18:13:51 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2014-03-18 18:13:51 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2014-03-18 18:13:51 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2014-03-18 18:13:51 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2014-03-18 18:13:51 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2014-03-18 18:13:51 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2014-03-18 18:13:52 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2014-03-18 18:13:52 [INFO    ] Setting Beam 2 xbars
2014-03-18 18:13:52 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2014-03-18 18:13:52 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2014-03-18 18:13:52 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2014-03-18 18:13:52 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2014-03-18 18:13:52 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2014-03-18 18:13:52 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2014-03-18 18:13:52 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2014-03-18 18:13:52 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2014-03-18 18:13:52 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2014-03-18 18:13:53 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2014-03-18 18:13:53 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2014-03-18 18:13:53 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2014-03-18 18:13:53 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2014-03-18 18:13:53 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2014-03-18 18:13:53 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2014-03-18 18:13:53 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2014-03-18 18:13:53 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2014-03-18 18:13:53 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2014-03-18 18:13:54 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2014-03-18 18:13:54 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2014-03-18 18:13:54 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2014-03-18 18:13:54 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2014-03-18 18:13:54 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2014-03-18 18:13:54 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2014-03-18 18:13:54 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2014-03-18 18:13:54 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2014-03-18 18:13:54 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2014-03-18 18:13:55 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2014-03-18 18:13:55 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2014-03-18 18:13:55 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2014-03-18 18:13:55 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2014-03-18 18:13:55 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2014-03-18 18:13:55 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2014-03-18 18:13:55 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2014-03-18 18:13:55 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2014-03-18 18:13:55 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2014-03-18 18:13:56 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2014-03-18 18:13:56 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2014-03-18 18:13:56 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2014-03-18 18:13:56 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2014-03-18 18:13:56 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2014-03-18 18:13:56 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2014-03-18 18:13:56 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2014-03-18 18:13:56 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2014-03-18 18:13:56 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2014-03-18 18:13:56 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2014-03-18 18:13:57 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2014-03-18 18:13:57 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2014-03-18 18:13:57 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2014-03-18 18:13:57 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2014-03-18 18:13:57 [INFO    ] Setting Beam 3 xbars
2014-03-18 18:13:57 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2014-03-18 18:13:57 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2014-03-18 18:13:57 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2014-03-18 18:13:57 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2014-03-18 18:13:57 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2014-03-18 18:13:58 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2014-03-18 18:13:58 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2014-03-18 18:13:58 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2014-03-18 18:13:58 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2014-03-18 18:13:58 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2014-03-18 18:13:58 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2014-03-18 18:13:58 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2014-03-18 18:13:58 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2014-03-18 18:13:58 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2014-03-18 18:13:59 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2014-03-18 18:13:59 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2014-03-18 18:13:59 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2014-03-18 18:13:59 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2014-03-18 18:13:59 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2014-03-18 18:13:59 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2014-03-18 18:13:59 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2014-03-18 18:13:59 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2014-03-18 18:13:59 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2014-03-18 18:14:00 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2014-03-18 18:14:00 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2014-03-18 18:14:00 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2014-03-18 18:14:00 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2014-03-18 18:14:00 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2014-03-18 18:14:00 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2014-03-18 18:14:00 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2014-03-18 18:14:00 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2014-03-18 18:14:00 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2014-03-18 18:14:01 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2014-03-18 18:14:01 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2014-03-18 18:14:01 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2014-03-18 18:14:01 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2014-03-18 18:14:01 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2014-03-18 18:14:01 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2014-03-18 18:14:01 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2014-03-18 18:14:01 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2014-03-18 18:14:01 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2014-03-18 18:14:02 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2014-03-18 18:14:02 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2014-03-18 18:14:02 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2014-03-18 18:14:02 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2014-03-18 18:14:02 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2014-03-18 18:14:02 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2014-03-18 18:14:02 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2014-03-18 18:14:02 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2014-03-18 18:14:02 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2014-03-18 18:14:02 [INFO    ] Setting Beam 4 xbars
2014-03-18 18:14:02 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2014-03-18 18:14:03 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2014-03-18 18:14:03 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2014-03-18 18:14:03 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2014-03-18 18:14:03 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2014-03-18 18:14:03 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2014-03-18 18:14:03 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2014-03-18 18:14:03 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2014-03-18 18:14:03 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2014-03-18 18:14:03 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2014-03-18 18:14:04 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2014-03-18 18:14:04 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2014-03-18 18:14:04 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2014-03-18 18:14:04 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2014-03-18 18:14:04 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2014-03-18 18:14:04 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2014-03-18 18:14:04 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2014-03-18 18:14:04 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2014-03-18 18:14:04 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2014-03-18 18:14:05 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2014-03-18 18:14:05 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2014-03-18 18:14:05 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2014-03-18 18:14:05 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2014-03-18 18:14:05 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2014-03-18 18:14:05 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2014-03-18 18:14:05 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2014-03-18 18:14:05 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2014-03-18 18:14:05 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2014-03-18 18:14:06 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2014-03-18 18:14:06 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2014-03-18 18:14:06 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2014-03-18 18:14:06 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2014-03-18 18:14:06 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2014-03-18 18:14:06 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2014-03-18 18:14:06 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2014-03-18 18:14:06 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2014-03-18 18:14:07 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2014-03-18 18:14:07 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2014-03-18 18:14:07 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2014-03-18 18:14:07 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2014-03-18 18:14:07 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2014-03-18 18:14:08 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2014-03-18 18:14:08 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2014-03-18 18:14:08 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2014-03-18 18:14:08 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2014-03-18 18:14:08 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2014-03-18 18:14:08 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2014-03-18 18:14:08 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2014-03-18 18:14:08 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2014-03-18 18:14:08 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2014-03-18 18:14:09 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2014-03-18 18:14:09 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2014-03-18 18:14:09 [INFO    ] All xbars set
2014-03-18 18:14:09 [INFO    ] Setting adder chain routing for all beams
2014-03-18 18:14:13 [INFO    ] Setting beam ids
2014-03-18 18:14:24 [INFO    ] Starting beam delay calibration
2014-03-18 18:14:36 [INFO    ] Beam 1 latency is 5742
2014-03-18 18:14:36 [INFO    ] Beam 2 latency is 5749
2014-03-18 18:14:36 [INFO    ] Beam 3 latency is 5730
2014-03-18 18:14:36 [INFO    ] Beam 4 latency is 5740
2014-03-18 18:14:36 [INFO    ] Stop calibration
2014-03-18 18:14:44 [INFO    ] Beam delay calibration successful
2014-03-18 18:14:44 [INFO    ] Calibration passed
2014-03-18 18:14:44 [DEBUG   ] spawn_process: at 2014-03-18 18:14:44 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2014-03-18 18:14:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2014-03-18 18:14:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2014-03-18 18:14:44 [DEBUG   ] spawn_process: at 2014-03-18 18:14:44 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2014-03-18 18:14:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2014-03-18 18:14:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2014-03-18 18:14:44 [DEBUG   ] spawn_process: at 2014-03-18 18:14:44 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2014-03-18 18:14:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2014-03-18 18:14:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2014-03-18 18:14:44 [DEBUG   ] spawn_process: at 2014-03-18 18:14:44 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2014-03-18 18:14:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2014-03-18 18:14:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2014-03-18 18:14:44 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2014-03-18 18:14:44 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 431 ms (1395166484.435 s) with PID 16117 and time 1395166485
2014-03-18 18:14:44 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -4 msec
2014-03-18 18:14:44 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 521 ms (1395166484.524 s) with PID 16120 and time 1395166485
2014-03-18 18:14:45 [DEBUG   ] Finished updating ant stats in 0.725 seconds
2014-03-18 18:14:45 [INFO    ] Started antennas statistics background thread
2014-03-18 18:14:45 [INFO    ] Started board flags background thread
2014-03-18 18:14:45 [INFO    ] Started BAM background thread
2014-03-18 18:14:45 [INFO    ] Finished the INI process (ref. #403177) in 104.753 s
2014-03-18 18:14:46 [DEBUG   ] Finished updating board flags in 1.355 seconds
2014-03-18 18:15:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 18:15:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 18:15:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 18:15:47 [DEBUG   ] Finished updating board flags in 1.270 seconds
2014-03-18 18:16:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 18:16:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 18:16:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 18:16:47 [DEBUG   ] Finished updating board flags in 1.187 seconds
2014-03-18 18:17:05 [DEBUG   ] Finished updating ant stats in 0.395 seconds
2014-03-18 18:17:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:17:43 [DEBUG   ] Got command RPT from MCS: ref #403178
2014-03-18 18:17:43 [DEBUG   ] summary = NORMAL
2014-03-18 18:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403178  14 56734 65863481 A NORMALNORMAL'
2014-03-18 18:17:43 [DEBUG   ] Got command RPT from MCS: ref #403179
2014-03-18 18:17:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 18:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403179  48 56734 65863482 A NORMALSystem calibrated and operating normally'
2014-03-18 18:17:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:17:47 [DEBUG   ] Finished updating board flags in 1.018 seconds
2014-03-18 18:18:00 [DEBUG   ] Got command RPT from MCS: ref #403196
2014-03-18 18:18:00 [DEBUG   ] summary = NORMAL
2014-03-18 18:18:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403196  14 56734 65880885 A NORMALNORMAL'
2014-03-18 18:18:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:18:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 18:18:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 18:18:47 [DEBUG   ] Finished updating board flags in 1.069 seconds
2014-03-18 18:19:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 18:19:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 18:19:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 18:19:48 [DEBUG   ] Finished updating board flags in 1.994 seconds
2014-03-18 18:20:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 18:20:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 18:20:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 18:20:47 [DEBUG   ] Finished updating board flags in 1.170 seconds
2014-03-18 18:21:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 18:21:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 18:21:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 18:21:47 [DEBUG   ] Finished updating board flags in 1.038 seconds
2014-03-18 18:22:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 18:22:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 18:22:43 [DEBUG   ] Got command RPT from MCS: ref #403231
2014-03-18 18:22:43 [DEBUG   ] summary = NORMAL
2014-03-18 18:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403231  14 56734 66163481 A NORMALNORMAL'
2014-03-18 18:22:43 [DEBUG   ] Got command RPT from MCS: ref #403232
2014-03-18 18:22:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 18:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403232  48 56734 66163482 A NORMALSystem calibrated and operating normally'
2014-03-18 18:22:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 18:22:47 [DEBUG   ] Finished updating board flags in 0.966 seconds
2014-03-18 18:23:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 18:23:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-18 18:23:46 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-03-18 18:23:48 [DEBUG   ] Finished updating board flags in 1.378 seconds
2014-03-18 18:24:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 18:24:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 18:24:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 18:24:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 18:24:48 [DEBUG   ] Finished updating board flags in 1.187 seconds
2014-03-18 18:25:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 18:25:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 18:25:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 18:25:48 [DEBUG   ] Finished updating board flags in 1.010 seconds
2014-03-18 18:26:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-18 18:26:27 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-18 18:26:48 [DEBUG   ] Finished updating ant stats in 1.427 seconds
2014-03-18 18:26:48 [DEBUG   ] Finished updating board flags in 1.060 seconds
2014-03-18 18:27:00 [DEBUG   ] Got command TBN from MCS: ref #403248
2014-03-18 18:27:00 [DEBUG   ] spawn_process: at 2014-03-18 18:27:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '1', '1395167222']
2014-03-18 18:27:00 [DEBUG   ] spawn_process: at 2014-03-18 18:27:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '2', '1395167222']
2014-03-18 18:27:00 [DEBUG   ] spawn_process: at 2014-03-18 18:27:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '3', '1395167222']
2014-03-18 18:27:00 [DEBUG   ] tbn = exited with status True, code 0x00
2014-03-18 18:27:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   403248   8 56734 66420970 A NORMAL'
2014-03-18 18:27:00 [DEBUG   ] spawn_process: at 2014-03-18 18:27:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '4', '1395167222']
2014-03-18 18:27:00 [DEBUG   ] spawn_process: at 2014-03-18 18:27:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '5', '1395167222']
2014-03-18 18:27:00 [DEBUG   ] spawn_process: at 2014-03-18 18:27:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '6', '1395167222']
2014-03-18 18:27:00 [DEBUG   ] spawn_process: at 2014-03-18 18:27:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '7', '1395167222']
2014-03-18 18:27:00 [DEBUG   ] spawn_process: at 2014-03-18 18:27:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '8', '1395167222']
2014-03-18 18:27:00 [DEBUG   ] spawn_process: at 2014-03-18 18:27:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '9', '1395167222']
2014-03-18 18:27:00 [DEBUG   ] spawn_process: at 2014-03-18 18:27:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '10', '1395167222']
2014-03-18 18:27:00 [DEBUG   ] spawn_process: at 2014-03-18 18:27:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '11', '1395167222']
2014-03-18 18:27:00 [DEBUG   ] spawn_process: at 2014-03-18 18:27:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '12', '1395167222']
2014-03-18 18:27:00 [DEBUG   ] spawn_process: at 2014-03-18 18:27:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '13', '1395167222']
2014-03-18 18:27:00 [DEBUG   ] spawn_process: at 2014-03-18 18:27:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '14', '1395167222']
2014-03-18 18:27:00 [DEBUG   ] spawn_process: at 2014-03-18 18:27:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '15', '1395167222']
2014-03-18 18:27:00 [DEBUG   ] spawn_process: at 2014-03-18 18:27:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '16', '1395167222']
2014-03-18 18:27:00 [DEBUG   ] spawn_process: at 2014-03-18 18:27:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '17', '1395167222']
2014-03-18 18:27:00 [DEBUG   ] spawn_process: at 2014-03-18 18:27:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '18', '1395167222']
2014-03-18 18:27:01 [DEBUG   ] spawn_process: at 2014-03-18 18:27:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '19', '1395167222']
2014-03-18 18:27:01 [DEBUG   ] spawn_process: at 2014-03-18 18:27:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '20', '1395167222']
2014-03-18 18:27:01 [DEBUG   ] spawn_process: at 2014-03-18 18:27:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '21', '1395167222']
2014-03-18 18:27:01 [DEBUG   ] spawn_process: at 2014-03-18 18:27:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '22', '1395167222']
2014-03-18 18:27:01 [DEBUG   ] spawn_process: at 2014-03-18 18:27:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '23', '1395167222']
2014-03-18 18:27:01 [DEBUG   ] spawn_process: at 2014-03-18 18:27:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '24', '1395167222']
2014-03-18 18:27:01 [DEBUG   ] spawn_process: at 2014-03-18 18:27:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '25', '1395167222']
2014-03-18 18:27:01 [DEBUG   ] spawn_process: at 2014-03-18 18:27:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '26', '1395167222']
2014-03-18 18:27:01 [INFO    ] Finished spawning TBN in 0.050 s
2014-03-18 18:27:07 [DEBUG   ] Finished updating ant stats in 0.443 seconds
2014-03-18 18:27:28 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-03-18 18:27:43 [DEBUG   ] Got command RPT from MCS: ref #403249
2014-03-18 18:27:43 [DEBUG   ] summary = NORMAL
2014-03-18 18:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403249  14 56734 66463477 A NORMALNORMAL'
2014-03-18 18:27:43 [DEBUG   ] Got command RPT from MCS: ref #403250
2014-03-18 18:27:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 18:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403250  48 56734 66463478 A NORMALSystem calibrated and operating normally'
2014-03-18 18:27:47 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-03-18 18:27:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 18:27:49 [DEBUG   ] Finished updating board flags in 2.181 seconds
2014-03-18 18:28:07 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-03-18 18:28:28 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-03-18 18:28:48 [DEBUG   ] Finished updating ant stats in 1.257 seconds
2014-03-18 18:28:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 18:28:49 [DEBUG   ] Finished updating board flags in 2.013 seconds
2014-03-18 18:29:08 [DEBUG   ] Finished updating ant stats in 1.153 seconds
2014-03-18 18:29:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 18:29:48 [DEBUG   ] Finished updating ant stats in 0.852 seconds
2014-03-18 18:29:49 [DEBUG   ] Finished updating board flags in 1.973 seconds
2014-03-18 18:30:08 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2014-03-18 18:30:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-18 18:30:39 [DEBUG   ] Got command TBW from MCS: ref #403267
2014-03-18 18:30:39 [DEBUG   ] tbw = exited with status True, code 0x00
2014-03-18 18:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   403267   8 56734 66639338 A NORMAL'
2014-03-18 18:30:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2014-03-18 18:30:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2014-03-18 18:30:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2014-03-18 18:30:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2014-03-18 18:30:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2014-03-18 18:30:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2014-03-18 18:30:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2014-03-18 18:30:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2014-03-18 18:30:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2014-03-18 18:30:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2014-03-18 18:30:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2014-03-18 18:30:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2014-03-18 18:30:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2014-03-18 18:30:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2014-03-18 18:30:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2014-03-18 18:30:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2014-03-18 18:30:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2014-03-18 18:30:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2014-03-18 18:30:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2014-03-18 18:30:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2014-03-18 18:30:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2014-03-18 18:30:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2014-03-18 18:30:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2014-03-18 18:30:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2014-03-18 18:30:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2014-03-18 18:30:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2014-03-18 18:30:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2014-03-18 18:30:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2014-03-18 18:30:42 [DEBUG   ] spawn_process: at 2014-03-18 18:30:42 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2014-03-18 18:30:42 [INFO    ] Finished spawning TBW
2014-03-18 18:30:49 [DEBUG   ] Finished updating board flags in 1.635 seconds
2014-03-18 18:31:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2014-03-18 18:31:49 [DEBUG   ] Finished updating board flags in 1.693 seconds
2014-03-18 18:32:43 [DEBUG   ] Got command RPT from MCS: ref #403273
2014-03-18 18:32:43 [DEBUG   ] summary = NORMAL
2014-03-18 18:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403273  14 56734 66763490 A NORMALNORMAL'
2014-03-18 18:32:43 [DEBUG   ] Got command RPT from MCS: ref #403274
2014-03-18 18:32:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 18:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403274  48 56734 66763490 A NORMALSystem calibrated and operating normally'
2014-03-18 18:32:48 [DEBUG   ] Finished updating board flags in 0.938 seconds
2014-03-18 18:33:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 18:33:49 [DEBUG   ] Finished updating board flags in 1.470 seconds
2014-03-18 18:34:20 [INFO    ] __waitForTBW - TBW finished in 218.037 s
2014-03-18 18:34:21 [DEBUG   ] Finished updating ant stats in 0.390 seconds
2014-03-18 18:34:21 [INFO    ] Started antennas statistics background thread
2014-03-18 18:34:21 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '1', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '2', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '3', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '4', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '5', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '6', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '7', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '8', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '9', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '10', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '11', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '12', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '13', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '14', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '15', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '16', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '17', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '18', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '19', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '20', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '21', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '22', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '23', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '24', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '25', '1395167663']
2014-03-18 18:34:21 [DEBUG   ] spawn_process: at 2014-03-18 18:34:21 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '26', '1395167663']
2014-03-18 18:34:21 [INFO    ] Finished spawning TBN in 0.050 s
2014-03-18 18:34:42 [DEBUG   ] Finished updating ant stats in 1.271 seconds
2014-03-18 18:34:49 [DEBUG   ] Finished updating board flags in 1.620 seconds
2014-03-18 18:35:02 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-18 18:35:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 18:35:42 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 18:35:49 [DEBUG   ] Finished updating board flags in 1.627 seconds
2014-03-18 18:36:02 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2014-03-18 18:36:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 18:36:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 18:36:49 [DEBUG   ] Finished updating board flags in 1.625 seconds
2014-03-18 18:37:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 18:37:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 18:37:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 18:37:43 [DEBUG   ] Got command RPT from MCS: ref #403295
2014-03-18 18:37:43 [DEBUG   ] summary = NORMAL
2014-03-18 18:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403295  14 56734 67063477 A NORMALNORMAL'
2014-03-18 18:37:43 [DEBUG   ] Got command RPT from MCS: ref #403296
2014-03-18 18:37:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 18:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403296  48 56734 67063478 A NORMALSystem calibrated and operating normally'
2014-03-18 18:37:49 [DEBUG   ] Finished updating board flags in 1.622 seconds
2014-03-18 18:38:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 18:38:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 18:38:42 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-03-18 18:38:49 [DEBUG   ] Finished updating board flags in 1.619 seconds
2014-03-18 18:39:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 18:39:22 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-03-18 18:39:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 18:39:49 [DEBUG   ] Finished updating board flags in 1.630 seconds
2014-03-18 18:40:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 18:40:23 [DEBUG   ] Finished updating ant stats in 1.191 seconds
2014-03-18 18:40:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 18:40:49 [DEBUG   ] Finished updating board flags in 1.627 seconds
2014-03-18 18:41:03 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2014-03-18 18:41:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 18:41:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 18:41:49 [DEBUG   ] Finished updating board flags in 1.623 seconds
2014-03-18 18:42:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 18:42:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 18:42:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 18:42:43 [DEBUG   ] Got command RPT from MCS: ref #403312
2014-03-18 18:42:43 [DEBUG   ] summary = NORMAL
2014-03-18 18:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403312  14 56734 67363485 A NORMALNORMAL'
2014-03-18 18:42:43 [DEBUG   ] Got command RPT from MCS: ref #403313
2014-03-18 18:42:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 18:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403313  48 56734 67363486 A NORMALSystem calibrated and operating normally'
2014-03-18 18:42:49 [DEBUG   ] Finished updating board flags in 1.632 seconds
2014-03-18 18:43:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 18:43:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 18:43:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 18:43:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 18:43:50 [DEBUG   ] Finished updating board flags in 1.630 seconds
2014-03-18 18:44:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 18:44:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 18:44:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 18:44:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 18:44:50 [DEBUG   ] Finished updating board flags in 1.626 seconds
2014-03-18 18:45:03 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-03-18 18:45:23 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-03-18 18:45:43 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-03-18 18:45:50 [DEBUG   ] Finished updating board flags in 1.627 seconds
2014-03-18 18:46:04 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-18 18:46:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 18:46:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 18:46:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 18:46:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 18:46:50 [DEBUG   ] Finished updating board flags in 2.316 seconds
2014-03-18 18:47:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 18:47:24 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-18 18:47:43 [DEBUG   ] Got command RPT from MCS: ref #403329
2014-03-18 18:47:43 [DEBUG   ] summary = NORMAL
2014-03-18 18:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403329  14 56734 67663489 A NORMALNORMAL'
2014-03-18 18:47:43 [DEBUG   ] Got command RPT from MCS: ref #403330
2014-03-18 18:47:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 18:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403330  48 56734 67663490 A NORMALSystem calibrated and operating normally'
2014-03-18 18:47:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 18:47:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 18:47:50 [DEBUG   ] Finished updating board flags in 2.074 seconds
2014-03-18 18:48:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 18:48:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 18:48:44 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-03-18 18:48:50 [DEBUG   ] Finished updating board flags in 2.003 seconds
2014-03-18 18:49:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-18 18:49:25 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-03-18 18:49:45 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-03-18 18:49:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-18 18:49:50 [DEBUG   ] Finished updating board flags in 1.991 seconds
2014-03-18 18:50:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 18:50:25 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2014-03-18 18:50:45 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-18 18:50:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 18:50:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 18:50:50 [DEBUG   ] Finished updating board flags in 1.816 seconds
2014-03-18 18:51:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 18:51:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 18:51:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 18:51:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 18:51:50 [DEBUG   ] Finished updating board flags in 1.782 seconds
2014-03-18 18:52:05 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2014-03-18 18:52:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 18:52:43 [DEBUG   ] Got command RPT from MCS: ref #403346
2014-03-18 18:52:43 [DEBUG   ] summary = NORMAL
2014-03-18 18:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403346  14 56734 67963485 A NORMALNORMAL'
2014-03-18 18:52:43 [DEBUG   ] Got command RPT from MCS: ref #403347
2014-03-18 18:52:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 18:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403347  48 56734 67963486 A NORMALSystem calibrated and operating normally'
2014-03-18 18:52:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 18:52:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 18:52:50 [DEBUG   ] Finished updating board flags in 1.613 seconds
2014-03-18 18:53:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 18:53:25 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2014-03-18 18:53:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 18:53:50 [DEBUG   ] Finished updating board flags in 1.590 seconds
2014-03-18 18:54:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-18 18:54:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 18:54:45 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-03-18 18:54:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 18:54:50 [DEBUG   ] Finished updating board flags in 1.407 seconds
2014-03-18 18:55:06 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-03-18 18:55:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:55:46 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-18 18:55:50 [DEBUG   ] Finished updating board flags in 1.410 seconds
2014-03-18 18:56:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 18:56:26 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2014-03-18 18:56:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 18:56:50 [DEBUG   ] Finished updating board flags in 1.388 seconds
2014-03-18 18:57:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 18:57:26 [DEBUG   ] Finished updating ant stats in 0.989 seconds
2014-03-18 18:57:43 [DEBUG   ] Got command RPT from MCS: ref #403363
2014-03-18 18:57:43 [DEBUG   ] summary = NORMAL
2014-03-18 18:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403363  14 56734 68263493 A NORMALNORMAL'
2014-03-18 18:57:43 [DEBUG   ] Got command RPT from MCS: ref #403364
2014-03-18 18:57:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 18:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403364  48 56734 68263494 A NORMALSystem calibrated and operating normally'
2014-03-18 18:57:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 18:57:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 18:57:50 [DEBUG   ] Finished updating board flags in 1.356 seconds
2014-03-18 18:58:06 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2014-03-18 18:58:27 [DEBUG   ] Finished updating ant stats in 1.375 seconds
2014-03-18 18:58:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 18:58:51 [DEBUG   ] Finished updating board flags in 2.066 seconds
2014-03-18 18:59:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 18:59:27 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-18 18:59:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 18:59:51 [DEBUG   ] Finished updating board flags in 1.994 seconds
2014-03-18 19:00:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 19:00:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 19:00:47 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-18 19:00:51 [DEBUG   ] Finished updating board flags in 1.807 seconds
2014-03-18 19:01:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 19:01:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 19:01:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 19:01:51 [DEBUG   ] Finished updating board flags in 1.790 seconds
2014-03-18 19:02:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 19:02:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 19:02:43 [DEBUG   ] Got command RPT from MCS: ref #403380
2014-03-18 19:02:43 [DEBUG   ] summary = NORMAL
2014-03-18 19:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403380  14 56734 68563493 A NORMALNORMAL'
2014-03-18 19:02:43 [DEBUG   ] Got command RPT from MCS: ref #403381
2014-03-18 19:02:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 19:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403381  48 56734 68563494 A NORMALSystem calibrated and operating normally'
2014-03-18 19:02:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 19:02:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 19:02:51 [DEBUG   ] Finished updating board flags in 1.637 seconds
2014-03-18 19:03:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 19:03:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 19:03:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 19:03:51 [DEBUG   ] Finished updating board flags in 1.566 seconds
2014-03-18 19:04:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 19:04:28 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-03-18 19:04:47 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2014-03-18 19:04:51 [DEBUG   ] Finished updating board flags in 1.419 seconds
2014-03-18 19:05:08 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-03-18 19:05:28 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-03-18 19:05:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 19:05:51 [DEBUG   ] Finished updating board flags in 1.391 seconds
2014-03-18 19:06:08 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2014-03-18 19:06:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 19:06:48 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2014-03-18 19:06:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 19:06:51 [DEBUG   ] Finished updating board flags in 1.372 seconds
2014-03-18 19:07:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 19:07:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 19:07:43 [DEBUG   ] Got command RPT from MCS: ref #403397
2014-03-18 19:07:43 [DEBUG   ] summary = NORMAL
2014-03-18 19:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403397  14 56734 68863493 A NORMALNORMAL'
2014-03-18 19:07:43 [DEBUG   ] Got command RPT from MCS: ref #403398
2014-03-18 19:07:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 19:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403398  48 56734 68863494 A NORMALSystem calibrated and operating normally'
2014-03-18 19:07:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 19:07:52 [DEBUG   ] Finished updating board flags in 2.043 seconds
2014-03-18 19:08:08 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-18 19:08:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 19:08:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 19:08:52 [DEBUG   ] Finished updating board flags in 1.988 seconds
2014-03-18 19:09:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 19:09:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 19:09:48 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-03-18 19:09:52 [DEBUG   ] Finished updating board flags in 1.820 seconds
2014-03-18 19:10:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-18 19:10:28 [DEBUG   ] Finished updating ant stats in 0.587 seconds
2014-03-18 19:10:48 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-18 19:10:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-18 19:10:52 [DEBUG   ] Finished updating board flags in 1.788 seconds
2014-03-18 19:11:09 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-03-18 19:11:29 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 19:11:49 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-18 19:11:52 [DEBUG   ] Finished updating board flags in 1.615 seconds
2014-03-18 19:12:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 19:12:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 19:12:43 [DEBUG   ] Got command RPT from MCS: ref #403414
2014-03-18 19:12:43 [DEBUG   ] summary = NORMAL
2014-03-18 19:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403414  14 56734 69163489 A NORMALNORMAL'
2014-03-18 19:12:43 [DEBUG   ] Got command RPT from MCS: ref #403415
2014-03-18 19:12:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 19:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403415  48 56734 69163490 A NORMALSystem calibrated and operating normally'
2014-03-18 19:12:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 19:12:52 [DEBUG   ] Finished updating board flags in 1.593 seconds
2014-03-18 19:13:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 19:13:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 19:13:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 19:13:52 [DEBUG   ] Finished updating board flags in 1.411 seconds
2014-03-18 19:14:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 19:14:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 19:14:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 19:14:52 [DEBUG   ] Finished updating board flags in 1.395 seconds
2014-03-18 19:15:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 19:15:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 19:15:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 19:15:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 19:15:52 [DEBUG   ] Finished updating board flags in 1.352 seconds
2014-03-18 19:16:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 19:16:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-18 19:16:50 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-18 19:16:53 [DEBUG   ] Finished updating board flags in 2.053 seconds
2014-03-18 19:17:10 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-03-18 19:17:30 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 19:17:43 [DEBUG   ] Got command RPT from MCS: ref #403431
2014-03-18 19:17:43 [DEBUG   ] summary = NORMAL
2014-03-18 19:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403431  14 56734 69463489 A NORMALNORMAL'
2014-03-18 19:17:43 [DEBUG   ] Got command RPT from MCS: ref #403432
2014-03-18 19:17:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 19:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403432  48 56734 69463490 A NORMALSystem calibrated and operating normally'
2014-03-18 19:17:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 19:17:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 19:17:53 [DEBUG   ] Finished updating board flags in 2.007 seconds
2014-03-18 19:18:10 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-18 19:18:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 19:18:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 19:18:53 [DEBUG   ] Finished updating board flags in 2.002 seconds
2014-03-18 19:19:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-18 19:19:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 19:19:50 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-03-18 19:19:53 [DEBUG   ] Finished updating board flags in 2.020 seconds
2014-03-18 19:20:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-18 19:20:31 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-03-18 19:20:51 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-18 19:20:53 [DEBUG   ] Finished updating board flags in 1.965 seconds
2014-03-18 19:21:11 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 19:21:31 [DEBUG   ] Finished updating ant stats in 0.987 seconds
2014-03-18 19:21:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 19:21:53 [DEBUG   ] Finished updating board flags in 1.817 seconds
2014-03-18 19:22:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 19:22:31 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-18 19:22:43 [DEBUG   ] Got command RPT from MCS: ref #403448
2014-03-18 19:22:43 [DEBUG   ] summary = NORMAL
2014-03-18 19:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403448  14 56734 69763497 A NORMALNORMAL'
2014-03-18 19:22:43 [DEBUG   ] Got command RPT from MCS: ref #403449
2014-03-18 19:22:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 19:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403449  48 56734 69763498 A NORMALSystem calibrated and operating normally'
2014-03-18 19:22:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 19:22:53 [DEBUG   ] Finished updating board flags in 1.783 seconds
2014-03-18 19:23:11 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-03-18 19:23:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-18 19:23:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 19:23:53 [DEBUG   ] Finished updating board flags in 1.684 seconds
2014-03-18 19:24:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 19:24:32 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-18 19:24:52 [DEBUG   ] Finished updating ant stats in 1.258 seconds
2014-03-18 19:24:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 19:24:53 [DEBUG   ] Finished updating board flags in 1.532 seconds
2014-03-18 19:25:12 [DEBUG   ] Finished updating ant stats in 1.153 seconds
2014-03-18 19:25:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 19:25:52 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2014-03-18 19:25:53 [DEBUG   ] Finished updating board flags in 1.397 seconds
2014-03-18 19:26:12 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2014-03-18 19:26:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 19:26:52 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-03-18 19:26:53 [DEBUG   ] Finished updating board flags in 1.361 seconds
2014-03-18 19:27:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 19:27:33 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-18 19:27:43 [DEBUG   ] Got command RPT from MCS: ref #403465
2014-03-18 19:27:43 [DEBUG   ] summary = NORMAL
2014-03-18 19:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403465  14 56734 70063494 A NORMALNORMAL'
2014-03-18 19:27:43 [DEBUG   ] Got command RPT from MCS: ref #403466
2014-03-18 19:27:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 19:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403466  48 56734 70063494 A NORMALSystem calibrated and operating normally'
2014-03-18 19:27:53 [DEBUG   ] Finished updating ant stats in 1.259 seconds
2014-03-18 19:27:54 [DEBUG   ] Finished updating board flags in 2.055 seconds
2014-03-18 19:28:13 [DEBUG   ] Finished updating ant stats in 1.152 seconds
2014-03-18 19:28:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 19:28:53 [DEBUG   ] Finished updating ant stats in 0.856 seconds
2014-03-18 19:28:54 [DEBUG   ] Finished updating board flags in 1.983 seconds
2014-03-18 19:29:13 [DEBUG   ] Finished updating ant stats in 0.752 seconds
2014-03-18 19:29:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-18 19:29:53 [DEBUG   ] Finished updating ant stats in 0.444 seconds
2014-03-18 19:29:54 [DEBUG   ] Finished updating board flags in 1.821 seconds
2014-03-18 19:30:14 [DEBUG   ] Finished updating ant stats in 1.361 seconds
2014-03-18 19:30:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-03-18 19:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-03-18 19:30:54 [DEBUG   ] Finished updating ant stats in 1.045 seconds
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-03-18 19:30:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 19:30:54 [DEBUG   ] Finished updating board flags in 1.869 seconds
2014-03-18 19:31:14 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2014-03-18 19:31:34 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-18 19:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-18 19:31:54 [DEBUG   ] Finished updating ant stats in 0.839 seconds
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-18 19:31:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 19:31:54 [DEBUG   ] Finished updating board flags in 1.782 seconds
2014-03-18 19:32:14 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2014-03-18 19:32:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 19:32:43 [DEBUG   ] Got command RPT from MCS: ref #403482
2014-03-18 19:32:43 [DEBUG   ] summary = NORMAL
2014-03-18 19:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403482  14 56734 70363497 A NORMALNORMAL'
2014-03-18 19:32:43 [DEBUG   ] Got command RPT from MCS: ref #403483
2014-03-18 19:32:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 19:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403483  48 56734 70363498 A NORMALSystem calibrated and operating normally'
2014-03-18 19:32:54 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2014-03-18 19:32:54 [DEBUG   ] Finished updating board flags in 1.615 seconds
2014-03-18 19:33:14 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2014-03-18 19:33:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 19:33:54 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2014-03-18 19:33:54 [DEBUG   ] Finished updating board flags in 1.574 seconds
2014-03-18 19:34:15 [DEBUG   ] Finished updating ant stats in 1.350 seconds
2014-03-18 19:34:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 19:34:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 19:34:55 [DEBUG   ] Finished updating board flags in 2.512 seconds
2014-03-18 19:35:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 19:35:35 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 19:35:54 [DEBUG   ] Finished updating board flags in 1.420 seconds
2014-03-18 19:35:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 19:36:15 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-18 19:36:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 19:36:54 [DEBUG   ] Finished updating board flags in 1.428 seconds
2014-03-18 19:36:55 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2014-03-18 19:37:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 19:37:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 19:37:43 [DEBUG   ] Got command RPT from MCS: ref #403499
2014-03-18 19:37:43 [DEBUG   ] summary = NORMAL
2014-03-18 19:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403499  14 56734 70663501 A NORMALNORMAL'
2014-03-18 19:37:43 [DEBUG   ] Got command RPT from MCS: ref #403500
2014-03-18 19:37:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 19:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403500  48 56734 70663502 A NORMALSystem calibrated and operating normally'
2014-03-18 19:37:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 19:37:54 [DEBUG   ] Finished updating board flags in 1.422 seconds
2014-03-18 19:37:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 19:38:15 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-18 19:38:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 19:38:55 [DEBUG   ] Finished updating ant stats in 0.649 seconds
2014-03-18 19:38:55 [DEBUG   ] Finished updating board flags in 2.259 seconds
2014-03-18 19:39:15 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2014-03-18 19:39:36 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-18 19:39:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 19:39:55 [DEBUG   ] Finished updating board flags in 2.160 seconds
2014-03-18 19:39:56 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-18 19:40:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 19:40:36 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2014-03-18 19:40:55 [DEBUG   ] Finished updating board flags in 2.014 seconds
2014-03-18 19:40:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 19:41:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 19:41:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 19:41:55 [DEBUG   ] Finished updating board flags in 1.959 seconds
2014-03-18 19:41:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 19:42:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 19:42:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 19:42:43 [DEBUG   ] Got command RPT from MCS: ref #403516
2014-03-18 19:42:43 [DEBUG   ] summary = NORMAL
2014-03-18 19:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403516  14 56734 70963505 A NORMALNORMAL'
2014-03-18 19:42:43 [DEBUG   ] Got command RPT from MCS: ref #403517
2014-03-18 19:42:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 19:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403517  48 56734 70963506 A NORMALSystem calibrated and operating normally'
2014-03-18 19:42:55 [DEBUG   ] Finished updating board flags in 1.808 seconds
2014-03-18 19:42:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 19:43:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 19:43:37 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-18 19:43:55 [DEBUG   ] Finished updating board flags in 1.816 seconds
2014-03-18 19:43:57 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 19:44:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 19:44:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 19:44:55 [DEBUG   ] Finished updating board flags in 1.780 seconds
2014-03-18 19:44:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 19:45:17 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2014-03-18 19:45:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 19:45:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 19:45:55 [DEBUG   ] Finished updating board flags in 1.615 seconds
2014-03-18 19:45:57 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-18 19:46:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 19:46:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 19:46:55 [DEBUG   ] Finished updating board flags in 1.651 seconds
2014-03-18 19:46:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 19:47:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 19:47:37 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-18 19:47:43 [DEBUG   ] Got command RPT from MCS: ref #403533
2014-03-18 19:47:43 [DEBUG   ] summary = NORMAL
2014-03-18 19:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403533  14 56734 71263505 A NORMALNORMAL'
2014-03-18 19:47:43 [DEBUG   ] Got command RPT from MCS: ref #403534
2014-03-18 19:47:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 19:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403534  48 56734 71263506 A NORMALSystem calibrated and operating normally'
2014-03-18 19:47:55 [DEBUG   ] Finished updating board flags in 1.548 seconds
2014-03-18 19:47:57 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2014-03-18 19:48:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 19:48:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 19:48:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 19:48:55 [DEBUG   ] Finished updating board flags in 1.411 seconds
2014-03-18 19:48:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-18 19:49:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 19:49:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 19:49:55 [DEBUG   ] Finished updating board flags in 1.383 seconds
2014-03-18 19:49:58 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-18 19:50:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 19:50:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 19:50:55 [DEBUG   ] Finished updating board flags in 1.361 seconds
2014-03-18 19:50:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 19:51:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-18 19:51:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 19:51:56 [DEBUG   ] Finished updating board flags in 2.070 seconds
2014-03-18 19:51:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 19:52:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 19:52:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 19:52:43 [DEBUG   ] Got command RPT from MCS: ref #403550
2014-03-18 19:52:43 [DEBUG   ] summary = NORMAL
2014-03-18 19:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403550  14 56734 71563502 A NORMALNORMAL'
2014-03-18 19:52:43 [DEBUG   ] Got command RPT from MCS: ref #403551
2014-03-18 19:52:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 19:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403551  48 56734 71563502 A NORMALSystem calibrated and operating normally'
2014-03-18 19:52:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-18 19:52:56 [DEBUG   ] Finished updating board flags in 1.974 seconds
2014-03-18 19:52:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 19:53:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 19:53:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 19:53:56 [DEBUG   ] Finished updating board flags in 1.828 seconds
2014-03-18 19:53:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 19:54:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 19:54:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 19:54:56 [DEBUG   ] Finished updating board flags in 1.780 seconds
2014-03-18 19:54:59 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-03-18 19:55:19 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-18 19:55:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 19:55:56 [DEBUG   ] Finished updating board flags in 1.621 seconds
2014-03-18 19:55:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 19:56:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 19:56:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 19:56:56 [DEBUG   ] Finished updating board flags in 1.583 seconds
2014-03-18 19:56:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 19:57:19 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-18 19:57:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 19:57:43 [DEBUG   ] Got command RPT from MCS: ref #403567
2014-03-18 19:57:43 [DEBUG   ] summary = NORMAL
2014-03-18 19:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403567  14 56734 71863505 A NORMALNORMAL'
2014-03-18 19:57:43 [DEBUG   ] Got command RPT from MCS: ref #403568
2014-03-18 19:57:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 19:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403568  48 56734 71863506 A NORMALSystem calibrated and operating normally'
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-03-18 19:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-03-18 19:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-03-18 19:57:56 [DEBUG   ] Finished updating board flags in 1.433 seconds
2014-03-18 19:57:59 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 19:58:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 19:58:40 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-18 19:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-18 19:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-18 19:58:56 [DEBUG   ] Finished updating board flags in 1.383 seconds
2014-03-18 19:59:00 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 19:59:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 19:59:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 19:59:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 19:59:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 19:59:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 19:59:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 19:59:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 19:59:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 19:59:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 19:59:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 19:59:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 19:59:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 19:59:57 [DEBUG   ] Finished updating board flags in 2.200 seconds
2014-03-18 20:00:00 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2014-03-18 20:00:20 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 20:00:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 20:00:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:00:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:00:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:00:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:00:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:00:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:00:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:00:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:00:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:00:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:00:57 [DEBUG   ] Finished updating board flags in 2.004 seconds
2014-03-18 20:01:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 20:01:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 20:01:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 20:01:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:01:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:01:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:01:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:01:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:01:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:01:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:01:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:01:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:01:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:01:57 [DEBUG   ] Finished updating board flags in 1.990 seconds
2014-03-18 20:02:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 20:02:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 20:02:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 20:02:43 [DEBUG   ] Got command RPT from MCS: ref #403584
2014-03-18 20:02:43 [DEBUG   ] summary = NORMAL
2014-03-18 20:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403584  14 56734 72163505 A NORMALNORMAL'
2014-03-18 20:02:43 [DEBUG   ] Got command RPT from MCS: ref #403585
2014-03-18 20:02:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 20:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403585  48 56734 72163506 A NORMALSystem calibrated and operating normally'
2014-03-18 20:02:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:02:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:02:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:02:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:02:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:02:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:02:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:02:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:02:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:02:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:02:57 [DEBUG   ] Finished updating board flags in 1.817 seconds
2014-03-18 20:03:01 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-18 20:03:21 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-18 20:03:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 20:03:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:03:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:03:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:03:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:03:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:03:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:03:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:03:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:03:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:03:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:03:57 [DEBUG   ] Finished updating board flags in 1.809 seconds
2014-03-18 20:04:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-18 20:04:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 20:04:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 20:04:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:04:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:04:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:04:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:04:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:04:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:04:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:04:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:04:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:04:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:04:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-18 20:04:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 20:04:57 [DEBUG   ] Finished updating board flags in 1.787 seconds
2014-03-18 20:05:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 20:05:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-18 20:05:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 20:05:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:05:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:05:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:05:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:05:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:05:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:05:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:05:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:05:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:05:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:05:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-03-18 20:05:57 [DEBUG   ] Finished updating board flags in 1.611 seconds
2014-03-18 20:06:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-03-18 20:06:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 20:06:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 20:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:06:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:06:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:06:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:06:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:06:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:06:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 20:06:57 [DEBUG   ] Finished updating board flags in 1.602 seconds
2014-03-18 20:07:02 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-18 20:07:22 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 20:07:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 20:07:43 [DEBUG   ] Got command RPT from MCS: ref #403601
2014-03-18 20:07:43 [DEBUG   ] summary = NORMAL
2014-03-18 20:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403601  14 56734 72463505 A NORMALNORMAL'
2014-03-18 20:07:43 [DEBUG   ] Got command RPT from MCS: ref #403602
2014-03-18 20:07:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 20:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403602  48 56734 72463506 A NORMALSystem calibrated and operating normally'
2014-03-18 20:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:07:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:07:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:07:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:07:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:07:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:07:57 [DEBUG   ] Finished updating board flags in 1.602 seconds
2014-03-18 20:08:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 20:08:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 20:08:42 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 20:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:08:57 [DEBUG   ] Finished updating board flags in 1.598 seconds
2014-03-18 20:09:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 20:09:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 20:09:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 20:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:09:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:09:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:09:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:09:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:09:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:09:57 [DEBUG   ] Finished updating board flags in 1.414 seconds
2014-03-18 20:10:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 20:10:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 20:10:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 20:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:10:57 [DEBUG   ] Finished updating board flags in 1.399 seconds
2014-03-18 20:11:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 20:11:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 20:11:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 20:11:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:11:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:11:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:11:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:11:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:11:58 [DEBUG   ] Finished updating board flags in 2.219 seconds
2014-03-18 20:12:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 20:12:22 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-18 20:12:42 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 20:12:43 [DEBUG   ] Got command RPT from MCS: ref #403618
2014-03-18 20:12:43 [DEBUG   ] summary = NORMAL
2014-03-18 20:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403618  14 56734 72763505 A NORMALNORMAL'
2014-03-18 20:12:43 [DEBUG   ] Got command RPT from MCS: ref #403619
2014-03-18 20:12:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 20:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403619  48 56734 72763506 A NORMALSystem calibrated and operating normally'
2014-03-18 20:12:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:12:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:12:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:12:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:12:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:12:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:12:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:12:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:12:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:12:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:12:58 [DEBUG   ] Finished updating board flags in 2.213 seconds
2014-03-18 20:13:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 20:13:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 20:13:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 20:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:13:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:13:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:13:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:13:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:13:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:13:58 [DEBUG   ] Finished updating board flags in 2.217 seconds
2014-03-18 20:14:02 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2014-03-18 20:14:23 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2014-03-18 20:14:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 20:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:14:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:14:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:14:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:14:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:14:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:14:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 20:14:58 [DEBUG   ] Finished updating board flags in 2.138 seconds
2014-03-18 20:15:02 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-18 20:15:22 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-03-18 20:15:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 20:15:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:15:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:15:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:15:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:15:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:15:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:15:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:15:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:15:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:15:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:15:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 20:15:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-18 20:15:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 20:15:58 [DEBUG   ] Finished updating board flags in 2.018 seconds
2014-03-18 20:16:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 20:16:23 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 20:16:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 20:16:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:16:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:16:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:16:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:16:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:16:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:16:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:16:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:16:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:16:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:16:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 20:16:58 [DEBUG   ] Finished updating board flags in 2.097 seconds
2014-03-18 20:17:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 20:17:23 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 20:17:43 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 20:17:43 [DEBUG   ] Got command RPT from MCS: ref #403635
2014-03-18 20:17:43 [DEBUG   ] summary = NORMAL
2014-03-18 20:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403635  14 56734 73063509 A NORMALNORMAL'
2014-03-18 20:17:43 [DEBUG   ] Got command RPT from MCS: ref #403636
2014-03-18 20:17:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 20:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403636  48 56734 73063510 A NORMALSystem calibrated and operating normally'
2014-03-18 20:17:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:17:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:17:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:17:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:17:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:17:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 20:17:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:17:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:17:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:17:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:17:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:17:58 [DEBUG   ] Finished updating board flags in 1.927 seconds
2014-03-18 20:18:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 20:18:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 20:18:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 20:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:18:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:18:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:18:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:18:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:18:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:18:58 [DEBUG   ] Finished updating board flags in 1.789 seconds
2014-03-18 20:19:03 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-18 20:19:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 20:19:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 20:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:19:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 20:19:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:19:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:19:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:19:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:19:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:19:58 [DEBUG   ] Finished updating board flags in 1.607 seconds
2014-03-18 20:20:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 20:20:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 20:20:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 20:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:20:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:20:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:20:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:20:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:20:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:20:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 20:20:58 [DEBUG   ] Finished updating board flags in 1.580 seconds
2014-03-18 20:21:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 20:21:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 20:21:43 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-18 20:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:21:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:21:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:21:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:21:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:21:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:21:58 [DEBUG   ] Finished updating board flags in 1.499 seconds
2014-03-18 20:22:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 20:22:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 20:22:43 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-18 20:22:43 [DEBUG   ] Got command RPT from MCS: ref #403652
2014-03-18 20:22:43 [DEBUG   ] summary = NORMAL
2014-03-18 20:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403652  14 56734 73363509 A NORMALNORMAL'
2014-03-18 20:22:43 [DEBUG   ] Got command RPT from MCS: ref #403653
2014-03-18 20:22:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 20:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403653  48 56734 73363510 A NORMALSystem calibrated and operating normally'
2014-03-18 20:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:22:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:22:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:22:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:22:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:22:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:22:58 [DEBUG   ] Finished updating board flags in 1.496 seconds
2014-03-18 20:23:04 [DEBUG   ] Finished updating ant stats in 1.389 seconds
2014-03-18 20:23:24 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-18 20:23:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 20:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:23:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:23:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:23:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:23:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:23:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:23:58 [DEBUG   ] Finished updating board flags in 1.494 seconds
2014-03-18 20:24:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 20:24:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 20:24:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 20:24:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:24:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:24:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:24:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:24:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:24:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:24:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:24:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:24:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:24:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:24:59 [DEBUG   ] Finished updating board flags in 2.211 seconds
2014-03-18 20:25:04 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 20:25:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 20:25:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 20:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:25:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 20:25:59 [DEBUG   ] Finished updating board flags in 2.109 seconds
2014-03-18 20:26:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 20:26:24 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 20:26:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 20:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:26:59 [DEBUG   ] Finished updating board flags in 2.005 seconds
2014-03-18 20:27:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 20:27:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 20:27:43 [DEBUG   ] Got command RPT from MCS: ref #403669
2014-03-18 20:27:43 [DEBUG   ] summary = NORMAL
2014-03-18 20:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403669  14 56734 73663505 A NORMALNORMAL'
2014-03-18 20:27:43 [DEBUG   ] Got command RPT from MCS: ref #403670
2014-03-18 20:27:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 20:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403670  48 56734 73663506 A NORMALSystem calibrated and operating normally'
2014-03-18 20:27:44 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 20:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:27:59 [DEBUG   ] Finished updating board flags in 2.007 seconds
2014-03-18 20:28:05 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-18 20:28:25 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-18 20:28:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 20:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:28:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 20:28:59 [DEBUG   ] Finished updating board flags in 1.985 seconds
2014-03-18 20:29:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 20:29:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 20:29:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 20:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:29:59 [DEBUG   ] Finished updating board flags in 1.827 seconds
2014-03-18 20:30:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 20:30:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 20:30:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 20:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:30:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 20:30:59 [DEBUG   ] Finished updating board flags in 1.778 seconds
2014-03-18 20:31:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 20:31:25 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 20:31:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 20:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:31:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:31:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:31:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:31:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:31:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:31:59 [DEBUG   ] Finished updating board flags in 1.611 seconds
2014-03-18 20:32:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 20:32:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 20:32:43 [DEBUG   ] Got command RPT from MCS: ref #403686
2014-03-18 20:32:43 [DEBUG   ] summary = NORMAL
2014-03-18 20:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403686  14 56734 73963514 A NORMALNORMAL'
2014-03-18 20:32:43 [DEBUG   ] Got command RPT from MCS: ref #403687
2014-03-18 20:32:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 20:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403687  48 56734 73963514 A NORMALSystem calibrated and operating normally'
2014-03-18 20:32:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 20:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:32:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:32:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:32:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:32:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:32:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:32:59 [DEBUG   ] Finished updating board flags in 1.629 seconds
2014-03-18 20:33:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 20:33:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 20:33:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 20:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:33:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:33:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:33:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:33:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:33:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:33:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 20:33:59 [DEBUG   ] Finished updating board flags in 1.581 seconds
2014-03-18 20:34:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 20:34:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 20:34:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 20:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:34:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:34:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:34:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:34:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:34:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:34:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 20:34:59 [DEBUG   ] Finished updating board flags in 1.541 seconds
2014-03-18 20:35:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 20:35:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 20:35:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 20:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:35:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:35:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:35:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:35:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:35:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:35:59 [DEBUG   ] Finished updating board flags in 1.541 seconds
2014-03-18 20:36:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-18 20:36:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 20:36:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 20:36:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:36:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:36:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:36:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:36:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:37:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:37:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:37:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:37:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:37:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:37:00 [DEBUG   ] Finished updating board flags in 2.202 seconds
2014-03-18 20:37:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 20:37:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 20:37:43 [DEBUG   ] Got command RPT from MCS: ref #403703
2014-03-18 20:37:43 [DEBUG   ] summary = NORMAL
2014-03-18 20:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403703  14 56734 74263514 A NORMALNORMAL'
2014-03-18 20:37:43 [DEBUG   ] Got command RPT from MCS: ref #403704
2014-03-18 20:37:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 20:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403704  48 56734 74263514 A NORMALSystem calibrated and operating normally'
2014-03-18 20:37:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 20:37:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:37:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:37:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:37:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:37:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:38:00 [DEBUG   ] Finished updating board flags in 2.121 seconds
2014-03-18 20:38:06 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-18 20:38:26 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 20:38:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 20:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:39:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 20:39:00 [DEBUG   ] Finished updating board flags in 2.023 seconds
2014-03-18 20:39:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 20:39:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 20:39:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 20:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:40:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:40:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:40:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:40:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:40:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:40:00 [DEBUG   ] Finished updating board flags in 1.986 seconds
2014-03-18 20:40:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 20:40:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 20:40:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 20:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:41:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:41:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:41:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:41:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:41:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:41:00 [DEBUG   ] Finished updating board flags in 1.821 seconds
2014-03-18 20:41:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 20:41:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 20:41:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 20:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:42:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:42:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:42:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:42:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:42:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:42:00 [DEBUG   ] Finished updating board flags in 1.776 seconds
2014-03-18 20:42:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 20:42:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 20:42:43 [DEBUG   ] Got command RPT from MCS: ref #403720
2014-03-18 20:42:43 [DEBUG   ] summary = NORMAL
2014-03-18 20:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403720  14 56734 74563514 A NORMALNORMAL'
2014-03-18 20:42:43 [DEBUG   ] Got command RPT from MCS: ref #403721
2014-03-18 20:42:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 20:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403721  48 56734 74563514 A NORMALSystem calibrated and operating normally'
2014-03-18 20:42:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 20:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:43:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:43:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:43:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:43:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:43:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:43:00 [DEBUG   ] Finished updating board flags in 1.608 seconds
2014-03-18 20:43:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 20:43:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 20:43:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 20:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:44:00 [DEBUG   ] Finished updating board flags in 1.706 seconds
2014-03-18 20:44:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 20:44:26 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 20:44:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 20:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:45:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:45:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:45:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:45:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:45:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:45:00 [DEBUG   ] Finished updating board flags in 1.482 seconds
2014-03-18 20:45:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 20:45:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 20:45:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 20:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:46:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:46:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:46:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:46:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:46:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:46:00 [DEBUG   ] Finished updating board flags in 1.470 seconds
2014-03-18 20:46:07 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-03-18 20:46:27 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 20:46:47 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-03-18 20:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:47:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:47:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:47:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:47:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:47:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:47:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 20:47:00 [DEBUG   ] Finished updating board flags in 1.475 seconds
2014-03-18 20:47:07 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-18 20:47:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 20:47:43 [DEBUG   ] Got command RPT from MCS: ref #403737
2014-03-18 20:47:43 [DEBUG   ] summary = NORMAL
2014-03-18 20:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403737  14 56734 74863513 A NORMALNORMAL'
2014-03-18 20:47:43 [DEBUG   ] Got command RPT from MCS: ref #403738
2014-03-18 20:47:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 20:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403738  48 56734 74863514 A NORMALSystem calibrated and operating normally'
2014-03-18 20:47:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 20:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:48:00 [DEBUG   ] Finished updating board flags in 1.474 seconds
2014-03-18 20:48:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 20:48:27 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 20:48:48 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-03-18 20:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:49:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:49:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:49:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:49:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:49:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:49:01 [DEBUG   ] Finished updating board flags in 2.208 seconds
2014-03-18 20:49:08 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-18 20:49:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 20:49:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 20:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:50:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:50:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:50:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:50:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:50:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:50:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 20:50:01 [DEBUG   ] Finished updating board flags in 2.188 seconds
2014-03-18 20:50:08 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 20:50:28 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-03-18 20:50:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 20:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:51:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:51:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:51:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:51:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:51:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:51:01 [DEBUG   ] Finished updating board flags in 2.007 seconds
2014-03-18 20:51:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-18 20:51:29 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2014-03-18 20:51:49 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 20:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:52:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:52:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:52:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:52:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:52:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:52:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 20:52:01 [DEBUG   ] Finished updating board flags in 2.006 seconds
2014-03-18 20:52:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 20:52:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 20:52:43 [DEBUG   ] Got command RPT from MCS: ref #403754
2014-03-18 20:52:43 [DEBUG   ] summary = NORMAL
2014-03-18 20:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403754  14 56734 75163517 A NORMALNORMAL'
2014-03-18 20:52:43 [DEBUG   ] Got command RPT from MCS: ref #403755
2014-03-18 20:52:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 20:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403755  48 56734 75163518 A NORMALSystem calibrated and operating normally'
2014-03-18 20:52:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 20:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:53:01 [DEBUG   ] Finished updating board flags in 1.995 seconds
2014-03-18 20:53:09 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 20:53:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 20:53:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 20:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:54:01 [DEBUG   ] Finished updating board flags in 1.807 seconds
2014-03-18 20:54:09 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-03-18 20:54:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 20:54:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 20:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:55:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 20:55:01 [DEBUG   ] Finished updating board flags in 1.804 seconds
2014-03-18 20:55:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 20:55:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 20:55:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 20:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:56:01 [DEBUG   ] Finished updating board flags in 1.808 seconds
2014-03-18 20:56:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 20:56:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 20:56:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 20:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:57:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:57:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:57:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:57:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:57:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:57:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 20:57:01 [DEBUG   ] Finished updating board flags in 1.822 seconds
2014-03-18 20:57:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 20:57:29 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 20:57:43 [DEBUG   ] Got command RPT from MCS: ref #403771
2014-03-18 20:57:43 [DEBUG   ] summary = NORMAL
2014-03-18 20:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403771  14 56734 75463513 A NORMALNORMAL'
2014-03-18 20:57:43 [DEBUG   ] Got command RPT from MCS: ref #403772
2014-03-18 20:57:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 20:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403772  48 56734 75463514 A NORMALSystem calibrated and operating normally'
2014-03-18 20:57:50 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-18 20:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:58:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:58:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:58:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:58:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:58:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:58:01 [DEBUG   ] Finished updating board flags in 1.773 seconds
2014-03-18 20:58:10 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-18 20:58:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 20:58:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 20:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 20:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 20:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 20:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 20:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 20:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 20:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 20:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 20:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 20:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 20:59:01 [DEBUG   ] Finished updating board flags in 1.618 seconds
2014-03-18 20:59:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 20:59:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 20:59:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 21:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:00:01 [DEBUG   ] Finished updating board flags in 1.652 seconds
2014-03-18 21:00:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 21:00:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 21:00:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 21:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:01:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 21:01:01 [DEBUG   ] Finished updating board flags in 1.533 seconds
2014-03-18 21:01:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 21:01:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 21:01:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 21:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:02:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 21:02:01 [DEBUG   ] Finished updating board flags in 1.459 seconds
2014-03-18 21:02:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 21:02:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 21:02:43 [DEBUG   ] Got command RPT from MCS: ref #403788
2014-03-18 21:02:43 [DEBUG   ] summary = NORMAL
2014-03-18 21:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403788  14 56734 75763513 A NORMALNORMAL'
2014-03-18 21:02:43 [DEBUG   ] Got command RPT from MCS: ref #403789
2014-03-18 21:02:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 21:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403789  48 56734 75763514 A NORMALSystem calibrated and operating normally'
2014-03-18 21:02:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 21:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:03:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 21:03:01 [DEBUG   ] Finished updating board flags in 1.525 seconds
2014-03-18 21:03:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 21:03:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 21:03:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 21:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:04:01 [DEBUG   ] Finished updating board flags in 1.540 seconds
2014-03-18 21:04:10 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 21:04:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 21:04:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 21:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:05:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:05:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:05:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:05:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:05:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:05:02 [DEBUG   ] Finished updating board flags in 2.149 seconds
2014-03-18 21:05:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 21:05:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 21:05:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 21:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:06:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:06:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:06:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:06:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:06:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:06:02 [DEBUG   ] Finished updating board flags in 2.050 seconds
2014-03-18 21:06:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 21:06:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 21:06:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 21:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:07:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:07:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:07:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:07:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:07:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:07:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 21:07:02 [DEBUG   ] Finished updating board flags in 1.901 seconds
2014-03-18 21:07:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 21:07:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 21:07:43 [DEBUG   ] Got command RPT from MCS: ref #403805
2014-03-18 21:07:43 [DEBUG   ] summary = NORMAL
2014-03-18 21:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403805  14 56734 76063514 A NORMALNORMAL'
2014-03-18 21:07:43 [DEBUG   ] Got command RPT from MCS: ref #403806
2014-03-18 21:07:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 21:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403806  48 56734 76063514 A NORMALSystem calibrated and operating normally'
2014-03-18 21:07:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 21:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:08:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:08:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:08:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:08:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:08:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:08:02 [DEBUG   ] Finished updating board flags in 1.805 seconds
2014-03-18 21:08:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 21:08:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 21:08:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 21:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:09:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:09:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:09:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:09:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:09:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:09:02 [DEBUG   ] Finished updating board flags in 1.813 seconds
2014-03-18 21:09:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 21:09:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 21:09:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 21:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:10:02 [DEBUG   ] Finished updating board flags in 1.776 seconds
2014-03-18 21:10:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 21:10:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 21:10:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 21:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:11:02 [DEBUG   ] Finished updating board flags in 1.627 seconds
2014-03-18 21:11:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 21:11:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 21:11:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 21:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:12:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:12:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:12:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:12:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:12:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:12:02 [DEBUG   ] Finished updating board flags in 1.694 seconds
2014-03-18 21:12:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-18 21:12:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 21:12:43 [DEBUG   ] Got command RPT from MCS: ref #403822
2014-03-18 21:12:43 [DEBUG   ] summary = NORMAL
2014-03-18 21:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403822  14 56734 76363517 A NORMALNORMAL'
2014-03-18 21:12:43 [DEBUG   ] Got command RPT from MCS: ref #403823
2014-03-18 21:12:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 21:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403823  48 56734 76363518 A NORMALSystem calibrated and operating normally'
2014-03-18 21:12:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 21:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:13:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 21:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:13:02 [DEBUG   ] Finished updating board flags in 1.470 seconds
2014-03-18 21:13:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 21:13:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 21:13:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 21:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:14:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:14:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:14:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:14:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:14:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:14:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 21:14:02 [DEBUG   ] Finished updating board flags in 1.484 seconds
2014-03-18 21:14:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 21:14:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 21:14:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 21:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:15:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 21:15:02 [DEBUG   ] Finished updating board flags in 1.485 seconds
2014-03-18 21:15:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 21:15:30 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-18 21:15:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 21:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:16:02 [DEBUG   ] Finished updating board flags in 1.487 seconds
2014-03-18 21:16:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 21:16:31 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-03-18 21:16:51 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 21:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:17:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:17:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:17:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:17:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:17:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:17:03 [DEBUG   ] Finished updating board flags in 2.172 seconds
2014-03-18 21:17:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 21:17:31 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-03-18 21:17:43 [DEBUG   ] Got command RPT from MCS: ref #403839
2014-03-18 21:17:43 [DEBUG   ] summary = NORMAL
2014-03-18 21:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403839  14 56734 76663521 A NORMALNORMAL'
2014-03-18 21:17:43 [DEBUG   ] Got command RPT from MCS: ref #403840
2014-03-18 21:17:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 21:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403840  48 56734 76663522 A NORMALSystem calibrated and operating normally'
2014-03-18 21:17:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 21:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:18:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:18:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:18:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:18:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:18:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:18:03 [DEBUG   ] Finished updating board flags in 1.983 seconds
2014-03-18 21:18:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 21:18:31 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-18 21:18:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 21:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:19:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:19:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:19:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:19:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:19:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:19:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 21:19:03 [DEBUG   ] Finished updating board flags in 1.827 seconds
2014-03-18 21:19:11 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-18 21:19:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 21:19:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 21:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:20:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:20:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:20:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:20:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:20:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:20:03 [DEBUG   ] Finished updating board flags in 1.779 seconds
2014-03-18 21:20:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 21:20:31 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 21:20:52 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-18 21:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:21:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:21:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:21:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:21:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:21:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:21:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 21:21:03 [DEBUG   ] Finished updating board flags in 1.618 seconds
2014-03-18 21:21:12 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-18 21:21:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 21:21:52 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 21:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:22:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:22:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:22:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:22:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:22:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:22:03 [DEBUG   ] Finished updating board flags in 1.587 seconds
2014-03-18 21:22:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 21:22:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 21:22:43 [DEBUG   ] Got command RPT from MCS: ref #403856
2014-03-18 21:22:43 [DEBUG   ] summary = NORMAL
2014-03-18 21:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403856  14 56734 76963525 A NORMALNORMAL'
2014-03-18 21:22:43 [DEBUG   ] Got command RPT from MCS: ref #403857
2014-03-18 21:22:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 21:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403857  48 56734 76963526 A NORMALSystem calibrated and operating normally'
2014-03-18 21:22:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 21:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:23:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:23:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:23:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:23:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:23:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:23:03 [DEBUG   ] Finished updating board flags in 1.413 seconds
2014-03-18 21:23:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 21:23:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 21:23:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 21:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:24:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:24:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:24:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:24:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:24:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:24:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 21:24:03 [DEBUG   ] Finished updating board flags in 1.447 seconds
2014-03-18 21:24:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 21:24:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 21:24:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 21:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:25:03 [DEBUG   ] Finished updating board flags in 1.402 seconds
2014-03-18 21:25:12 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-03-18 21:25:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 21:25:53 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-18 21:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:26:03 [DEBUG   ] Finished updating board flags in 1.342 seconds
2014-03-18 21:26:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-18 21:26:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 21:26:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 21:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:27:03 [DEBUG   ] Finished updating board flags in 1.371 seconds
2014-03-18 21:27:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 21:27:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 21:27:43 [DEBUG   ] Got command RPT from MCS: ref #403873
2014-03-18 21:27:43 [DEBUG   ] summary = NORMAL
2014-03-18 21:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403873  14 56734 77263521 A NORMALNORMAL'
2014-03-18 21:27:43 [DEBUG   ] Got command RPT from MCS: ref #403874
2014-03-18 21:27:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 21:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403874  48 56734 77263522 A NORMALSystem calibrated and operating normally'
2014-03-18 21:27:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 21:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:28:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:28:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:28:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:28:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:28:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:28:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 21:28:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 21:28:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 21:28:04 [DEBUG   ] Finished updating board flags in 2.100 seconds
2014-03-18 21:28:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 21:28:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 21:28:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 21:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:29:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:29:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:29:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:29:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:29:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:29:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 21:29:04 [DEBUG   ] Finished updating board flags in 2.015 seconds
2014-03-18 21:29:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 21:29:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 21:29:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 21:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:30:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:30:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:30:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:30:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:30:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:30:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 21:30:04 [DEBUG   ] Finished updating board flags in 1.948 seconds
2014-03-18 21:30:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 21:30:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 21:30:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 21:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 21:31:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:31:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:31:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:31:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:31:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:31:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 21:31:04 [DEBUG   ] Finished updating board flags in 1.822 seconds
2014-03-18 21:31:13 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-03-18 21:31:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 21:31:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-18 21:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:32:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:32:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:32:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:32:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:32:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:32:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 21:32:04 [DEBUG   ] Finished updating board flags in 1.763 seconds
2014-03-18 21:32:14 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-18 21:32:34 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 21:32:43 [DEBUG   ] Got command RPT from MCS: ref #403890
2014-03-18 21:32:43 [DEBUG   ] summary = NORMAL
2014-03-18 21:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403890  14 56734 77563521 A NORMALNORMAL'
2014-03-18 21:32:43 [DEBUG   ] Got command RPT from MCS: ref #403891
2014-03-18 21:32:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 21:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403891  48 56734 77563522 A NORMALSystem calibrated and operating normally'
2014-03-18 21:32:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 21:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:33:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:33:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:33:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:33:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:33:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:33:04 [DEBUG   ] Finished updating board flags in 1.619 seconds
2014-03-18 21:33:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 21:33:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 21:33:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 21:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:34:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:34:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:34:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:34:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:34:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:34:04 [DEBUG   ] Finished updating board flags in 1.631 seconds
2014-03-18 21:34:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 21:34:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 21:34:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 21:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-18 21:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-18 21:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-18 21:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-18 21:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-18 21:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-18 21:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-18 21:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-18 21:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-18 21:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-18 21:35:04 [DEBUG   ] Finished updating board flags in 1.560 seconds
2014-03-18 21:35:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 21:35:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 21:35:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2014-03-18 21:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2014-03-18 21:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2014-03-18 21:36:04 [DEBUG   ] Finished updating board flags in 1.440 seconds
2014-03-18 21:36:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 21:36:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 21:36:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-18 21:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-18 21:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-18 21:37:04 [DEBUG   ] Finished updating board flags in 1.406 seconds
2014-03-18 21:37:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 21:37:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 21:37:43 [DEBUG   ] Got command RPT from MCS: ref #403907
2014-03-18 21:37:43 [DEBUG   ] summary = NORMAL
2014-03-18 21:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403907  14 56734 77863521 A NORMALNORMAL'
2014-03-18 21:37:43 [DEBUG   ] Got command RPT from MCS: ref #403908
2014-03-18 21:37:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 21:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403908  48 56734 77863522 A NORMALSystem calibrated and operating normally'
2014-03-18 21:37:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 21:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 21:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 21:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 21:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 21:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 21:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 21:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 21:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 21:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 21:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 21:38:04 [DEBUG   ] Finished updating board flags in 1.439 seconds
2014-03-18 21:38:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 21:38:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 21:38:54 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-18 21:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 21:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 21:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 21:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 21:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 21:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 21:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 21:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 21:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 21:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 21:39:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 21:39:04 [DEBUG   ] Finished updating board flags in 1.447 seconds
2014-03-18 21:39:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 21:39:34 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-18 21:39:55 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-18 21:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-18 21:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-18 21:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-18 21:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-18 21:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-18 21:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-18 21:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-18 21:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-18 21:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-18 21:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-18 21:40:04 [DEBUG   ] Finished updating board flags in 1.444 seconds
2014-03-18 21:40:15 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-18 21:40:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 21:40:55 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-03-18 21:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-03-18 21:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-03-18 21:41:04 [DEBUG   ] Finished updating board flags in 1.461 seconds
2014-03-18 21:41:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 21:41:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 21:41:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-18 21:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-18 21:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-18 21:42:05 [DEBUG   ] Finished updating board flags in 2.230 seconds
2014-03-18 21:42:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 21:42:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 21:42:43 [DEBUG   ] Got command RPT from MCS: ref #403924
2014-03-18 21:42:43 [DEBUG   ] summary = NORMAL
2014-03-18 21:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403924  14 56734 78163525 A NORMALNORMAL'
2014-03-18 21:42:43 [DEBUG   ] Got command RPT from MCS: ref #403925
2014-03-18 21:42:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 21:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403925  48 56734 78163526 A NORMALSystem calibrated and operating normally'
2014-03-18 21:42:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 21:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-18 21:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-18 21:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-18 21:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-18 21:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-18 21:43:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-18 21:43:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-18 21:43:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-18 21:43:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-18 21:43:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-18 21:43:05 [DEBUG   ] Finished updating board flags in 2.223 seconds
2014-03-18 21:43:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 21:43:35 [DEBUG   ] Finished updating ant stats in 0.793 seconds
2014-03-18 21:43:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 21:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-18 21:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-18 21:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-18 21:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-18 21:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-18 21:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-18 21:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-18 21:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-18 21:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-18 21:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-18 21:44:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 21:44:05 [DEBUG   ] Finished updating board flags in 2.218 seconds
2014-03-18 21:44:15 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 21:44:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 21:44:55 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-03-18 21:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-18 21:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-18 21:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-18 21:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-18 21:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-18 21:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-18 21:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-18 21:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-18 21:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-18 21:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-18 21:45:05 [DEBUG   ] Finished updating board flags in 2.121 seconds
2014-03-18 21:45:16 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-18 21:45:36 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-18 21:45:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 21:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-18 21:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-18 21:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-18 21:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-18 21:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-18 21:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-18 21:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-18 21:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-18 21:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-18 21:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-18 21:46:05 [DEBUG   ] Finished updating board flags in 2.011 seconds
2014-03-18 21:46:16 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-03-18 21:46:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 21:46:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 21:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-18 21:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-18 21:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-18 21:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-18 21:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-18 21:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-18 21:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-18 21:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-18 21:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-18 21:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-18 21:47:05 [DEBUG   ] Finished updating board flags in 1.980 seconds
2014-03-18 21:47:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 21:47:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 21:47:43 [DEBUG   ] Got command RPT from MCS: ref #403941
2014-03-18 21:47:43 [DEBUG   ] summary = NORMAL
2014-03-18 21:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403941  14 56734 78463525 A NORMALNORMAL'
2014-03-18 21:47:43 [DEBUG   ] Got command RPT from MCS: ref #403942
2014-03-18 21:47:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 21:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403942  48 56734 78463526 A NORMALSystem calibrated and operating normally'
2014-03-18 21:47:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 21:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-18 21:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-18 21:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-18 21:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-18 21:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-18 21:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-18 21:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-18 21:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-18 21:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-18 21:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-18 21:48:05 [DEBUG   ] Finished updating board flags in 1.839 seconds
2014-03-18 21:48:16 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 21:48:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 21:48:56 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-03-18 21:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-03-18 21:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-03-18 21:49:05 [DEBUG   ] Finished updating board flags in 1.780 seconds
2014-03-18 21:49:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 21:49:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 21:49:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-18 21:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-18 21:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-18 21:50:05 [DEBUG   ] Finished updating board flags in 1.627 seconds
2014-03-18 21:50:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 21:50:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 21:50:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 21:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 21:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 21:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 21:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 21:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 21:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 21:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 21:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 21:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 21:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 21:51:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 21:51:05 [DEBUG   ] Finished updating board flags in 1.562 seconds
2014-03-18 21:51:16 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-03-18 21:51:37 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-03-18 21:51:57 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-18 21:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 21:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 21:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 21:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 21:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 21:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 21:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 21:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 21:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 21:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 21:52:05 [DEBUG   ] Finished updating board flags in 1.416 seconds
2014-03-18 21:52:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 21:52:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 21:52:43 [DEBUG   ] Got command RPT from MCS: ref #403958
2014-03-18 21:52:43 [DEBUG   ] summary = NORMAL
2014-03-18 21:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403958  14 56734 78763529 A NORMALNORMAL'
2014-03-18 21:52:43 [DEBUG   ] Got command RPT from MCS: ref #403959
2014-03-18 21:52:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 21:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403959  48 56734 78763530 A NORMALSystem calibrated and operating normally'
2014-03-18 21:52:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 21:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 21:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 21:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 21:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 21:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 21:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 21:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 21:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 21:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 21:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 21:53:05 [DEBUG   ] Finished updating board flags in 1.393 seconds
2014-03-18 21:53:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 21:53:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 21:53:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 21:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 21:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 21:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 21:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 21:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 21:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 21:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 21:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 21:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 21:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 21:54:05 [DEBUG   ] Finished updating board flags in 1.414 seconds
2014-03-18 21:54:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 21:54:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 21:54:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 21:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 21:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 21:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 21:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 21:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 21:55:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 21:55:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 21:55:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 21:55:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 21:55:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 21:55:06 [DEBUG   ] Finished updating board flags in 2.297 seconds
2014-03-18 21:55:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 21:55:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 21:55:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 21:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 21:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 21:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 21:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 21:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 21:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 21:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 21:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 21:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 21:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 21:56:06 [DEBUG   ] Finished updating board flags in 2.118 seconds
2014-03-18 21:56:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 21:56:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 21:56:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 21:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 21:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 21:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 21:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 21:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 21:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 21:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 21:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 21:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 21:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 21:57:06 [DEBUG   ] Finished updating board flags in 2.003 seconds
2014-03-18 21:57:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 21:57:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 21:57:43 [DEBUG   ] Got command RPT from MCS: ref #403975
2014-03-18 21:57:43 [DEBUG   ] summary = NORMAL
2014-03-18 21:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403975  14 56734 79063525 A NORMALNORMAL'
2014-03-18 21:57:43 [DEBUG   ] Got command RPT from MCS: ref #403976
2014-03-18 21:57:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 21:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403976  48 56734 79063526 A NORMALSystem calibrated and operating normally'
2014-03-18 21:57:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 21:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 21:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 21:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 21:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 21:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 21:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 21:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 21:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 21:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 21:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 21:58:06 [DEBUG   ] Finished updating board flags in 2.004 seconds
2014-03-18 21:58:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 21:58:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 21:58:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 21:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 21:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 21:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 21:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 21:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 21:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 21:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 21:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 21:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 21:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 21:59:06 [DEBUG   ] Finished updating board flags in 1.976 seconds
2014-03-18 21:59:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 21:59:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 21:59:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 22:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 22:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 22:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 22:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 22:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 22:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 22:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 22:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 22:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 22:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 22:00:06 [DEBUG   ] Finished updating board flags in 1.876 seconds
2014-03-18 22:00:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 22:00:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 22:00:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 22:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 22:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 22:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 22:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 22:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 22:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 22:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 22:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 22:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 22:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 22:01:06 [DEBUG   ] Finished updating board flags in 1.837 seconds
2014-03-18 22:01:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 22:01:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 22:01:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 22:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 22:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 22:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 22:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 22:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 22:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 22:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 22:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 22:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 22:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 22:02:06 [DEBUG   ] Finished updating board flags in 1.690 seconds
2014-03-18 22:02:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 22:02:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 22:02:43 [DEBUG   ] Got command RPT from MCS: ref #403992
2014-03-18 22:02:43 [DEBUG   ] summary = NORMAL
2014-03-18 22:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403992  14 56734 79363533 A NORMALNORMAL'
2014-03-18 22:02:43 [DEBUG   ] Got command RPT from MCS: ref #403993
2014-03-18 22:02:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 22:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   403993  48 56734 79363534 A NORMALSystem calibrated and operating normally'
2014-03-18 22:02:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 22:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 22:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 22:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 22:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 22:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 22:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 22:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 22:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 22:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 22:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 22:03:06 [DEBUG   ] Finished updating board flags in 1.622 seconds
2014-03-18 22:03:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 22:03:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 22:03:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 22:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 22:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 22:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 22:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 22:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 22:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 22:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 22:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 22:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 22:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 22:04:06 [DEBUG   ] Finished updating board flags in 1.616 seconds
2014-03-18 22:04:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 22:04:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 22:04:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 22:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 22:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 22:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 22:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 22:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 22:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 22:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 22:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 22:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 22:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 22:05:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 22:05:06 [DEBUG   ] Finished updating board flags in 1.563 seconds
2014-03-18 22:05:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 22:05:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 22:05:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 22:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 22:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 22:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 22:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 22:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 22:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 22:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 22:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 22:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 22:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 22:06:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 22:06:06 [DEBUG   ] Finished updating board flags in 1.424 seconds
2014-03-18 22:06:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 22:06:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 22:06:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 22:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 22:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 22:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 22:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 22:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 22:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 22:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 22:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 22:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 22:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 22:07:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 22:07:06 [DEBUG   ] Finished updating board flags in 1.534 seconds
2014-03-18 22:07:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 22:07:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 22:07:43 [DEBUG   ] Got command RPT from MCS: ref #404009
2014-03-18 22:07:43 [DEBUG   ] summary = NORMAL
2014-03-18 22:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404009  14 56734 79663537 A NORMALNORMAL'
2014-03-18 22:07:43 [DEBUG   ] Got command RPT from MCS: ref #404010
2014-03-18 22:07:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 22:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404010  48 56734 79663538 A NORMALSystem calibrated and operating normally'
2014-03-18 22:07:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 22:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 22:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 22:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 22:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 22:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 22:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 22:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 22:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 22:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 22:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 22:08:06 [DEBUG   ] Finished updating board flags in 1.567 seconds
2014-03-18 22:08:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 22:08:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 22:08:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 22:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 22:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 22:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 22:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 22:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 22:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 22:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 22:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 22:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 22:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 22:09:07 [DEBUG   ] Finished updating board flags in 2.216 seconds
2014-03-18 22:09:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 22:09:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 22:09:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 22:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 22:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 22:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 22:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 22:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 22:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 22:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 22:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 22:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 22:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 22:10:08 [DEBUG   ] Finished updating board flags in 2.572 seconds
2014-03-18 22:10:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 22:10:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 22:10:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 22:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 22:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 22:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 22:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 22:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 22:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 22:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 22:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 22:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 22:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 22:11:07 [DEBUG   ] Finished updating board flags in 1.896 seconds
2014-03-18 22:11:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 22:11:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 22:11:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 22:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 22:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 22:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 22:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 22:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 22:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 22:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 22:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 22:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 22:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 22:12:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 22:12:07 [DEBUG   ] Finished updating board flags in 1.824 seconds
2014-03-18 22:12:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 22:12:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 22:12:43 [DEBUG   ] Got command RPT from MCS: ref #404026
2014-03-18 22:12:43 [DEBUG   ] summary = NORMAL
2014-03-18 22:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404026  14 56734 79963533 A NORMALNORMAL'
2014-03-18 22:12:43 [DEBUG   ] Got command RPT from MCS: ref #404027
2014-03-18 22:12:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 22:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404027  48 56734 79963534 A NORMALSystem calibrated and operating normally'
2014-03-18 22:12:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 22:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 22:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 22:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 22:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 22:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 22:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 22:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 22:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 22:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 22:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 22:13:07 [DEBUG   ] Finished updating board flags in 1.777 seconds
2014-03-18 22:13:17 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 22:13:37 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-03-18 22:13:58 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-18 22:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 22:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 22:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 22:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 22:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 22:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 22:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 22:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 22:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 22:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 22:14:07 [DEBUG   ] Finished updating board flags in 1.609 seconds
2014-03-18 22:14:18 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-18 22:14:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 22:14:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 22:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 22:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 22:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 22:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 22:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 22:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 22:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 22:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 22:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 22:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 22:15:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 22:15:07 [DEBUG   ] Finished updating board flags in 1.610 seconds
2014-03-18 22:15:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 22:15:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 22:15:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 22:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-18 22:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-18 22:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-18 22:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-18 22:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-18 22:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-18 22:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-18 22:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-18 22:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-18 22:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-18 22:16:07 [DEBUG   ] Finished updating board flags in 1.587 seconds
2014-03-18 22:16:18 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-18 22:16:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 22:16:58 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-03-18 22:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-03-18 22:17:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 22:17:07 [DEBUG   ] Finished updating board flags in 1.421 seconds
2014-03-18 22:17:19 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-18 22:17:39 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-18 22:17:43 [DEBUG   ] Got command RPT from MCS: ref #404043
2014-03-18 22:17:43 [DEBUG   ] summary = NORMAL
2014-03-18 22:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404043  14 56734 80263533 A NORMALNORMAL'
2014-03-18 22:17:43 [DEBUG   ] Got command RPT from MCS: ref #404044
2014-03-18 22:17:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 22:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404044  48 56734 80263534 A NORMALSystem calibrated and operating normally'
2014-03-18 22:17:59 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-18 22:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-18 22:18:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 22:18:07 [DEBUG   ] Finished updating board flags in 1.383 seconds
2014-03-18 22:18:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 22:18:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 22:18:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 22:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-18 22:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 22:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 22:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 22:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 22:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 22:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 22:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 22:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 22:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 22:19:07 [DEBUG   ] Finished updating board flags in 1.357 seconds
2014-03-18 22:19:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 22:19:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 22:19:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 22:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-18 22:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 22:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 22:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 22:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 22:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 22:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 22:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 22:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 22:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 22:20:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 22:20:08 [DEBUG   ] Finished updating board flags in 2.059 seconds
2014-03-18 22:20:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 22:20:39 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-18 22:20:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 22:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-18 22:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 22:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 22:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 22:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 22:21:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-18 22:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 22:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 22:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 22:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 22:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 22:21:08 [DEBUG   ] Finished updating board flags in 1.986 seconds
2014-03-18 22:21:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 22:21:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 22:21:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 22:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-18 22:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 22:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 22:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 22:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 22:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 22:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 22:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 22:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 22:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 22:22:08 [DEBUG   ] Finished updating board flags in 1.860 seconds
2014-03-18 22:22:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 22:22:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 22:22:43 [DEBUG   ] Got command RPT from MCS: ref #404060
2014-03-18 22:22:43 [DEBUG   ] summary = NORMAL
2014-03-18 22:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404060  14 56734 80563533 A NORMALNORMAL'
2014-03-18 22:22:43 [DEBUG   ] Got command RPT from MCS: ref #404061
2014-03-18 22:22:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 22:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404061  48 56734 80563534 A NORMALSystem calibrated and operating normally'
2014-03-18 22:22:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 22:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-18 22:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 22:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 22:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 22:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 22:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 22:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 22:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 22:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 22:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 22:23:08 [DEBUG   ] Finished updating board flags in 1.806 seconds
2014-03-18 22:23:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 22:23:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 22:23:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 22:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-18 22:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 22:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 22:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 22:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 22:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 22:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 22:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 22:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 22:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 22:24:08 [DEBUG   ] Finished updating board flags in 1.735 seconds
2014-03-18 22:24:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 22:24:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 22:24:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 22:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-18 22:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 22:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 22:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 22:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 22:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 22:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 22:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 22:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 22:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 22:25:08 [DEBUG   ] Finished updating board flags in 1.635 seconds
2014-03-18 22:25:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 22:25:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 22:25:59 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-18 22:26:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-18 22:26:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 22:26:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 22:26:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 22:26:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 22:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 22:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 22:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 22:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 22:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 22:26:08 [DEBUG   ] Finished updating board flags in 1.619 seconds
2014-03-18 22:26:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 22:26:40 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-18 22:27:00 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-18 22:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-18 22:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-18 22:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-18 22:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-18 22:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-18 22:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-18 22:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-18 22:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-18 22:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-18 22:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-18 22:27:08 [DEBUG   ] Finished updating board flags in 1.564 seconds
2014-03-18 22:27:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 22:27:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 22:27:43 [DEBUG   ] Got command RPT from MCS: ref #404077
2014-03-18 22:27:43 [DEBUG   ] summary = NORMAL
2014-03-18 22:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404077  14 56734 80863541 A NORMALNORMAL'
2014-03-18 22:27:43 [DEBUG   ] Got command RPT from MCS: ref #404078
2014-03-18 22:27:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 22:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404078  48 56734 80863542 A NORMALSystem calibrated and operating normally'
2014-03-18 22:28:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-03-18 22:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-03-18 22:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-03-18 22:28:08 [DEBUG   ] Finished updating board flags in 1.439 seconds
2014-03-18 22:28:20 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 22:28:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 22:29:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-18 22:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-18 22:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-18 22:29:08 [DEBUG   ] Finished updating board flags in 1.483 seconds
2014-03-18 22:29:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 22:29:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 22:30:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 22:30:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:30:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:30:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:30:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:30:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:30:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:30:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:30:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:30:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:30:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:30:08 [DEBUG   ] Finished updating board flags in 1.496 seconds
2014-03-18 22:30:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 22:30:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 22:31:00 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 22:31:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:31:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:31:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:31:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:31:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:31:09 [DEBUG   ] Finished updating board flags in 2.212 seconds
2014-03-18 22:31:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 22:31:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 22:32:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 22:32:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:32:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:32:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:32:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:32:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:32:09 [DEBUG   ] Finished updating board flags in 2.164 seconds
2014-03-18 22:32:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 22:32:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 22:32:43 [DEBUG   ] Got command RPT from MCS: ref #404094
2014-03-18 22:32:43 [DEBUG   ] summary = NORMAL
2014-03-18 22:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404094  14 56734 81163541 A NORMALNORMAL'
2014-03-18 22:32:43 [DEBUG   ] Got command RPT from MCS: ref #404095
2014-03-18 22:32:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 22:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404095  48 56734 81163542 A NORMALSystem calibrated and operating normally'
2014-03-18 22:33:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 22:33:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:33:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:33:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:33:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:33:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:33:09 [DEBUG   ] Finished updating board flags in 2.059 seconds
2014-03-18 22:33:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 22:33:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 22:34:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 22:34:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:34:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:34:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:34:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:34:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:34:09 [DEBUG   ] Finished updating board flags in 1.948 seconds
2014-03-18 22:34:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 22:34:40 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 22:35:01 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-18 22:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:35:09 [DEBUG   ] Finished updating board flags in 1.816 seconds
2014-03-18 22:35:21 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 22:35:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 22:36:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 22:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:36:09 [DEBUG   ] Finished updating board flags in 1.785 seconds
2014-03-18 22:36:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 22:36:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 22:37:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 22:37:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:37:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:37:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:37:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:37:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:37:09 [DEBUG   ] Finished updating board flags in 1.618 seconds
2014-03-18 22:37:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 22:37:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 22:37:43 [DEBUG   ] Got command RPT from MCS: ref #404111
2014-03-18 22:37:43 [DEBUG   ] summary = NORMAL
2014-03-18 22:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404111  14 56734 81463541 A NORMALNORMAL'
2014-03-18 22:37:43 [DEBUG   ] Got command RPT from MCS: ref #404112
2014-03-18 22:37:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 22:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404112  48 56734 81463542 A NORMALSystem calibrated and operating normally'
2014-03-18 22:38:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 22:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:38:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 22:38:09 [DEBUG   ] Finished updating board flags in 1.578 seconds
2014-03-18 22:38:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 22:38:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 22:39:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-18 22:39:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:39:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:39:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:39:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:39:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:39:09 [DEBUG   ] Finished updating board flags in 1.418 seconds
2014-03-18 22:39:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 22:39:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 22:40:01 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 22:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:40:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 22:40:09 [DEBUG   ] Finished updating board flags in 1.408 seconds
2014-03-18 22:40:21 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-18 22:40:41 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-18 22:41:02 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-03-18 22:41:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:41:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:41:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:41:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:41:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:41:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:41:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:41:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:41:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:41:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:41:09 [DEBUG   ] Finished updating board flags in 1.384 seconds
2014-03-18 22:41:22 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-18 22:41:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 22:42:02 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 22:42:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:42:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:42:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:42:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:42:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:42:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:42:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:42:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:42:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:42:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:42:09 [DEBUG   ] Finished updating board flags in 1.360 seconds
2014-03-18 22:42:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-18 22:42:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 22:42:43 [DEBUG   ] Got command RPT from MCS: ref #404128
2014-03-18 22:42:43 [DEBUG   ] summary = NORMAL
2014-03-18 22:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404128  14 56734 81763541 A NORMALNORMAL'
2014-03-18 22:42:43 [DEBUG   ] Got command RPT from MCS: ref #404129
2014-03-18 22:42:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 22:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404129  48 56734 81763542 A NORMALSystem calibrated and operating normally'
2014-03-18 22:43:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 22:43:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:43:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:43:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:43:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:43:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:43:10 [DEBUG   ] Finished updating board flags in 2.058 seconds
2014-03-18 22:43:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 22:43:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 22:44:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 22:44:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:44:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:44:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:44:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:44:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:44:10 [DEBUG   ] Finished updating board flags in 1.992 seconds
2014-03-18 22:44:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 22:44:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 22:45:02 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-18 22:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:45:10 [DEBUG   ] Finished updating board flags in 1.863 seconds
2014-03-18 22:45:22 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2014-03-18 22:45:42 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-18 22:46:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 22:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:46:10 [DEBUG   ] Finished updating board flags in 1.741 seconds
2014-03-18 22:46:23 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-18 22:46:43 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-18 22:47:03 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 22:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:47:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 22:47:10 [DEBUG   ] Finished updating board flags in 1.603 seconds
2014-03-18 22:47:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 22:47:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 22:47:43 [DEBUG   ] Got command RPT from MCS: ref #404145
2014-03-18 22:47:43 [DEBUG   ] summary = NORMAL
2014-03-18 22:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404145  14 56734 82063545 A NORMALNORMAL'
2014-03-18 22:47:43 [DEBUG   ] Got command RPT from MCS: ref #404146
2014-03-18 22:47:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 22:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404146  48 56734 82063546 A NORMALSystem calibrated and operating normally'
2014-03-18 22:48:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 22:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:48:10 [DEBUG   ] Finished updating board flags in 1.590 seconds
2014-03-18 22:48:23 [DEBUG   ] Finished updating ant stats in 0.990 seconds
2014-03-18 22:48:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 22:49:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 22:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:49:10 [DEBUG   ] Finished updating board flags in 1.422 seconds
2014-03-18 22:49:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 22:49:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 22:50:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 22:50:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:50:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:50:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:50:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:50:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:50:10 [DEBUG   ] Finished updating board flags in 1.478 seconds
2014-03-18 22:50:23 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2014-03-18 22:50:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 22:51:03 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 22:51:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:51:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:51:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:51:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:51:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:51:10 [DEBUG   ] Finished updating board flags in 1.475 seconds
2014-03-18 22:51:24 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-18 22:51:44 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 22:52:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 22:52:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:52:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:52:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:52:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:52:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:52:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 22:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:52:10 [DEBUG   ] Finished updating board flags in 1.476 seconds
2014-03-18 22:52:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 22:52:43 [DEBUG   ] Got command RPT from MCS: ref #404162
2014-03-18 22:52:43 [DEBUG   ] summary = NORMAL
2014-03-18 22:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404162  14 56734 82363546 A NORMALNORMAL'
2014-03-18 22:52:43 [DEBUG   ] Got command RPT from MCS: ref #404163
2014-03-18 22:52:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 22:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404163  48 56734 82363546 A NORMALSystem calibrated and operating normally'
2014-03-18 22:52:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 22:53:04 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 22:53:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:53:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:53:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:53:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:53:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:53:11 [DEBUG   ] Finished updating board flags in 2.237 seconds
2014-03-18 22:53:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 22:53:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 22:54:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 22:54:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:54:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:54:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:54:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:54:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:54:11 [DEBUG   ] Finished updating board flags in 2.124 seconds
2014-03-18 22:54:24 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 22:54:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 22:55:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 22:55:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:55:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:55:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:55:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:55:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:55:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-18 22:55:11 [DEBUG   ] Finished updating board flags in 2.024 seconds
2014-03-18 22:55:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 22:55:44 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-18 22:56:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 22:56:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:56:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:56:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:56:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:56:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:56:11 [DEBUG   ] Finished updating board flags in 1.992 seconds
2014-03-18 22:56:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 22:56:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 22:57:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 22:57:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:57:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:57:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:57:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:57:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:57:11 [DEBUG   ] Finished updating board flags in 1.818 seconds
2014-03-18 22:57:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 22:57:43 [DEBUG   ] Got command RPT from MCS: ref #404179
2014-03-18 22:57:43 [DEBUG   ] summary = NORMAL
2014-03-18 22:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404179  14 56734 82663549 A NORMALNORMAL'
2014-03-18 22:57:43 [DEBUG   ] Got command RPT from MCS: ref #404180
2014-03-18 22:57:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 22:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404180  48 56734 82663550 A NORMALSystem calibrated and operating normally'
2014-03-18 22:57:45 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-18 22:58:05 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 22:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:58:11 [DEBUG   ] Finished updating board flags in 1.778 seconds
2014-03-18 22:58:25 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 22:58:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 22:59:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 22:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 22:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 22:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 22:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 22:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 22:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 22:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 22:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 22:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 22:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 22:59:11 [DEBUG   ] Finished updating board flags in 1.614 seconds
2014-03-18 22:59:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 22:59:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 23:00:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 23:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:00:11 [DEBUG   ] Finished updating board flags in 1.589 seconds
2014-03-18 23:00:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 23:00:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 23:01:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 23:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:01:11 [DEBUG   ] Finished updating board flags in 1.468 seconds
2014-03-18 23:01:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 23:01:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 23:02:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 23:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:02:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 23:02:11 [DEBUG   ] Finished updating board flags in 1.415 seconds
2014-03-18 23:02:25 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 23:02:43 [DEBUG   ] Got command RPT from MCS: ref #404196
2014-03-18 23:02:43 [DEBUG   ] summary = NORMAL
2014-03-18 23:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404196  14 56734 82963546 A NORMALNORMAL'
2014-03-18 23:02:43 [DEBUG   ] Got command RPT from MCS: ref #404197
2014-03-18 23:02:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 23:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404197  48 56734 82963546 A NORMALSystem calibrated and operating normally'
2014-03-18 23:02:46 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-18 23:03:06 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-18 23:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:03:11 [DEBUG   ] Finished updating board flags in 1.415 seconds
2014-03-18 23:03:26 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-18 23:03:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 23:04:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-18 23:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:04:11 [DEBUG   ] Finished updating board flags in 1.360 seconds
2014-03-18 23:04:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 23:04:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 23:05:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 23:05:10 [DEBUG   ] Got command TBW from MCS: ref #404214
2014-03-18 23:05:10 [DEBUG   ] tbw = exited with status True, code 0x00
2014-03-18 23:05:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   404214   8 56734 83110046 A NORMAL'
2014-03-18 23:05:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:05:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:05:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:05:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:05:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:05:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2014-03-18 23:05:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2014-03-18 23:05:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2014-03-18 23:05:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2014-03-18 23:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:05:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2014-03-18 23:05:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2014-03-18 23:05:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2014-03-18 23:05:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2014-03-18 23:05:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2014-03-18 23:05:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2014-03-18 23:05:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2014-03-18 23:05:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2014-03-18 23:05:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2014-03-18 23:05:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2014-03-18 23:05:12 [DEBUG   ] Finished updating board flags in 2.180 seconds
2014-03-18 23:05:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2014-03-18 23:05:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2014-03-18 23:05:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2014-03-18 23:05:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2014-03-18 23:05:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2014-03-18 23:05:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2014-03-18 23:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2014-03-18 23:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2014-03-18 23:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2014-03-18 23:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2014-03-18 23:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2014-03-18 23:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2014-03-18 23:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2014-03-18 23:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2014-03-18 23:05:13 [DEBUG   ] spawn_process: at 2014-03-18 23:05:13 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2014-03-18 23:05:13 [INFO    ] Finished spawning TBW
2014-03-18 23:06:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:06:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:06:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:06:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:06:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:06:12 [DEBUG   ] Finished updating board flags in 1.898 seconds
2014-03-18 23:07:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:07:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:07:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:07:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:07:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:07:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 23:07:12 [DEBUG   ] Finished updating board flags in 1.821 seconds
2014-03-18 23:07:43 [DEBUG   ] Got command RPT from MCS: ref #404221
2014-03-18 23:07:43 [DEBUG   ] summary = NORMAL
2014-03-18 23:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404221  14 56734 83263549 A NORMALNORMAL'
2014-03-18 23:07:43 [DEBUG   ] Got command RPT from MCS: ref #404222
2014-03-18 23:07:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 23:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404222  48 56734 83263550 A NORMALSystem calibrated and operating normally'
2014-03-18 23:08:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:08:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:08:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:08:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:08:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:08:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-18 23:08:12 [DEBUG   ] Finished updating board flags in 1.668 seconds
2014-03-18 23:08:51 [INFO    ] __waitForTBW - TBW finished in 218.188 s
2014-03-18 23:08:52 [DEBUG   ] Finished updating ant stats in 0.502 seconds
2014-03-18 23:08:52 [INFO    ] Started antennas statistics background thread
2014-03-18 23:08:52 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '1', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '2', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '3', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '4', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '5', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '6', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '7', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '8', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '9', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '10', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '11', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '12', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '13', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '14', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '15', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '16', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '17', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '18', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '19', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '20', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '21', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '22', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '23', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '24', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '25', '1395184134']
2014-03-18 23:08:52 [DEBUG   ] spawn_process: at 2014-03-18 23:08:52 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '26', '1395184134']
2014-03-18 23:08:52 [INFO    ] Finished spawning TBN in 0.049 s
2014-03-18 23:09:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:09:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:09:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:09:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:09:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:09:12 [DEBUG   ] Finished updating ant stats in 0.513 seconds
2014-03-18 23:09:12 [DEBUG   ] Finished updating board flags in 1.875 seconds
2014-03-18 23:09:33 [DEBUG   ] Finished updating ant stats in 1.359 seconds
2014-03-18 23:09:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 23:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:10:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 23:10:12 [DEBUG   ] Finished updating board flags in 1.772 seconds
2014-03-18 23:10:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-18 23:10:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 23:10:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 23:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:11:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 23:11:12 [DEBUG   ] Finished updating board flags in 1.651 seconds
2014-03-18 23:11:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 23:11:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 23:11:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 23:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:12:12 [DEBUG   ] Finished updating board flags in 1.559 seconds
2014-03-18 23:12:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 23:12:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 23:12:43 [DEBUG   ] Got command RPT from MCS: ref #404242
2014-03-18 23:12:43 [DEBUG   ] summary = NORMAL
2014-03-18 23:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404242  14 56734 83563553 A NORMALNORMAL'
2014-03-18 23:12:43 [DEBUG   ] Got command RPT from MCS: ref #404243
2014-03-18 23:12:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 23:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404243  48 56734 83563554 A NORMALSystem calibrated and operating normally'
2014-03-18 23:12:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 23:13:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:13:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:13:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:13:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:13:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:13:12 [DEBUG   ] Finished updating board flags in 1.483 seconds
2014-03-18 23:13:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 23:13:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 23:13:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 23:14:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:14:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:14:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:14:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:14:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:14:12 [DEBUG   ] Finished updating board flags in 1.531 seconds
2014-03-18 23:14:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 23:14:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 23:14:53 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-18 23:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:15:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 23:15:13 [DEBUG   ] Finished updating ant stats in 1.052 seconds
2014-03-18 23:15:13 [DEBUG   ] Finished updating board flags in 2.308 seconds
2014-03-18 23:15:33 [DEBUG   ] Finished updating ant stats in 0.946 seconds
2014-03-18 23:15:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 23:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:16:13 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2014-03-18 23:16:13 [DEBUG   ] Finished updating board flags in 2.103 seconds
2014-03-18 23:16:33 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2014-03-18 23:16:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 23:17:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:17:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:17:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:17:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:17:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:17:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 23:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:17:13 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2014-03-18 23:17:13 [DEBUG   ] Finished updating board flags in 2.009 seconds
2014-03-18 23:17:33 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2014-03-18 23:17:43 [DEBUG   ] Got command RPT from MCS: ref #404259
2014-03-18 23:17:43 [DEBUG   ] summary = NORMAL
2014-03-18 23:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404259  14 56734 83863545 A NORMALNORMAL'
2014-03-18 23:17:43 [DEBUG   ] Got command RPT from MCS: ref #404260
2014-03-18 23:17:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 23:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404260  48 56734 83863546 A NORMALSystem calibrated and operating normally'
2014-03-18 23:17:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-18 23:18:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:18:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:18:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:18:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:18:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:18:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 23:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:18:13 [DEBUG   ] Finished updating ant stats in 0.446 seconds
2014-03-18 23:18:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 23:18:13 [DEBUG   ] Finished updating board flags in 2.038 seconds
2014-03-18 23:18:34 [DEBUG   ] Finished updating ant stats in 1.359 seconds
2014-03-18 23:18:54 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 23:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:19:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 23:19:13 [DEBUG   ] Finished updating board flags in 1.930 seconds
2014-03-18 23:19:14 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 23:19:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 23:19:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 23:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:20:13 [DEBUG   ] Finished updating board flags in 1.836 seconds
2014-03-18 23:20:14 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-03-18 23:20:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 23:20:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 23:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:21:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 23:21:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 23:21:13 [DEBUG   ] Finished updating board flags in 1.745 seconds
2014-03-18 23:21:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 23:21:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-18 23:21:55 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-18 23:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:22:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 23:22:13 [DEBUG   ] Finished updating board flags in 1.594 seconds
2014-03-18 23:22:15 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-18 23:22:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 23:22:43 [DEBUG   ] Got command RPT from MCS: ref #404276
2014-03-18 23:22:43 [DEBUG   ] summary = NORMAL
2014-03-18 23:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404276  14 56734 84163557 A NORMALNORMAL'
2014-03-18 23:22:43 [DEBUG   ] Got command RPT from MCS: ref #404277
2014-03-18 23:22:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 23:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404277  48 56734 84163558 A NORMALSystem calibrated and operating normally'
2014-03-18 23:22:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 23:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:23:13 [DEBUG   ] Finished updating board flags in 1.409 seconds
2014-03-18 23:23:15 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-18 23:23:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 23:23:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 23:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:24:13 [DEBUG   ] Finished updating board flags in 1.386 seconds
2014-03-18 23:24:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 23:24:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 23:24:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 23:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:25:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 23:25:13 [DEBUG   ] Finished updating board flags in 1.444 seconds
2014-03-18 23:25:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 23:25:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 23:25:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 23:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:26:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 23:26:15 [DEBUG   ] Finished updating board flags in 2.931 seconds
2014-03-18 23:26:35 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-18 23:26:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 23:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:27:14 [DEBUG   ] Finished updating board flags in 2.045 seconds
2014-03-18 23:27:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 23:27:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 23:27:43 [DEBUG   ] Got command RPT from MCS: ref #404293
2014-03-18 23:27:43 [DEBUG   ] summary = NORMAL
2014-03-18 23:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404293  14 56734 84463557 A NORMALNORMAL'
2014-03-18 23:27:43 [DEBUG   ] Got command RPT from MCS: ref #404294
2014-03-18 23:27:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 23:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404294  48 56734 84463558 A NORMALSystem calibrated and operating normally'
2014-03-18 23:27:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 23:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:28:14 [DEBUG   ] Finished updating board flags in 2.013 seconds
2014-03-18 23:28:16 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-18 23:28:36 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 23:28:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 23:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:29:14 [DEBUG   ] Finished updating board flags in 1.976 seconds
2014-03-18 23:29:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 23:29:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 23:29:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 23:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:30:14 [DEBUG   ] Finished updating board flags in 1.873 seconds
2014-03-18 23:30:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 23:30:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 23:30:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 23:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:31:14 [DEBUG   ] Finished updating board flags in 1.736 seconds
2014-03-18 23:31:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 23:31:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 23:31:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 23:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:32:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 23:32:14 [DEBUG   ] Finished updating board flags in 1.605 seconds
2014-03-18 23:32:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 23:32:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 23:32:43 [DEBUG   ] Got command RPT from MCS: ref #404310
2014-03-18 23:32:43 [DEBUG   ] summary = NORMAL
2014-03-18 23:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404310  14 56734 84763549 A NORMALNORMAL'
2014-03-18 23:32:43 [DEBUG   ] Got command RPT from MCS: ref #404311
2014-03-18 23:32:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 23:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404311  48 56734 84763550 A NORMALSystem calibrated and operating normally'
2014-03-18 23:32:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 23:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:33:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 23:33:14 [DEBUG   ] Finished updating board flags in 1.629 seconds
2014-03-18 23:33:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 23:33:36 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-18 23:33:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 23:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:34:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-03-18 23:34:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-18 23:34:14 [DEBUG   ] Finished updating board flags in 1.565 seconds
2014-03-18 23:34:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 23:34:37 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-18 23:34:57 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 23:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:35:14 [DEBUG   ] Finished updating board flags in 1.409 seconds
2014-03-18 23:35:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 23:35:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 23:35:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 23:36:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:36:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:36:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:36:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:36:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:36:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 23:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:36:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 23:36:14 [DEBUG   ] Finished updating board flags in 1.406 seconds
2014-03-18 23:36:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 23:36:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 23:36:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 23:37:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:37:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:37:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:37:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:37:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:37:14 [DEBUG   ] Finished updating board flags in 1.394 seconds
2014-03-18 23:37:17 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-18 23:37:37 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 23:37:43 [DEBUG   ] Got command RPT from MCS: ref #404327
2014-03-18 23:37:43 [DEBUG   ] summary = NORMAL
2014-03-18 23:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404327  14 56734 85063561 A NORMALNORMAL'
2014-03-18 23:37:43 [DEBUG   ] Got command RPT from MCS: ref #404328
2014-03-18 23:37:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 23:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404328  48 56734 85063562 A NORMALSystem calibrated and operating normally'
2014-03-18 23:37:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-18 23:38:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:38:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:38:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:38:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:38:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:38:14 [DEBUG   ] Finished updating board flags in 1.359 seconds
2014-03-18 23:38:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 23:38:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 23:38:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 23:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:39:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 23:39:15 [DEBUG   ] Finished updating board flags in 2.055 seconds
2014-03-18 23:39:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-18 23:39:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 23:39:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 23:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:40:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 23:40:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 23:40:15 [DEBUG   ] Finished updating board flags in 1.984 seconds
2014-03-18 23:40:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 23:40:38 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-18 23:40:58 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-18 23:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:41:15 [DEBUG   ] Finished updating board flags in 1.812 seconds
2014-03-18 23:41:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-18 23:41:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 23:41:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-18 23:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:42:15 [DEBUG   ] Finished updating board flags in 1.803 seconds
2014-03-18 23:42:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 23:42:38 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-18 23:42:43 [DEBUG   ] Got command RPT from MCS: ref #404344
2014-03-18 23:42:43 [DEBUG   ] summary = NORMAL
2014-03-18 23:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404344  14 56734 85363561 A NORMALNORMAL'
2014-03-18 23:42:43 [DEBUG   ] Got command RPT from MCS: ref #404345
2014-03-18 23:42:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-18 23:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404345  48 56734 85363562 A NORMALSystem calibrated and operating normally'
2014-03-18 23:42:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 23:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:43:15 [DEBUG   ] Finished updating board flags in 1.799 seconds
2014-03-18 23:43:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 23:43:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 23:43:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 23:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:44:15 [DEBUG   ] Finished updating board flags in 1.648 seconds
2014-03-18 23:44:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 23:44:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 23:44:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 23:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:45:15 [DEBUG   ] Finished updating board flags in 1.549 seconds
2014-03-18 23:45:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-18 23:45:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-18 23:45:58 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-03-18 23:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:46:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-18 23:46:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-03-18 23:46:15 [CRITICAL] MGT underflow detected on beam(s) 1
2014-03-18 23:46:15 [DEBUG   ] Finished updating board flags in 1.422 seconds
2014-03-18 23:46:18 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-18 23:46:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 23:46:59 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-18 23:47:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:47:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:47:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:47:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:47:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:47:15 [DEBUG   ] Finished updating board flags in 1.382 seconds
2014-03-18 23:47:18 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-18 23:47:39 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2014-03-18 23:47:43 [DEBUG   ] Got command RPT from MCS: ref #404361
2014-03-18 23:47:43 [DEBUG   ] summary = ERROR
2014-03-18 23:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404361  13 56734 85663553 A  ERRORERROR'
2014-03-18 23:47:43 [DEBUG   ] Got command RPT from MCS: ref #404362
2014-03-18 23:47:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 23:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404362  77 56734 85663554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 23:47:59 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-18 23:48:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:48:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:48:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:48:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:48:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:48:15 [DEBUG   ] Finished updating board flags in 1.396 seconds
2014-03-18 23:48:19 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-18 23:48:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 23:48:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 23:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:49:16 [DEBUG   ] Finished updating board flags in 2.025 seconds
2014-03-18 23:49:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 23:49:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-18 23:49:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-18 23:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:50:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 23:50:16 [DEBUG   ] Finished updating board flags in 2.008 seconds
2014-03-18 23:50:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 23:50:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 23:50:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 23:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:51:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2014-03-18 23:51:16 [DEBUG   ] Finished updating board flags in 1.993 seconds
2014-03-18 23:51:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 23:51:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-18 23:52:00 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-18 23:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:52:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-18 23:52:16 [DEBUG   ] Finished updating board flags in 1.801 seconds
2014-03-18 23:52:20 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 23:52:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-18 23:52:43 [DEBUG   ] Got command RPT from MCS: ref #404378
2014-03-18 23:52:43 [DEBUG   ] summary = ERROR
2014-03-18 23:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404378  13 56734 85963553 A  ERRORERROR'
2014-03-18 23:52:43 [DEBUG   ] Got command RPT from MCS: ref #404379
2014-03-18 23:52:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 23:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404379  77 56734 85963554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 23:53:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 23:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:53:16 [DEBUG   ] Finished updating board flags in 1.789 seconds
2014-03-18 23:53:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-18 23:53:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-18 23:54:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-18 23:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:54:16 [DEBUG   ] Finished updating board flags in 1.608 seconds
2014-03-18 23:54:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-18 23:54:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-18 23:55:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-18 23:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:55:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-18 23:55:16 [DEBUG   ] Finished updating board flags in 1.612 seconds
2014-03-18 23:55:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-18 23:55:40 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-18 23:56:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-18 23:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:56:16 [DEBUG   ] Finished updating board flags in 1.633 seconds
2014-03-18 23:56:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-18 23:56:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 23:57:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-18 23:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:57:16 [DEBUG   ] Finished updating board flags in 1.553 seconds
2014-03-18 23:57:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-18 23:57:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-18 23:57:43 [DEBUG   ] Got command RPT from MCS: ref #404395
2014-03-18 23:57:43 [DEBUG   ] summary = ERROR
2014-03-18 23:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404395  13 56734 86263557 A  ERRORERROR'
2014-03-18 23:57:43 [DEBUG   ] Got command RPT from MCS: ref #404396
2014-03-18 23:57:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-18 23:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404396  77 56734 86263558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-18 23:58:01 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-03-18 23:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:58:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 23:58:16 [DEBUG   ] Finished updating board flags in 1.414 seconds
2014-03-18 23:58:21 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-18 23:58:41 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-18 23:59:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 23:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-18 23:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-18 23:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-18 23:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-18 23:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-18 23:59:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-18 23:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-18 23:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-18 23:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-18 23:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-18 23:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-18 23:59:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-18 23:59:16 [DEBUG   ] Finished updating board flags in 1.390 seconds
2014-03-18 23:59:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-18 23:59:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 00:00:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 00:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 00:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 00:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 00:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 00:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 00:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 00:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 00:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 00:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 00:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 00:00:16 [DEBUG   ] Finished updating board flags in 1.466 seconds
2014-03-19 00:00:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 00:00:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 00:01:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 00:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 00:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 00:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 00:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 00:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 00:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 00:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 00:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 00:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 00:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 00:01:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-19 00:01:17 [DEBUG   ] Finished updating board flags in 2.223 seconds
2014-03-19 00:01:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 00:01:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 00:02:00 [DEBUG   ] Got command INI from MCS: ref #404412
2014-03-19 00:02:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2014-03-19 00:02:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   404412   8 56735   120802 ABOOTING'
2014-03-19 00:02:01 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2014-03-19 00:02:24 [INFO    ] -------------------
2014-03-19 00:02:24 [INFO    ]  LWA board status
2014-03-19 00:02:24 [INFO    ] -------------------
2014-03-19 00:02:24 [INFO    ] DP 1: 2 lwa27
2014-03-19 00:02:24 [INFO    ] DP 1: 3 lwa24
2014-03-19 00:02:24 [INFO    ] DP 1: 4 lwa23
2014-03-19 00:02:24 [INFO    ] DP 1: 5 lwa18
2014-03-19 00:02:24 [INFO    ] DP 1: 6 lwa10
2014-03-19 00:02:24 [INFO    ] DP 1: 7 lwa32
2014-03-19 00:02:24 [INFO    ] DP 1: 8 lwa11
2014-03-19 00:02:24 [INFO    ] DP 1: 9 lwa30
2014-03-19 00:02:24 [INFO    ] DP 1: 10 lwa12
2014-03-19 00:02:24 [INFO    ] DP 1: 11 lwa8
2014-03-19 00:02:24 [INFO    ] DP 1: 12 lwa13
2014-03-19 00:02:24 [INFO    ] DP 1: 13 lwa26
2014-03-19 00:02:24 [INFO    ] DP 1: 14 lwa14
2014-03-19 00:02:24 [INFO    ] DP 1: 16 lwa22
2014-03-19 00:02:24 [INFO    ] DP 1: 17 lwa20
2014-03-19 00:02:24 [INFO    ] DP 1: 18 lwa1
2014-03-19 00:02:24 [INFO    ] DP 1: 19 lwa5
2014-03-19 00:02:24 [INFO    ] DP 1: 20 lwa25
2014-03-19 00:02:24 [INFO    ] DP 1: 21 lwa35
2014-03-19 00:02:24 [INFO    ] DP 1: 22 lwa19
2014-03-19 00:02:24 [INFO    ] DP 1: 23 lwa21
2014-03-19 00:02:24 [INFO    ] DP 1: 24 lwa6
2014-03-19 00:02:24 [INFO    ] DP 1: 25 lwa7
2014-03-19 00:02:24 [INFO    ] DP 1: 26 lwa33
2014-03-19 00:02:24 [INFO    ] DP 1: 27 lwa15
2014-03-19 00:02:24 [INFO    ] DP 1: 28 lwa28
2014-03-19 00:02:24 [INFO    ] DP 2: 1 lwa16
2014-03-19 00:02:24 [INFO    ] DP 2: 15 lwa34
2014-03-19 00:02:24 [INFO    ] Total of 28 boards
2014-03-19 00:02:24 [INFO    ] Total of 260 stands
2014-03-19 00:02:24 [INFO    ] -------------------
2014-03-19 00:02:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22063
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22064
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22065
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22066
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22067
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22068
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22069
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22070
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22071
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22072
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22073
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22074
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22075
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22076
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22077
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22078
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22079
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22080
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22081
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22082
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22083
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22084
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22085
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22086
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22087
2014-03-19 00:02:31 [DEBUG   ] 2014-03-19 00:02:31 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22088
2014-03-19 00:02:43 [DEBUG   ] Got command RPT from MCS: ref #404413
2014-03-19 00:02:43 [DEBUG   ] summary = BOOTING
2014-03-19 00:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404413  15 56735   163565 ABOOTINGBOOTING'
2014-03-19 00:02:43 [DEBUG   ] Got command RPT from MCS: ref #404414
2014-03-19 00:02:43 [DEBUG   ] info = Running INI sequence
2014-03-19 00:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404414  28 56735   163566 ABOOTINGRunning INI sequence'
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22063 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22064 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22065 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22066 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22067 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22068 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22069 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22070 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22071 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22072 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22073 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22074 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22075 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22076 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22077 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22078 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22079 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22080 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22081 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22082 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22083 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22084 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22085 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22086 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22087 exited with status 0
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22088 exited with status 0
2014-03-19 00:02:44 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] spawn_process: at 2014-03-19 00:02:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 22115
2014-03-19 00:02:44 [DEBUG   ] 2014-03-19 00:02:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 22116
2014-03-19 00:02:49 [DEBUG   ] 2014-03-19 00:02:49 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 22115 exited with status 0
2014-03-19 00:02:49 [DEBUG   ] 2014-03-19 00:02:49 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 22116 exited with status 0
2014-03-19 00:02:49 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2014-03-19 00:02:49 [DEBUG   ] spawn_process: at 2014-03-19 00:02:49 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2014-03-19 00:02:49 [DEBUG   ] spawn_process: at 2014-03-19 00:02:49 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2014-03-19 00:02:49 [INFO    ] Setting Beam 1 xbars
2014-03-19 00:02:49 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2014-03-19 00:02:49 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2014-03-19 00:02:49 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2014-03-19 00:02:50 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2014-03-19 00:02:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2014-03-19 00:02:50 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2014-03-19 00:02:50 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2014-03-19 00:02:50 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2014-03-19 00:02:50 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2014-03-19 00:02:50 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2014-03-19 00:02:50 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2014-03-19 00:02:50 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2014-03-19 00:02:51 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2014-03-19 00:02:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2014-03-19 00:02:51 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2014-03-19 00:02:51 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2014-03-19 00:02:51 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2014-03-19 00:02:51 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2014-03-19 00:02:51 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2014-03-19 00:02:51 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2014-03-19 00:02:51 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2014-03-19 00:02:51 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2014-03-19 00:02:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2014-03-19 00:02:52 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2014-03-19 00:02:52 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2014-03-19 00:02:52 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2014-03-19 00:02:52 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2014-03-19 00:02:52 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2014-03-19 00:02:52 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2014-03-19 00:02:52 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2014-03-19 00:02:52 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2014-03-19 00:02:53 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2014-03-19 00:02:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2014-03-19 00:02:53 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2014-03-19 00:02:53 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2014-03-19 00:02:53 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2014-03-19 00:02:53 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2014-03-19 00:02:53 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2014-03-19 00:02:53 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2014-03-19 00:02:53 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2014-03-19 00:02:54 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2014-03-19 00:02:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2014-03-19 00:02:54 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2014-03-19 00:02:54 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2014-03-19 00:02:54 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2014-03-19 00:02:54 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2014-03-19 00:02:54 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2014-03-19 00:02:54 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2014-03-19 00:02:54 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2014-03-19 00:02:55 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2014-03-19 00:02:55 [INFO    ] Setting Beam 2 xbars
2014-03-19 00:02:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2014-03-19 00:02:55 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2014-03-19 00:02:55 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2014-03-19 00:02:55 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2014-03-19 00:02:55 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2014-03-19 00:02:55 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2014-03-19 00:02:55 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2014-03-19 00:02:55 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2014-03-19 00:02:56 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2014-03-19 00:02:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2014-03-19 00:02:56 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2014-03-19 00:02:56 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2014-03-19 00:02:56 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2014-03-19 00:02:56 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2014-03-19 00:02:56 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2014-03-19 00:02:56 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2014-03-19 00:02:56 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2014-03-19 00:02:56 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2014-03-19 00:02:57 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2014-03-19 00:02:57 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2014-03-19 00:02:57 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2014-03-19 00:02:57 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2014-03-19 00:02:57 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2014-03-19 00:02:57 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2014-03-19 00:02:57 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2014-03-19 00:02:57 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2014-03-19 00:02:57 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2014-03-19 00:02:58 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2014-03-19 00:02:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2014-03-19 00:02:58 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2014-03-19 00:02:58 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2014-03-19 00:02:58 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2014-03-19 00:02:58 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2014-03-19 00:02:58 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2014-03-19 00:02:58 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2014-03-19 00:02:58 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2014-03-19 00:02:59 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2014-03-19 00:02:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2014-03-19 00:02:59 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2014-03-19 00:02:59 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2014-03-19 00:02:59 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2014-03-19 00:02:59 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2014-03-19 00:02:59 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2014-03-19 00:02:59 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2014-03-19 00:02:59 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2014-03-19 00:02:59 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2014-03-19 00:03:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2014-03-19 00:03:00 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2014-03-19 00:03:00 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2014-03-19 00:03:00 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2014-03-19 00:03:00 [INFO    ] Setting Beam 3 xbars
2014-03-19 00:03:00 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2014-03-19 00:03:00 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2014-03-19 00:03:00 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2014-03-19 00:03:00 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2014-03-19 00:03:00 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2014-03-19 00:03:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2014-03-19 00:03:01 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2014-03-19 00:03:01 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2014-03-19 00:03:01 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2014-03-19 00:03:01 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2014-03-19 00:03:01 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2014-03-19 00:03:01 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2014-03-19 00:03:01 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2014-03-19 00:03:01 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2014-03-19 00:03:02 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2014-03-19 00:03:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2014-03-19 00:03:02 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2014-03-19 00:03:02 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2014-03-19 00:03:02 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2014-03-19 00:03:02 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2014-03-19 00:03:02 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2014-03-19 00:03:02 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2014-03-19 00:03:02 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2014-03-19 00:03:03 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2014-03-19 00:03:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2014-03-19 00:03:03 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2014-03-19 00:03:03 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2014-03-19 00:03:03 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2014-03-19 00:03:03 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2014-03-19 00:03:03 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2014-03-19 00:03:03 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2014-03-19 00:03:03 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2014-03-19 00:03:03 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2014-03-19 00:03:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2014-03-19 00:03:04 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2014-03-19 00:03:04 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2014-03-19 00:03:04 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2014-03-19 00:03:04 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2014-03-19 00:03:04 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2014-03-19 00:03:04 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2014-03-19 00:03:04 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2014-03-19 00:03:04 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2014-03-19 00:03:05 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2014-03-19 00:03:05 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2014-03-19 00:03:05 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2014-03-19 00:03:05 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2014-03-19 00:03:05 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2014-03-19 00:03:05 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2014-03-19 00:03:05 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2014-03-19 00:03:05 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2014-03-19 00:03:05 [INFO    ] Setting Beam 4 xbars
2014-03-19 00:03:05 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2014-03-19 00:03:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2014-03-19 00:03:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2014-03-19 00:03:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2014-03-19 00:03:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2014-03-19 00:03:06 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2014-03-19 00:03:06 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2014-03-19 00:03:06 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2014-03-19 00:03:06 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2014-03-19 00:03:06 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2014-03-19 00:03:07 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2014-03-19 00:03:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2014-03-19 00:03:07 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2014-03-19 00:03:07 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2014-03-19 00:03:07 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2014-03-19 00:03:07 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2014-03-19 00:03:07 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2014-03-19 00:03:07 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2014-03-19 00:03:07 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2014-03-19 00:03:07 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2014-03-19 00:03:08 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2014-03-19 00:03:08 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2014-03-19 00:03:08 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2014-03-19 00:03:08 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2014-03-19 00:03:08 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2014-03-19 00:03:08 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2014-03-19 00:03:08 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2014-03-19 00:03:08 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2014-03-19 00:03:08 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2014-03-19 00:03:09 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2014-03-19 00:03:09 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2014-03-19 00:03:09 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2014-03-19 00:03:09 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2014-03-19 00:03:09 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2014-03-19 00:03:09 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2014-03-19 00:03:09 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2014-03-19 00:03:09 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2014-03-19 00:03:09 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2014-03-19 00:03:10 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2014-03-19 00:03:10 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2014-03-19 00:03:10 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2014-03-19 00:03:10 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2014-03-19 00:03:10 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2014-03-19 00:03:10 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2014-03-19 00:03:10 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2014-03-19 00:03:10 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2014-03-19 00:03:10 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2014-03-19 00:03:11 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2014-03-19 00:03:11 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2014-03-19 00:03:11 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2014-03-19 00:03:11 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2014-03-19 00:03:11 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2014-03-19 00:03:11 [INFO    ] All xbars set
2014-03-19 00:03:11 [INFO    ] Setting adder chain routing for all beams
2014-03-19 00:03:16 [INFO    ] Setting beam ids
2014-03-19 00:03:26 [INFO    ] Starting beam delay calibration
2014-03-19 00:03:38 [INFO    ] Beam 1 latency is 5719
2014-03-19 00:03:38 [INFO    ] Beam 2 latency is 5741
2014-03-19 00:03:38 [INFO    ] Beam 3 latency is 5735
2014-03-19 00:03:38 [INFO    ] Beam 4 latency is 5708
2014-03-19 00:03:38 [INFO    ] Stop calibration
2014-03-19 00:03:46 [INFO    ] Beam delay calibration successful
2014-03-19 00:03:46 [INFO    ] Calibration passed
2014-03-19 00:03:46 [DEBUG   ] spawn_process: at 2014-03-19 00:03:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2014-03-19 00:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2014-03-19 00:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2014-03-19 00:03:46 [DEBUG   ] spawn_process: at 2014-03-19 00:03:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2014-03-19 00:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2014-03-19 00:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2014-03-19 00:03:46 [DEBUG   ] spawn_process: at 2014-03-19 00:03:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2014-03-19 00:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2014-03-19 00:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2014-03-19 00:03:46 [DEBUG   ] spawn_process: at 2014-03-19 00:03:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2014-03-19 00:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2014-03-19 00:03:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2014-03-19 00:03:46 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2014-03-19 00:03:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 285 ms (1395187427.287 s) with PID 23692 and time 1395187428
2014-03-19 00:03:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2014-03-19 00:03:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 374 ms (1395187427.376 s) with PID 23695 and time 1395187428
2014-03-19 00:03:48 [DEBUG   ] Finished updating ant stats in 0.872 seconds
2014-03-19 00:03:48 [INFO    ] Started antennas statistics background thread
2014-03-19 00:03:48 [INFO    ] Started board flags background thread
2014-03-19 00:03:48 [INFO    ] Started BAM background thread
2014-03-19 00:03:48 [INFO    ] Finished the INI process (ref. #404412) in 107.696 s
2014-03-19 00:03:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 00:03:49 [DEBUG   ] Finished updating board flags in 1.049 seconds
2014-03-19 00:04:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 00:04:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 00:04:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 00:04:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:04:49 [DEBUG   ] Finished updating board flags in 1.013 seconds
2014-03-19 00:05:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 00:05:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 00:05:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 00:05:49 [DEBUG   ] Finished updating board flags in 1.069 seconds
2014-03-19 00:06:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 00:06:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 00:06:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 00:06:50 [DEBUG   ] Finished updating board flags in 1.995 seconds
2014-03-19 00:07:00 [DEBUG   ] Got command RPT from MCS: ref #404430
2014-03-19 00:07:00 [DEBUG   ] summary = NORMAL
2014-03-19 00:07:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404430  14 56735   420797 A NORMALNORMAL'
2014-03-19 00:07:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 00:07:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 00:07:43 [DEBUG   ] Got command RPT from MCS: ref #404431
2014-03-19 00:07:43 [DEBUG   ] summary = NORMAL
2014-03-19 00:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404431  14 56735   463557 A NORMALNORMAL'
2014-03-19 00:07:43 [DEBUG   ] Got command RPT from MCS: ref #404432
2014-03-19 00:07:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-19 00:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404432  48 56735   463558 A NORMALSystem calibrated and operating normally'
2014-03-19 00:07:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 00:07:50 [DEBUG   ] Finished updating board flags in 1.722 seconds
2014-03-19 00:08:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 00:08:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 00:08:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 00:08:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 00:08:49 [DEBUG   ] Finished updating board flags in 1.089 seconds
2014-03-19 00:09:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 00:09:28 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-19 00:09:48 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-19 00:09:49 [DEBUG   ] Finished updating board flags in 0.976 seconds
2014-03-19 00:10:08 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-19 00:10:28 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-19 00:10:48 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-19 00:10:50 [DEBUG   ] Finished updating board flags in 1.358 seconds
2014-03-19 00:11:08 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2014-03-19 00:11:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 00:11:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 00:11:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 00:11:50 [DEBUG   ] Finished updating board flags in 1.182 seconds
2014-03-19 00:12:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 00:12:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 00:12:43 [DEBUG   ] Got command RPT from MCS: ref #404448
2014-03-19 00:12:43 [DEBUG   ] summary = NORMAL
2014-03-19 00:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404448  14 56735   763562 A NORMALNORMAL'
2014-03-19 00:12:43 [DEBUG   ] Got command RPT from MCS: ref #404449
2014-03-19 00:12:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-19 00:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404449  48 56735   763562 A NORMALSystem calibrated and operating normally'
2014-03-19 00:12:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 00:12:50 [DEBUG   ] Finished updating board flags in 1.013 seconds
2014-03-19 00:13:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 00:13:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 00:13:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 00:13:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 00:13:50 [DEBUG   ] Finished updating board flags in 1.038 seconds
2014-03-19 00:14:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 00:14:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 00:14:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 00:14:50 [DEBUG   ] Finished updating board flags in 1.470 seconds
2014-03-19 00:14:58 [DEBUG   ] Got command DRX from MCS: ref #404469
2014-03-19 00:14:58 [INFO    ] sending drx command to lwa16
2014-03-19 00:14:58 [DEBUG   ] run_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 45450000.0 7 9 0']
2014-03-19 00:14:58 [DEBUG   ] drx = exited with status True, code 0x00
2014-03-19 00:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   404469   8 56735   898010 A NORMAL'
2014-03-19 00:14:58 [DEBUG   ] Got command DRX from MCS: ref #404470
2014-03-19 00:14:58 [INFO    ] sending drx command to lwa16
2014-03-19 00:14:58 [DEBUG   ] run_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 45450000.0 7 9 0']
2014-03-19 00:14:58 [DEBUG   ] drx = exited with status True, code 0x00
2014-03-19 00:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   404470   8 56735   898018 A NORMAL'
2014-03-19 00:14:58 [DEBUG   ] Got command DRX from MCS: ref #404468
2014-03-19 00:14:58 [INFO    ] sending drx command to lwa34
2014-03-19 00:14:58 [DEBUG   ] run_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 45450000.0 7 9 0']
2014-03-19 00:14:58 [DEBUG   ] drx = exited with status True, code 0x00
2014-03-19 00:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   404468   8 56735   898026 A NORMAL'
2014-03-19 00:14:58 [DEBUG   ] Got command DRX from MCS: ref #404471
2014-03-19 00:14:58 [INFO    ] sending drx command to lwa34
2014-03-19 00:14:58 [DEBUG   ] run_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 65050000.0 7 9 0']
2014-03-19 00:14:58 [DEBUG   ] drx = exited with status True, code 0x00
2014-03-19 00:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   404471   8 56735   898034 A NORMAL'
2014-03-19 00:14:58 [DEBUG   ] Got command DRX from MCS: ref #404472
2014-03-19 00:14:58 [INFO    ] sending drx command to lwa16
2014-03-19 00:14:58 [DEBUG   ] run_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 65050000.0 7 9 0']
2014-03-19 00:14:58 [DEBUG   ] drx = exited with status True, code 0x00
2014-03-19 00:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   404472   8 56735   898042 A NORMAL'
2014-03-19 00:14:58 [DEBUG   ] Got command DRX from MCS: ref #404473
2014-03-19 00:14:58 [INFO    ] sending drx command to lwa16
2014-03-19 00:14:58 [DEBUG   ] run_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 65050000.0 7 9 0']
2014-03-19 00:14:58 [DEBUG   ] drx = exited with status True, code 0x00
2014-03-19 00:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   404473   8 56735   898050 A NORMAL'
2014-03-19 00:14:58 [INFO    ] Finished starting DRX
2014-03-19 00:14:58 [INFO    ] Finished starting DRX
2014-03-19 00:14:58 [INFO    ] Finished starting DRX
2014-03-19 00:14:58 [INFO    ] Finished starting DRX
2014-03-19 00:14:58 [INFO    ] Finished starting DRX
2014-03-19 00:14:58 [INFO    ] Finished starting DRX
2014-03-19 00:14:58 [DEBUG   ] Got command BAM from MCS: ref #404474
2014-03-19 00:14:58 [INFO    ] Finished processing BAM request
2014-03-19 00:14:58 [DEBUG   ] bam = exited with status True, code 0x00
2014-03-19 00:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   404474   8 56735   898173 A NORMAL'
2014-03-19 00:14:58 [DEBUG   ] Got command BAM from MCS: ref #404475
2014-03-19 00:14:58 [INFO    ] Finished processing BAM request
2014-03-19 00:14:58 [DEBUG   ] bam = exited with status True, code 0x00
2014-03-19 00:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   404475   8 56735   898273 A NORMAL'
2014-03-19 00:14:58 [DEBUG   ] Got command BAM from MCS: ref #404476
2014-03-19 00:14:58 [INFO    ] Finished processing BAM request
2014-03-19 00:14:58 [DEBUG   ] bam = exited with status True, code 0x00
2014-03-19 00:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   404476   8 56735   898361 A NORMAL'
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2014-03-19 00:14:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2014-03-19 00:14:58 [DEBUG   ] spawn_process: at 2014-03-19 00:14:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2014-03-19 00:15:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 00:15:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 00:15:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 00:15:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 00:15:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 00:15:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2014-03-19 00:15:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2014-03-19 00:15:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:15:50 [DEBUG   ] Finished updating board flags in 1.336 seconds
2014-03-19 00:16:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 00:16:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 00:16:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 00:16:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 00:16:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 00:16:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 00:16:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 00:16:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 00:16:51 [DEBUG   ] Finished updating board flags in 1.798 seconds
2014-03-19 00:17:00 [DEBUG   ] Got command TBN from MCS: ref #404480
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '1', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '2', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] tbn = exited with status True, code 0x00
2014-03-19 00:17:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   404480   8 56735  1020818 A NORMAL'
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '3', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '4', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '5', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '6', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '7', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '8', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '9', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '10', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '11', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '12', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '13', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '14', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '15', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '16', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '17', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '18', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '19', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '20', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '21', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '22', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '23', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '24', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '25', '1395188222']
2014-03-19 00:17:00 [DEBUG   ] spawn_process: at 2014-03-19 00:17:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '26', '1395188222']
2014-03-19 00:17:00 [INFO    ] Finished spawning TBN in 0.050 s
2014-03-19 00:17:09 [DEBUG   ] Finished updating ant stats in 1.072 seconds
2014-03-19 00:17:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 00:17:43 [DEBUG   ] Got command RPT from MCS: ref #404481
2014-03-19 00:17:43 [DEBUG   ] summary = NORMAL
2014-03-19 00:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404481  14 56735  1063561 A NORMALNORMAL'
2014-03-19 00:17:43 [DEBUG   ] Got command RPT from MCS: ref #404482
2014-03-19 00:17:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-19 00:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404482  48 56735  1063562 A NORMALSystem calibrated and operating normally'
2014-03-19 00:17:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 00:17:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 00:17:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:17:51 [DEBUG   ] Finished updating board flags in 1.832 seconds
2014-03-19 00:18:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 00:18:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 00:18:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 00:18:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 00:18:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 00:18:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:18:51 [DEBUG   ] Finished updating board flags in 1.836 seconds
2014-03-19 00:19:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 00:19:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 00:19:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 00:19:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 00:19:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:19:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-03-19 00:19:51 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:19:51 [CRITICAL] MGT underflow detected on beam(s) 1
2014-03-19 00:19:51 [DEBUG   ] Finished updating board flags in 1.722 seconds
2014-03-19 00:20:09 [DEBUG   ] Finished updating ant stats in 0.591 seconds
2014-03-19 00:20:30 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-03-19 00:20:50 [DEBUG   ] Finished updating ant stats in 1.258 seconds
2014-03-19 00:20:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:20:51 [DEBUG   ] Finished updating board flags in 1.602 seconds
2014-03-19 00:21:10 [DEBUG   ] Finished updating ant stats in 1.150 seconds
2014-03-19 00:21:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 00:21:50 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2014-03-19 00:21:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 00:21:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:21:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:21:51 [DEBUG   ] Finished updating board flags in 1.611 seconds
2014-03-19 00:22:10 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2014-03-19 00:22:30 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 00:22:43 [DEBUG   ] Got command RPT from MCS: ref #404498
2014-03-19 00:22:43 [DEBUG   ] summary = ERROR
2014-03-19 00:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404498  13 56735  1363569 A  ERRORERROR'
2014-03-19 00:22:43 [DEBUG   ] Got command RPT from MCS: ref #404499
2014-03-19 00:22:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 00:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404499  77 56735  1363570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 00:22:50 [DEBUG   ] Finished updating ant stats in 0.450 seconds
2014-03-19 00:22:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 00:22:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:22:51 [DEBUG   ] Finished updating board flags in 1.585 seconds
2014-03-19 00:23:11 [DEBUG   ] Finished updating ant stats in 1.355 seconds
2014-03-19 00:23:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 00:23:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 00:23:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 00:23:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 00:23:51 [DEBUG   ] Finished updating ant stats in 1.246 seconds
2014-03-19 00:23:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:23:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:23:51 [DEBUG   ] Finished updating board flags in 1.478 seconds
2014-03-19 00:24:11 [DEBUG   ] Finished updating ant stats in 1.160 seconds
2014-03-19 00:24:31 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2014-03-19 00:24:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 00:24:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 00:24:51 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2014-03-19 00:24:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:24:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:24:51 [DEBUG   ] Finished updating board flags in 1.456 seconds
2014-03-19 00:25:11 [DEBUG   ] Finished updating ant stats in 0.761 seconds
2014-03-19 00:25:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 00:25:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 00:25:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 00:25:51 [DEBUG   ] Finished updating ant stats in 0.639 seconds
2014-03-19 00:25:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:25:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 00:25:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:25:51 [DEBUG   ] Finished updating board flags in 1.436 seconds
2014-03-19 00:26:11 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2014-03-19 00:26:32 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2014-03-19 00:26:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2014-03-19 00:26:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 00:26:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:26:51 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:26:51 [DEBUG   ] Finished updating board flags in 1.444 seconds
2014-03-19 00:26:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 00:27:12 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 00:27:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 00:27:43 [DEBUG   ] Got command RPT from MCS: ref #404515
2014-03-19 00:27:43 [DEBUG   ] summary = ERROR
2014-03-19 00:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404515  13 56735  1663565 A  ERRORERROR'
2014-03-19 00:27:43 [DEBUG   ] Got command RPT from MCS: ref #404516
2014-03-19 00:27:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 00:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404516  77 56735  1663566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 00:27:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 00:27:51 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:27:51 [DEBUG   ] Finished updating board flags in 1.425 seconds
2014-03-19 00:27:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 00:28:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 00:28:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 00:28:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 00:28:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 00:28:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 00:28:52 [DEBUG   ] Finished updating ant stats in 0.849 seconds
2014-03-19 00:28:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:28:52 [DEBUG   ] Finished updating board flags in 2.254 seconds
2014-03-19 00:29:12 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2014-03-19 00:29:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 00:29:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-03-19 00:29:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 00:29:52 [DEBUG   ] Finished updating ant stats in 0.446 seconds
2014-03-19 00:29:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:29:52 [DEBUG   ] Finished updating board flags in 2.213 seconds
2014-03-19 00:30:13 [DEBUG   ] Finished updating ant stats in 1.361 seconds
2014-03-19 00:30:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 00:30:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 00:30:52 [DEBUG   ] Finished updating board flags in 2.156 seconds
2014-03-19 00:30:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 00:31:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 00:31:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 00:31:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 00:31:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 00:31:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 00:31:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:31:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-03-19 00:31:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:31:52 [DEBUG   ] Finished updating board flags in 2.022 seconds
2014-03-19 00:31:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 00:32:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 00:32:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 00:32:43 [DEBUG   ] Got command RPT from MCS: ref #404532
2014-03-19 00:32:43 [DEBUG   ] summary = ERROR
2014-03-19 00:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404532  13 56735  1963573 A  ERRORERROR'
2014-03-19 00:32:43 [DEBUG   ] Got command RPT from MCS: ref #404533
2014-03-19 00:32:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 00:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404533  77 56735  1963574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 00:32:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 00:32:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:32:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 00:32:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:32:52 [DEBUG   ] Finished updating board flags in 1.966 seconds
2014-03-19 00:32:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 00:33:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 00:33:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 00:33:52 [DEBUG   ] Finished updating board flags in 1.800 seconds
2014-03-19 00:33:53 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-19 00:34:13 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-03-19 00:34:34 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-03-19 00:34:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-03-19 00:34:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 00:34:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:34:52 [DEBUG   ] Finished updating board flags in 1.790 seconds
2014-03-19 00:34:54 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-03-19 00:35:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 00:35:34 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2014-03-19 00:35:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 00:35:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 00:35:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 00:35:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:35:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-03-19 00:35:52 [CRITICAL] MGT underflow detected on beam(s) 1
2014-03-19 00:35:52 [DEBUG   ] Finished updating board flags in 1.620 seconds
2014-03-19 00:35:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 00:36:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 00:36:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 00:36:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 00:36:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:36:52 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:36:52 [DEBUG   ] Finished updating board flags in 1.573 seconds
2014-03-19 00:36:54 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2014-03-19 00:37:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 00:37:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 00:37:43 [DEBUG   ] Got command RPT from MCS: ref #404549
2014-03-19 00:37:43 [DEBUG   ] summary = ERROR
2014-03-19 00:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404549  13 56735  2263577 A  ERRORERROR'
2014-03-19 00:37:43 [DEBUG   ] Got command RPT from MCS: ref #404550
2014-03-19 00:37:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 00:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404550  77 56735  2263578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 00:37:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 00:37:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 00:37:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:37:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 00:37:52 [DEBUG   ] Finished updating board flags in 1.421 seconds
2014-03-19 00:37:54 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 00:38:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 00:38:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 00:38:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 00:38:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 00:38:52 [DEBUG   ] Finished updating board flags in 1.386 seconds
2014-03-19 00:38:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 00:39:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 00:39:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 00:39:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 00:39:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 00:39:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:39:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-03-19 00:39:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:39:52 [CRITICAL] MGT underflow detected on beam(s) 1
2014-03-19 00:39:52 [DEBUG   ] Finished updating board flags in 1.384 seconds
2014-03-19 00:39:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-19 00:40:15 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-03-19 00:40:35 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 00:40:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 00:40:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 00:40:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 00:40:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:40:53 [DEBUG   ] Finished updating board flags in 2.029 seconds
2014-03-19 00:40:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 00:41:15 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-19 00:41:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 00:41:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 00:41:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 00:41:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 00:41:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 00:41:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 00:41:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 00:41:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:41:53 [DEBUG   ] Finished updating board flags in 2.005 seconds
2014-03-19 00:41:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 00:42:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 00:42:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 00:42:43 [DEBUG   ] Got command RPT from MCS: ref #404566
2014-03-19 00:42:43 [DEBUG   ] summary = ERROR
2014-03-19 00:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404566  13 56735  2563573 A  ERRORERROR'
2014-03-19 00:42:43 [DEBUG   ] Got command RPT from MCS: ref #404567
2014-03-19 00:42:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 00:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404567  77 56735  2563574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 00:42:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 00:42:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 00:42:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 00:42:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 00:42:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 00:42:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:42:53 [DEBUG   ] Finished updating board flags in 1.994 seconds
2014-03-19 00:42:55 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2014-03-19 00:43:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 00:43:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 00:43:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 00:43:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 00:43:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 00:43:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:43:53 [DEBUG   ] Finished updating board flags in 1.809 seconds
2014-03-19 00:43:56 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-19 00:44:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 00:44:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 00:44:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 00:44:53 [DEBUG   ] Finished updating board flags in 1.786 seconds
2014-03-19 00:44:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 00:45:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 00:45:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 00:45:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 00:45:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 00:45:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:45:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:45:53 [DEBUG   ] Finished updating board flags in 1.618 seconds
2014-03-19 00:45:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 00:46:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 00:46:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 00:46:53 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:46:53 [DEBUG   ] Finished updating board flags in 1.599 seconds
2014-03-19 00:46:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 00:47:16 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2014-03-19 00:47:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 00:47:43 [DEBUG   ] Got command RPT from MCS: ref #404583
2014-03-19 00:47:43 [DEBUG   ] summary = ERROR
2014-03-19 00:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404583  13 56735  2863577 A  ERRORERROR'
2014-03-19 00:47:43 [DEBUG   ] Got command RPT from MCS: ref #404584
2014-03-19 00:47:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 00:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404584  77 56735  2863578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 00:47:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:47:53 [DEBUG   ] Finished updating board flags in 1.421 seconds
2014-03-19 00:47:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 00:48:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 00:48:36 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-03-19 00:48:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 00:48:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:48:53 [DEBUG   ] Finished updating board flags in 1.370 seconds
2014-03-19 00:48:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 00:49:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 00:49:37 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-03-19 00:49:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 00:49:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 00:49:53 [DEBUG   ] Finished updating board flags in 1.356 seconds
2014-03-19 00:49:57 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-03-19 00:50:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 00:50:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 00:50:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 00:50:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 00:50:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 00:50:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 00:50:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:50:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 00:50:54 [DEBUG   ] Finished updating board flags in 2.067 seconds
2014-03-19 00:50:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 00:51:17 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-19 00:51:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 00:51:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 00:51:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:51:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 00:51:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:51:54 [DEBUG   ] Finished updating board flags in 2.043 seconds
2014-03-19 00:51:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 00:52:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 00:52:37 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-19 00:52:43 [DEBUG   ] Got command RPT from MCS: ref #404600
2014-03-19 00:52:43 [DEBUG   ] summary = ERROR
2014-03-19 00:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404600  13 56735  3163577 A  ERRORERROR'
2014-03-19 00:52:43 [DEBUG   ] Got command RPT from MCS: ref #404601
2014-03-19 00:52:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 00:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404601  77 56735  3163578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 00:52:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 00:52:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 00:52:54 [DEBUG   ] Finished updating board flags in 1.950 seconds
2014-03-19 00:52:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 00:53:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 00:53:37 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-03-19 00:53:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 00:53:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 00:53:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 00:53:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:53:54 [DEBUG   ] Finished updating board flags in 1.804 seconds
2014-03-19 00:53:57 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-19 00:54:17 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-03-19 00:54:38 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-19 00:54:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 00:54:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:54:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:54:54 [DEBUG   ] Finished updating board flags in 1.799 seconds
2014-03-19 00:54:58 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 00:55:18 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 00:55:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 00:55:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 00:55:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 00:55:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 00:55:54 [DEBUG   ] Finished updating board flags in 1.619 seconds
2014-03-19 00:55:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 00:56:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 00:56:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 00:56:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 00:56:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 00:56:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 00:56:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:56:54 [DEBUG   ] Finished updating board flags in 1.627 seconds
2014-03-19 00:56:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 00:57:18 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-19 00:57:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 00:57:43 [DEBUG   ] Got command RPT from MCS: ref #404617
2014-03-19 00:57:43 [DEBUG   ] summary = ERROR
2014-03-19 00:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404617  13 56735  3463573 A  ERRORERROR'
2014-03-19 00:57:43 [DEBUG   ] Got command RPT from MCS: ref #404618
2014-03-19 00:57:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 00:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404618  77 56735  3463574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 00:57:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 00:57:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 00:57:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 00:57:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 00:57:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 00:57:54 [DEBUG   ] Finished updating board flags in 1.614 seconds
2014-03-19 00:57:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 00:58:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 00:58:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 00:58:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 00:58:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 00:58:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:58:54 [DEBUG   ] Finished updating board flags in 1.546 seconds
2014-03-19 00:58:58 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-19 00:59:18 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-03-19 00:59:39 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-19 00:59:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 00:59:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 00:59:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 00:59:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 00:59:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 00:59:54 [DEBUG   ] Finished updating board flags in 1.410 seconds
2014-03-19 00:59:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 01:00:19 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 01:00:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 01:00:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 01:00:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:00:54 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:00:54 [DEBUG   ] Finished updating board flags in 1.413 seconds
2014-03-19 01:00:59 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-19 01:01:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 01:01:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 01:01:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 01:01:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 01:01:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:01:54 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:01:54 [DEBUG   ] Finished updating board flags in 1.384 seconds
2014-03-19 01:01:59 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2014-03-19 01:02:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 01:02:39 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2014-03-19 01:02:43 [DEBUG   ] Got command RPT from MCS: ref #404634
2014-03-19 01:02:43 [DEBUG   ] summary = ERROR
2014-03-19 01:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404634  13 56735  3763581 A  ERRORERROR'
2014-03-19 01:02:43 [DEBUG   ] Got command RPT from MCS: ref #404635
2014-03-19 01:02:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 01:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404635  77 56735  3763582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 01:02:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 01:02:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 01:02:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 01:02:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:02:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 01:02:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:02:54 [DEBUG   ] Finished updating board flags in 1.407 seconds
2014-03-19 01:02:59 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2014-03-19 01:03:19 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-03-19 01:03:40 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-03-19 01:03:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 01:03:54 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 01:03:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 01:03:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:03:54 [DEBUG   ] Finished updating board flags in 1.330 seconds
2014-03-19 01:04:00 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-19 01:04:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 01:04:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 01:04:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 01:04:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 01:04:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 01:04:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 01:04:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 01:04:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:04:55 [DEBUG   ] Finished updating board flags in 2.077 seconds
2014-03-19 01:05:00 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2014-03-19 01:05:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 01:05:40 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-19 01:05:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 01:05:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 01:05:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:05:55 [DEBUG   ] Finished updating board flags in 1.996 seconds
2014-03-19 01:06:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 01:06:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 01:06:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 01:06:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 01:06:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 01:06:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:06:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:06:55 [DEBUG   ] Finished updating board flags in 1.816 seconds
2014-03-19 01:07:01 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-03-19 01:07:20 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-03-19 01:07:40 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-03-19 01:07:43 [DEBUG   ] Got command RPT from MCS: ref #404651
2014-03-19 01:07:43 [DEBUG   ] summary = ERROR
2014-03-19 01:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404651  13 56735  4063577 A  ERRORERROR'
2014-03-19 01:07:43 [DEBUG   ] Got command RPT from MCS: ref #404652
2014-03-19 01:07:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 01:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404652  77 56735  4063578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 01:07:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 01:07:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 01:07:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 01:07:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2014-03-19 01:07:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 01:07:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:07:55 [DEBUG   ] Finished updating board flags in 1.786 seconds
2014-03-19 01:08:01 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2014-03-19 01:08:21 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 01:08:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 01:08:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 01:08:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 01:08:55 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:08:55 [DEBUG   ] Finished updating board flags in 1.618 seconds
2014-03-19 01:09:01 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 01:09:21 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 01:09:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 01:09:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 01:09:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 01:09:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2014-03-19 01:09:55 [DEBUG   ] Finished updating board flags in 1.583 seconds
2014-03-19 01:10:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 01:10:21 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2014-03-19 01:10:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 01:10:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 01:10:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 01:10:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 01:10:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:10:55 [DEBUG   ] Finished updating board flags in 1.417 seconds
2014-03-19 01:11:01 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 01:11:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 01:11:41 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 01:11:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 01:11:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:11:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 01:11:55 [DEBUG   ] Finished updating board flags in 1.396 seconds
2014-03-19 01:12:01 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2014-03-19 01:12:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 01:12:41 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 01:12:43 [DEBUG   ] Got command RPT from MCS: ref #404668
2014-03-19 01:12:43 [DEBUG   ] summary = ERROR
2014-03-19 01:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404668  13 56735  4363577 A  ERRORERROR'
2014-03-19 01:12:43 [DEBUG   ] Got command RPT from MCS: ref #404669
2014-03-19 01:12:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 01:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404669  77 56735  4363578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 01:12:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 01:12:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 01:12:55 [DEBUG   ] Finished updating board flags in 1.364 seconds
2014-03-19 01:13:01 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 01:13:21 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-19 01:13:42 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-03-19 01:13:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 01:13:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 01:13:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:13:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:13:56 [DEBUG   ] Finished updating board flags in 2.048 seconds
2014-03-19 01:14:02 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 01:14:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 01:14:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 01:14:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2014-03-19 01:14:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-03-19 01:14:56 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 01:14:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:14:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:14:56 [DEBUG   ] Finished updating board flags in 1.983 seconds
2014-03-19 01:15:02 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 01:15:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 01:15:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 01:15:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 01:15:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2014-03-19 01:15:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 01:15:56 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:15:56 [DEBUG   ] Finished updating board flags in 1.808 seconds
2014-03-19 01:16:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 01:16:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 01:16:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 01:16:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2014-03-19 01:16:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 01:16:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 01:16:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:16:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:16:56 [DEBUG   ] Finished updating board flags in 1.815 seconds
2014-03-19 01:17:03 [DEBUG   ] Finished updating ant stats in 1.798 seconds
2014-03-19 01:17:22 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2014-03-19 01:17:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 01:17:43 [DEBUG   ] Got command RPT from MCS: ref #404685
2014-03-19 01:17:43 [DEBUG   ] summary = ERROR
2014-03-19 01:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404685  13 56735  4663577 A  ERRORERROR'
2014-03-19 01:17:43 [DEBUG   ] Got command RPT from MCS: ref #404686
2014-03-19 01:17:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 01:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404686  77 56735  4663578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 01:17:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:17:56 [DEBUG   ] Finished updating board flags in 1.791 seconds
2014-03-19 01:18:03 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-03-19 01:18:23 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2014-03-19 01:18:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-19 01:18:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 01:18:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 01:18:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 01:18:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:18:56 [DEBUG   ] Finished updating board flags in 1.605 seconds
2014-03-19 01:19:03 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-19 01:19:23 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-19 01:19:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 01:19:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 01:19:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 01:19:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 01:19:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:19:56 [DEBUG   ] Finished updating board flags in 1.593 seconds
2014-03-19 01:20:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 01:20:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 01:20:43 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2014-03-19 01:20:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 01:20:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:20:56 [DEBUG   ] Finished updating board flags in 1.417 seconds
2014-03-19 01:21:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 01:21:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 01:21:43 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-03-19 01:21:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:21:56 [DEBUG   ] Finished updating board flags in 1.384 seconds
2014-03-19 01:22:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 01:22:23 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 01:22:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 01:22:43 [DEBUG   ] Got command RPT from MCS: ref #404702
2014-03-19 01:22:43 [DEBUG   ] summary = ERROR
2014-03-19 01:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404702  13 56735  4963577 A  ERRORERROR'
2014-03-19 01:22:43 [DEBUG   ] Got command RPT from MCS: ref #404703
2014-03-19 01:22:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 01:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404703  77 56735  4963578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 01:22:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 01:22:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 01:22:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 01:22:56 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:22:56 [DEBUG   ] Finished updating board flags in 1.380 seconds
2014-03-19 01:23:04 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-19 01:23:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 01:23:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 01:23:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 01:23:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 01:23:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:23:57 [DEBUG   ] Finished updating board flags in 2.049 seconds
2014-03-19 01:24:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 01:24:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 01:24:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 01:24:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 01:24:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 01:24:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 01:24:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:24:57 [DEBUG   ] Finished updating board flags in 2.014 seconds
2014-03-19 01:25:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 01:25:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 01:25:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 01:25:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 01:25:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 01:25:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 01:25:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:25:57 [DEBUG   ] Finished updating board flags in 2.029 seconds
2014-03-19 01:26:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 01:26:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 01:26:44 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-19 01:26:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 01:26:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 01:26:57 [DEBUG   ] Finished updating board flags in 1.943 seconds
2014-03-19 01:27:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 01:27:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 01:27:43 [DEBUG   ] Got command RPT from MCS: ref #404719
2014-03-19 01:27:43 [DEBUG   ] summary = ERROR
2014-03-19 01:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404719  13 56735  5263590 A  ERRORERROR'
2014-03-19 01:27:43 [DEBUG   ] Got command RPT from MCS: ref #404720
2014-03-19 01:27:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 01:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404720  77 56735  5263590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 01:27:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 01:27:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 01:27:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 01:27:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 01:27:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:27:57 [DEBUG   ] Finished updating board flags in 1.833 seconds
2014-03-19 01:28:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 01:28:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 01:28:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 01:28:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:28:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 01:28:57 [DEBUG   ] Finished updating board flags in 1.763 seconds
2014-03-19 01:29:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 01:29:24 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2014-03-19 01:29:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 01:29:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 01:29:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:29:57 [DEBUG   ] Finished updating board flags in 1.623 seconds
2014-03-19 01:30:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 01:30:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 01:30:45 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-19 01:30:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 01:30:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 01:30:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:30:57 [DEBUG   ] Finished updating board flags in 1.585 seconds
2014-03-19 01:31:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 01:31:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 01:31:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 01:31:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:31:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 01:31:57 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:31:57 [DEBUG   ] Finished updating board flags in 1.411 seconds
2014-03-19 01:32:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 01:32:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 01:32:43 [DEBUG   ] Got command RPT from MCS: ref #404736
2014-03-19 01:32:43 [DEBUG   ] summary = ERROR
2014-03-19 01:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404736  13 56735  5563585 A  ERRORERROR'
2014-03-19 01:32:43 [DEBUG   ] Got command RPT from MCS: ref #404737
2014-03-19 01:32:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 01:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404737  77 56735  5563586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 01:32:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 01:32:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 01:32:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 01:32:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 01:32:57 [DEBUG   ] Finished updating board flags in 1.454 seconds
2014-03-19 01:33:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 01:33:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 01:33:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 01:33:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 01:33:57 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:33:57 [DEBUG   ] Finished updating board flags in 1.458 seconds
2014-03-19 01:34:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 01:34:26 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-03-19 01:34:46 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-19 01:34:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:34:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-03-19 01:34:57 [DEBUG   ] Finished updating board flags in 1.451 seconds
2014-03-19 01:35:06 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 01:35:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 01:35:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 01:35:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 01:35:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 01:35:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 01:35:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 01:35:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:35:57 [DEBUG   ] Finished updating board flags in 1.451 seconds
2014-03-19 01:36:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 01:36:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 01:36:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 01:36:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 01:36:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:36:58 [DEBUG   ] Finished updating board flags in 2.216 seconds
2014-03-19 01:37:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 01:37:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 01:37:43 [DEBUG   ] Got command RPT from MCS: ref #404753
2014-03-19 01:37:43 [DEBUG   ] summary = ERROR
2014-03-19 01:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404753  13 56735  5863585 A  ERRORERROR'
2014-03-19 01:37:43 [DEBUG   ] Got command RPT from MCS: ref #404754
2014-03-19 01:37:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 01:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404754  77 56735  5863586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 01:37:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 01:37:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 01:37:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 01:37:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 01:37:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 01:37:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:37:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-03-19 01:37:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:37:58 [DEBUG   ] Finished updating board flags in 2.180 seconds
2014-03-19 01:38:06 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-03-19 01:38:27 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-03-19 01:38:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 01:38:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 01:38:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:38:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:38:58 [DEBUG   ] Finished updating board flags in 2.007 seconds
2014-03-19 01:39:07 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 01:39:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 01:39:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 01:39:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 01:39:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 01:39:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-03-19 01:39:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-03-19 01:39:58 [DEBUG   ] Finished updating board flags in 2.019 seconds
2014-03-19 01:40:07 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-19 01:40:27 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 01:40:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 01:40:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 01:40:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 01:40:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:40:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:40:58 [DEBUG   ] Finished updating board flags in 1.975 seconds
2014-03-19 01:41:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 01:41:27 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2014-03-19 01:41:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 01:41:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 01:41:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 01:41:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 01:41:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 01:41:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 01:41:58 [DEBUG   ] Finished updating board flags in 1.816 seconds
2014-03-19 01:42:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 01:42:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 01:42:43 [DEBUG   ] Got command RPT from MCS: ref #404770
2014-03-19 01:42:43 [DEBUG   ] summary = ERROR
2014-03-19 01:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404770  13 56735  6163581 A  ERRORERROR'
2014-03-19 01:42:43 [DEBUG   ] Got command RPT from MCS: ref #404771
2014-03-19 01:42:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 01:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404771  77 56735  6163582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 01:42:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-19 01:42:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 01:42:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:42:58 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:42:58 [DEBUG   ] Finished updating board flags in 1.794 seconds
2014-03-19 01:43:08 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-19 01:43:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 01:43:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 01:43:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 01:43:58 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 01:43:58 [DEBUG   ] Finished updating board flags in 1.609 seconds
2014-03-19 01:44:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 01:44:28 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-03-19 01:44:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 01:44:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 01:44:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 01:44:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 01:44:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2014-03-19 01:44:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 01:44:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:44:58 [DEBUG   ] Finished updating board flags in 1.591 seconds
2014-03-19 01:45:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 01:45:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 01:45:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 01:45:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 01:45:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 01:45:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 01:45:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:45:58 [DEBUG   ] Finished updating board flags in 1.414 seconds
2014-03-19 01:46:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 01:46:28 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-03-19 01:46:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 01:46:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 01:46:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 01:46:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:46:58 [DEBUG   ] Finished updating board flags in 1.408 seconds
2014-03-19 01:47:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 01:47:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 01:47:43 [DEBUG   ] Got command RPT from MCS: ref #404787
2014-03-19 01:47:43 [DEBUG   ] summary = ERROR
2014-03-19 01:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404787  13 56735  6463585 A  ERRORERROR'
2014-03-19 01:47:43 [DEBUG   ] Got command RPT from MCS: ref #404788
2014-03-19 01:47:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 01:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404788  77 56735  6463586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 01:47:49 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-03-19 01:47:58 [DEBUG   ] Finished updating board flags in 1.384 seconds
2014-03-19 01:48:08 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-03-19 01:48:29 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-03-19 01:48:49 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2014-03-19 01:48:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 01:48:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 01:48:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:48:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:48:58 [DEBUG   ] Finished updating board flags in 1.352 seconds
2014-03-19 01:49:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 01:49:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 01:49:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 01:49:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 01:49:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 01:49:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 01:49:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:49:59 [DEBUG   ] Finished updating board flags in 2.065 seconds
2014-03-19 01:50:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 01:50:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 01:50:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 01:50:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 01:50:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:50:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:50:59 [DEBUG   ] Finished updating board flags in 2.011 seconds
2014-03-19 01:51:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 01:51:29 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-19 01:51:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 01:51:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 01:51:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 01:51:59 [DEBUG   ] Finished updating board flags in 1.989 seconds
2014-03-19 01:52:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 01:52:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 01:52:43 [DEBUG   ] Got command RPT from MCS: ref #404804
2014-03-19 01:52:43 [DEBUG   ] summary = ERROR
2014-03-19 01:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404804  13 56735  6763593 A  ERRORERROR'
2014-03-19 01:52:43 [DEBUG   ] Got command RPT from MCS: ref #404805
2014-03-19 01:52:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 01:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404805  77 56735  6763594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 01:52:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 01:52:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 01:52:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:52:59 [DEBUG   ] Finished updating board flags in 1.817 seconds
2014-03-19 01:53:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 01:53:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 01:53:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 01:53:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 01:53:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 01:53:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:53:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:53:59 [DEBUG   ] Finished updating board flags in 1.869 seconds
2014-03-19 01:54:09 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-19 01:54:30 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-03-19 01:54:50 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 01:54:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 01:54:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 01:54:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:54:59 [DEBUG   ] Finished updating board flags in 1.724 seconds
2014-03-19 01:55:10 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-19 01:55:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 01:55:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 01:55:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 01:55:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 01:55:59 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:55:59 [DEBUG   ] Finished updating board flags in 1.603 seconds
2014-03-19 01:56:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 01:56:30 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-19 01:56:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 01:56:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 01:56:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:56:59 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:56:59 [DEBUG   ] Finished updating board flags in 1.591 seconds
2014-03-19 01:57:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 01:57:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 01:57:43 [DEBUG   ] Got command RPT from MCS: ref #404821
2014-03-19 01:57:43 [DEBUG   ] summary = ERROR
2014-03-19 01:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404821  13 56735  7063585 A  ERRORERROR'
2014-03-19 01:57:43 [DEBUG   ] Got command RPT from MCS: ref #404822
2014-03-19 01:57:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 01:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404822  77 56735  7063586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 01:57:50 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-03-19 01:57:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 01:57:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 01:57:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 01:57:59 [DEBUG   ] Finished updating board flags in 1.413 seconds
2014-03-19 01:58:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 01:58:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 01:58:50 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-19 01:58:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2014-03-19 01:58:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:58:59 [DEBUG   ] Finished updating board flags in 1.391 seconds
2014-03-19 01:59:11 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-03-19 01:59:31 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-19 01:59:51 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 01:59:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 01:59:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 01:59:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 01:59:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 01:59:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 01:59:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 01:59:59 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 01:59:59 [DEBUG   ] Finished updating board flags in 1.350 seconds
2014-03-19 02:00:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 02:00:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 02:00:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 02:00:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 02:01:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:01:00 [DEBUG   ] Finished updating board flags in 2.072 seconds
2014-03-19 02:01:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 02:01:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 02:01:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 02:02:00 [DEBUG   ] Finished updating board flags in 1.991 seconds
2014-03-19 02:02:11 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2014-03-19 02:02:31 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-19 02:02:43 [DEBUG   ] Got command RPT from MCS: ref #404838
2014-03-19 02:02:43 [DEBUG   ] summary = ERROR
2014-03-19 02:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404838  13 56735  7363593 A  ERRORERROR'
2014-03-19 02:02:43 [DEBUG   ] Got command RPT from MCS: ref #404839
2014-03-19 02:02:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 02:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404839  77 56735  7363594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 02:02:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 02:02:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 02:02:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 02:03:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 02:03:00 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:03:00 [DEBUG   ] Finished updating board flags in 1.806 seconds
2014-03-19 02:03:11 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2014-03-19 02:03:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 02:03:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 02:03:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 02:04:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 02:04:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:04:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:04:00 [DEBUG   ] Finished updating board flags in 1.808 seconds
2014-03-19 02:04:11 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2014-03-19 02:04:31 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2014-03-19 02:04:52 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-19 02:04:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 02:04:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 02:04:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 02:04:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 02:05:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:05:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 02:05:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:05:00 [DEBUG   ] Finished updating board flags in 1.788 seconds
2014-03-19 02:05:12 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 02:05:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 02:05:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 02:05:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-03-19 02:05:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 02:05:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 02:06:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:06:00 [DEBUG   ] Finished updating board flags in 1.613 seconds
2014-03-19 02:06:12 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 02:06:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 02:06:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 02:06:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 02:07:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2014-03-19 02:07:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:07:00 [DEBUG   ] Finished updating board flags in 1.591 seconds
2014-03-19 02:07:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 02:07:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 02:07:43 [DEBUG   ] Got command RPT from MCS: ref #404855
2014-03-19 02:07:43 [DEBUG   ] summary = ERROR
2014-03-19 02:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404855  13 56735  7663597 A  ERRORERROR'
2014-03-19 02:07:43 [DEBUG   ] Got command RPT from MCS: ref #404856
2014-03-19 02:07:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 02:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404856  77 56735  7663598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 02:07:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 02:07:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 02:07:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 02:08:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 02:08:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:08:00 [DEBUG   ] Finished updating board flags in 1.407 seconds
2014-03-19 02:08:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 02:08:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 02:08:53 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2014-03-19 02:08:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 02:08:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 02:09:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:09:00 [DEBUG   ] Finished updating board flags in 1.404 seconds
2014-03-19 02:09:12 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-03-19 02:09:33 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-03-19 02:09:53 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 02:09:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 02:10:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 02:10:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 02:10:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:10:00 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:10:00 [DEBUG   ] Finished updating board flags in 1.387 seconds
2014-03-19 02:10:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 02:10:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 02:10:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 02:10:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 02:11:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 02:11:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:11:00 [DEBUG   ] Finished updating board flags in 1.418 seconds
2014-03-19 02:11:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 02:11:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 02:11:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 02:12:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 02:12:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 02:12:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 02:12:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:12:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-03-19 02:12:01 [DEBUG   ] Finished updating board flags in 2.275 seconds
2014-03-19 02:12:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 02:12:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 02:12:43 [DEBUG   ] Got command RPT from MCS: ref #404872
2014-03-19 02:12:43 [DEBUG   ] summary = ERROR
2014-03-19 02:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404872  13 56735  7963593 A  ERRORERROR'
2014-03-19 02:12:43 [DEBUG   ] Got command RPT from MCS: ref #404873
2014-03-19 02:12:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 02:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404873  77 56735  7963594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 02:12:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 02:13:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 02:13:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-03-19 02:13:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:13:01 [DEBUG   ] Finished updating board flags in 2.117 seconds
2014-03-19 02:13:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 02:13:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 02:13:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 02:14:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 02:14:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 02:14:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 02:14:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 02:14:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 02:14:01 [DEBUG   ] Finished updating board flags in 2.016 seconds
2014-03-19 02:14:13 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-19 02:14:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-03-19 02:14:54 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-19 02:15:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:15:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:15:01 [DEBUG   ] Finished updating board flags in 1.989 seconds
2014-03-19 02:15:14 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-19 02:15:34 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2014-03-19 02:15:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 02:16:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 02:16:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:16:01 [DEBUG   ] Finished updating board flags in 1.794 seconds
2014-03-19 02:16:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 02:16:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 02:16:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 02:17:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 02:17:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 02:17:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 02:17:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:17:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:17:01 [DEBUG   ] Finished updating board flags in 1.710 seconds
2014-03-19 02:17:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 02:17:34 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-03-19 02:17:43 [DEBUG   ] Got command RPT from MCS: ref #404889
2014-03-19 02:17:43 [DEBUG   ] summary = ERROR
2014-03-19 02:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404889  13 56735  8263597 A  ERRORERROR'
2014-03-19 02:17:43 [DEBUG   ] Got command RPT from MCS: ref #404890
2014-03-19 02:17:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 02:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404890  77 56735  8263598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 02:17:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 02:18:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 02:18:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 02:18:01 [DEBUG   ] Finished updating board flags in 1.501 seconds
2014-03-19 02:18:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 02:18:34 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-19 02:18:55 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-03-19 02:19:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 02:19:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 02:19:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:19:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:19:01 [DEBUG   ] Finished updating board flags in 1.404 seconds
2014-03-19 02:19:15 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-19 02:19:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 02:19:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 02:20:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 02:20:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:20:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 02:20:01 [DEBUG   ] Finished updating board flags in 1.391 seconds
2014-03-19 02:20:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 02:20:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 02:20:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 02:21:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 02:21:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 02:21:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:21:01 [DEBUG   ] Finished updating board flags in 1.352 seconds
2014-03-19 02:21:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 02:21:35 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-19 02:21:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 02:22:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 02:22:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 02:22:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 02:22:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 02:22:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 02:22:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 02:22:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:22:02 [DEBUG   ] Finished updating board flags in 2.071 seconds
2014-03-19 02:22:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 02:22:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 02:22:43 [DEBUG   ] Got command RPT from MCS: ref #404906
2014-03-19 02:22:43 [DEBUG   ] summary = ERROR
2014-03-19 02:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404906  13 56735  8563601 A  ERRORERROR'
2014-03-19 02:22:43 [DEBUG   ] Got command RPT from MCS: ref #404907
2014-03-19 02:22:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 02:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404907  77 56735  8563602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 02:22:55 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2014-03-19 02:23:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 02:23:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 02:23:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:23:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:23:02 [DEBUG   ] Finished updating board flags in 1.990 seconds
2014-03-19 02:23:16 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-19 02:23:36 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 02:23:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 02:24:02 [DEBUG   ] Finished updating board flags in 1.816 seconds
2014-03-19 02:24:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 02:24:36 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2014-03-19 02:24:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 02:25:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 02:25:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 02:25:02 [DEBUG   ] Finished updating board flags in 1.783 seconds
2014-03-19 02:25:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 02:25:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 02:25:56 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2014-03-19 02:26:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 02:26:02 [DEBUG   ] Finished updating board flags in 1.615 seconds
2014-03-19 02:26:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 02:26:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 02:26:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 02:27:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 02:27:02 [DEBUG   ] Finished updating board flags in 1.589 seconds
2014-03-19 02:27:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 02:27:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 02:27:43 [DEBUG   ] Got command RPT from MCS: ref #404923
2014-03-19 02:27:43 [DEBUG   ] summary = ERROR
2014-03-19 02:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404923  13 56735  8863601 A  ERRORERROR'
2014-03-19 02:27:43 [DEBUG   ] Got command RPT from MCS: ref #404924
2014-03-19 02:27:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 02:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404924  77 56735  8863602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 02:27:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 02:28:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 02:28:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 02:28:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:28:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:28:02 [DEBUG   ] Finished updating board flags in 1.416 seconds
2014-03-19 02:28:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 02:28:36 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-03-19 02:28:57 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-19 02:29:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 02:29:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:29:02 [DEBUG   ] Finished updating board flags in 1.388 seconds
2014-03-19 02:29:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 02:29:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 02:29:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 02:30:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 02:30:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 02:30:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:30:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:30:02 [DEBUG   ] Finished updating board flags in 1.365 seconds
2014-03-19 02:30:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 02:30:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 02:30:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 02:31:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 02:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 02:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:31:03 [DEBUG   ] Finished updating board flags in 2.049 seconds
2014-03-19 02:31:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 02:31:37 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2014-03-19 02:31:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 02:32:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 02:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 02:32:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:32:03 [DEBUG   ] Finished updating board flags in 1.997 seconds
2014-03-19 02:32:17 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-19 02:32:38 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-19 02:32:43 [DEBUG   ] Got command RPT from MCS: ref #404940
2014-03-19 02:32:43 [DEBUG   ] summary = ERROR
2014-03-19 02:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404940  13 56735  9163597 A  ERRORERROR'
2014-03-19 02:32:43 [DEBUG   ] Got command RPT from MCS: ref #404941
2014-03-19 02:32:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 02:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404941  77 56735  9163598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 02:32:58 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 02:33:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 02:33:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 02:33:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 02:33:03 [DEBUG   ] Finished updating board flags in 1.810 seconds
2014-03-19 02:33:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 02:33:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 02:33:58 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 02:34:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 02:34:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 02:34:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:34:03 [DEBUG   ] Finished updating board flags in 1.783 seconds
2014-03-19 02:34:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 02:34:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 02:34:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 02:35:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 02:35:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 02:35:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 02:35:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 02:35:03 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:35:03 [DEBUG   ] Finished updating board flags in 1.608 seconds
2014-03-19 02:35:18 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2014-03-19 02:35:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 02:35:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 02:36:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 02:36:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 02:36:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 02:36:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:36:03 [DEBUG   ] Finished updating board flags in 1.612 seconds
2014-03-19 02:36:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 02:36:38 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 02:36:58 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-19 02:37:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 02:37:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 02:37:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 02:37:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 02:37:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 02:37:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 02:37:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:37:03 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:37:03 [DEBUG   ] Finished updating board flags in 1.587 seconds
2014-03-19 02:37:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-19 02:37:39 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-03-19 02:37:43 [DEBUG   ] Got command RPT from MCS: ref #404957
2014-03-19 02:37:43 [DEBUG   ] summary = ERROR
2014-03-19 02:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404957  13 56735  9463597 A  ERRORERROR'
2014-03-19 02:37:43 [DEBUG   ] Got command RPT from MCS: ref #404958
2014-03-19 02:37:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 02:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404958  77 56735  9463598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 02:37:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 02:38:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 02:38:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 02:38:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:38:03 [DEBUG   ] Finished updating board flags in 1.412 seconds
2014-03-19 02:38:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 02:38:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 02:38:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 02:39:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:39:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 02:39:03 [DEBUG   ] Finished updating board flags in 1.437 seconds
2014-03-19 02:39:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 02:39:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 02:39:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 02:40:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 02:40:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 02:40:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 02:40:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:40:03 [DEBUG   ] Finished updating board flags in 1.438 seconds
2014-03-19 02:40:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 02:40:39 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-03-19 02:40:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 02:41:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 02:41:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 02:41:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 02:41:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:41:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:41:03 [DEBUG   ] Finished updating board flags in 1.443 seconds
2014-03-19 02:41:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 02:41:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 02:42:00 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2014-03-19 02:42:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 02:42:03 [DEBUG   ] Finished updating board flags in 1.440 seconds
2014-03-19 02:42:19 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2014-03-19 02:42:40 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-03-19 02:42:43 [DEBUG   ] Got command RPT from MCS: ref #404974
2014-03-19 02:42:43 [DEBUG   ] summary = ERROR
2014-03-19 02:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404974  13 56735  9763597 A  ERRORERROR'
2014-03-19 02:42:43 [DEBUG   ] Got command RPT from MCS: ref #404975
2014-03-19 02:42:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 02:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404975  77 56735  9763598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 02:43:00 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2014-03-19 02:43:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 02:43:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 02:43:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 02:43:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 02:43:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 02:43:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:43:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:43:03 [DEBUG   ] Finished updating board flags in 1.436 seconds
2014-03-19 02:43:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 02:43:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 02:44:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 02:44:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 02:44:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:44:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 02:44:03 [DEBUG   ] Finished updating board flags in 1.436 seconds
2014-03-19 02:44:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 02:44:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 02:45:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 02:45:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 02:45:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-03-19 02:45:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 02:45:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 02:45:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:45:04 [DEBUG   ] Finished updating board flags in 2.272 seconds
2014-03-19 02:45:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 02:45:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 02:46:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 02:46:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 02:46:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 02:46:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 02:46:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:46:04 [DEBUG   ] Finished updating board flags in 2.117 seconds
2014-03-19 02:46:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 02:46:40 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2014-03-19 02:47:01 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-19 02:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 02:47:04 [DEBUG   ] Finished updating board flags in 2.006 seconds
2014-03-19 02:47:21 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 02:47:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 02:47:43 [DEBUG   ] Got command RPT from MCS: ref #404991
2014-03-19 02:47:43 [DEBUG   ] summary = ERROR
2014-03-19 02:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404991  13 56735 10063597 A  ERRORERROR'
2014-03-19 02:47:43 [DEBUG   ] Got command RPT from MCS: ref #404992
2014-03-19 02:47:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 02:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   404992  77 56735 10063598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 02:48:01 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2014-03-19 02:48:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 02:48:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 02:48:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 02:48:04 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:48:04 [DEBUG   ] Finished updating board flags in 2.011 seconds
2014-03-19 02:48:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 02:48:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 02:49:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 02:49:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 02:49:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 02:49:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:49:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-03-19 02:49:04 [CRITICAL] MGT underflow detected on beam(s) 1
2014-03-19 02:49:04 [DEBUG   ] Finished updating board flags in 1.988 seconds
2014-03-19 02:49:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 02:49:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 02:50:01 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 02:50:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 02:50:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 02:50:04 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:50:04 [DEBUG   ] Finished updating board flags in 1.810 seconds
2014-03-19 02:50:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 02:50:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 02:51:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 02:51:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-03-19 02:51:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 02:51:04 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 02:51:04 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:51:04 [DEBUG   ] Finished updating board flags in 1.788 seconds
2014-03-19 02:51:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 02:51:41 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 02:52:02 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2014-03-19 02:52:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 02:52:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 02:52:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:52:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:52:04 [DEBUG   ] Finished updating board flags in 1.615 seconds
2014-03-19 02:52:21 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-03-19 02:52:42 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-03-19 02:52:43 [DEBUG   ] Got command RPT from MCS: ref #405008
2014-03-19 02:52:43 [DEBUG   ] summary = ERROR
2014-03-19 02:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405008  13 56735 10363605 A  ERRORERROR'
2014-03-19 02:52:43 [DEBUG   ] Got command RPT from MCS: ref #405009
2014-03-19 02:52:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 02:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405009  77 56735 10363606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 02:53:02 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-03-19 02:53:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 02:53:04 [DEBUG   ] Finished updating board flags in 1.589 seconds
2014-03-19 02:53:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 02:53:42 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 02:54:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 02:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:54:04 [DEBUG   ] Finished updating board flags in 1.414 seconds
2014-03-19 02:54:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 02:54:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 02:55:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 02:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 02:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 02:55:04 [DEBUG   ] Finished updating board flags in 1.435 seconds
2014-03-19 02:55:22 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2014-03-19 02:55:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 02:56:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 02:56:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 02:56:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 02:56:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:56:04 [DEBUG   ] Finished updating board flags in 1.359 seconds
2014-03-19 02:56:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 02:56:43 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-03-19 02:57:02 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2014-03-19 02:57:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 02:57:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 02:57:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 02:57:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 02:57:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:57:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 02:57:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:57:04 [DEBUG   ] Finished updating board flags in 1.359 seconds
2014-03-19 02:57:23 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-03-19 02:57:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 02:57:43 [DEBUG   ] Got command RPT from MCS: ref #405025
2014-03-19 02:57:43 [DEBUG   ] summary = ERROR
2014-03-19 02:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405025  13 56735 10663601 A  ERRORERROR'
2014-03-19 02:57:43 [DEBUG   ] Got command RPT from MCS: ref #405026
2014-03-19 02:57:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 02:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405026  77 56735 10663602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 02:58:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 02:58:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 02:58:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 02:58:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 02:58:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 02:58:05 [DEBUG   ] Finished updating board flags in 2.064 seconds
2014-03-19 02:58:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 02:58:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 02:59:03 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-19 02:59:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 02:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 02:59:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 02:59:05 [DEBUG   ] Finished updating board flags in 1.982 seconds
2014-03-19 02:59:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 02:59:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 03:00:03 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 03:00:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 03:00:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 03:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 03:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:00:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:00:05 [DEBUG   ] Finished updating board flags in 1.829 seconds
2014-03-19 03:00:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 03:00:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 03:01:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 03:01:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 03:01:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 03:01:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:01:05 [DEBUG   ] Finished updating board flags in 1.857 seconds
2014-03-19 03:01:23 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 03:01:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 03:02:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 03:02:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 03:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:02:05 [DEBUG   ] Finished updating board flags in 1.734 seconds
2014-03-19 03:02:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 03:02:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 03:02:43 [DEBUG   ] Got command RPT from MCS: ref #405042
2014-03-19 03:02:43 [DEBUG   ] summary = ERROR
2014-03-19 03:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405042  13 56735 10963609 A  ERRORERROR'
2014-03-19 03:02:43 [DEBUG   ] Got command RPT from MCS: ref #405043
2014-03-19 03:02:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 03:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405043  77 56735 10963610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 03:03:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 03:03:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 03:03:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 03:03:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 03:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:03:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:03:05 [DEBUG   ] Finished updating board flags in 1.620 seconds
2014-03-19 03:03:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 03:03:43 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 03:04:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 03:04:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 03:04:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 03:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-03-19 03:04:05 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:04:05 [DEBUG   ] Finished updating board flags in 1.639 seconds
2014-03-19 03:04:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 03:04:43 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-03-19 03:05:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 03:05:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 03:05:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 03:05:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 03:05:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:05:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 03:05:05 [DEBUG   ] Finished updating board flags in 1.533 seconds
2014-03-19 03:05:23 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 03:05:44 [DEBUG   ] Finished updating ant stats in 1.325 seconds
2014-03-19 03:06:04 [DEBUG   ] Finished updating ant stats in 1.254 seconds
2014-03-19 03:06:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 03:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 03:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:06:05 [DEBUG   ] Finished updating board flags in 1.461 seconds
2014-03-19 03:06:24 [DEBUG   ] Finished updating ant stats in 1.147 seconds
2014-03-19 03:06:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 03:07:04 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2014-03-19 03:07:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 03:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 03:07:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 03:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 03:07:05 [DEBUG   ] Finished updating board flags in 1.451 seconds
2014-03-19 03:07:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 03:07:43 [DEBUG   ] Got command RPT from MCS: ref #405059
2014-03-19 03:07:43 [DEBUG   ] summary = ERROR
2014-03-19 03:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405059  13 56735 11263606 A  ERRORERROR'
2014-03-19 03:07:43 [DEBUG   ] Got command RPT from MCS: ref #405060
2014-03-19 03:07:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 03:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405060  77 56735 11263606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 03:07:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 03:08:04 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-19 03:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 03:08:05 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:08:05 [DEBUG   ] Finished updating board flags in 1.451 seconds
2014-03-19 03:08:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 03:08:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 03:09:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 03:09:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:09:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 03:09:05 [DEBUG   ] Finished updating board flags in 1.457 seconds
2014-03-19 03:09:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 03:09:44 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2014-03-19 03:10:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 03:10:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 03:10:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:10:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:10:05 [DEBUG   ] Finished updating board flags in 1.459 seconds
2014-03-19 03:10:24 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2014-03-19 03:10:44 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2014-03-19 03:11:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-19 03:11:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 03:11:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 03:11:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 03:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 03:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 03:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:11:06 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:11:06 [DEBUG   ] Finished updating board flags in 2.151 seconds
2014-03-19 03:11:25 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-03-19 03:11:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 03:12:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 03:12:05 [DEBUG   ] Finished updating ant stats in 1.248 seconds
2014-03-19 03:12:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 03:12:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:12:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:12:06 [DEBUG   ] Finished updating board flags in 1.993 seconds
2014-03-19 03:12:25 [DEBUG   ] Finished updating ant stats in 1.153 seconds
2014-03-19 03:12:43 [DEBUG   ] Got command RPT from MCS: ref #405076
2014-03-19 03:12:43 [DEBUG   ] summary = ERROR
2014-03-19 03:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405076  13 56735 11563613 A  ERRORERROR'
2014-03-19 03:12:43 [DEBUG   ] Got command RPT from MCS: ref #405077
2014-03-19 03:12:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 03:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405077  77 56735 11563614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 03:12:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 03:13:05 [DEBUG   ] Finished updating ant stats in 0.851 seconds
2014-03-19 03:13:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 03:13:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:13:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:13:06 [DEBUG   ] Finished updating board flags in 1.809 seconds
2014-03-19 03:13:25 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2014-03-19 03:13:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 03:14:05 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2014-03-19 03:14:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 03:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 03:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:14:06 [DEBUG   ] Finished updating board flags in 1.802 seconds
2014-03-19 03:14:25 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2014-03-19 03:14:45 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-03-19 03:15:05 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 03:15:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 03:15:06 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-03-19 03:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:15:06 [DEBUG   ] Finished updating board flags in 1.794 seconds
2014-03-19 03:15:26 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 03:15:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 03:16:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 03:16:06 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 03:16:07 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 03:16:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:16:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:16:07 [DEBUG   ] Finished updating board flags in 2.606 seconds
2014-03-19 03:16:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 03:16:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 03:17:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 03:17:06 [DEBUG   ] Finished updating ant stats in 1.245 seconds
2014-03-19 03:17:06 [DEBUG   ] Finished updating board flags in 1.646 seconds
2014-03-19 03:17:26 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2014-03-19 03:17:43 [DEBUG   ] Got command RPT from MCS: ref #405093
2014-03-19 03:17:43 [DEBUG   ] summary = ERROR
2014-03-19 03:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405093  13 56735 11863613 A  ERRORERROR'
2014-03-19 03:17:43 [DEBUG   ] Got command RPT from MCS: ref #405094
2014-03-19 03:17:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 03:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405094  77 56735 11863614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 03:17:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 03:18:06 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2014-03-19 03:18:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:18:06 [DEBUG   ] Finished updating board flags in 1.625 seconds
2014-03-19 03:18:26 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2014-03-19 03:18:46 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 03:19:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 03:19:06 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2014-03-19 03:19:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:19:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:19:06 [DEBUG   ] Finished updating board flags in 1.589 seconds
2014-03-19 03:19:26 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2014-03-19 03:19:47 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-03-19 03:20:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 03:20:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 03:20:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:20:06 [DEBUG   ] Finished updating board flags in 1.428 seconds
2014-03-19 03:20:07 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 03:20:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 03:20:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 03:21:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-03-19 03:21:06 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:21:06 [DEBUG   ] Finished updating board flags in 1.431 seconds
2014-03-19 03:21:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 03:21:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 03:21:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 03:22:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-03-19 03:22:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 03:22:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:22:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:22:06 [DEBUG   ] Finished updating board flags in 1.414 seconds
2014-03-19 03:22:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 03:22:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 03:22:43 [DEBUG   ] Got command RPT from MCS: ref #405110
2014-03-19 03:22:43 [DEBUG   ] summary = ERROR
2014-03-19 03:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405110  13 56735 12163609 A  ERRORERROR'
2014-03-19 03:22:43 [DEBUG   ] Got command RPT from MCS: ref #405111
2014-03-19 03:22:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 03:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405111  77 56735 12163610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 03:22:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 03:23:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 03:23:06 [DEBUG   ] Finished updating board flags in 1.419 seconds
2014-03-19 03:23:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 03:23:27 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-19 03:23:48 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-03-19 03:24:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 03:24:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:24:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2014-03-19 03:24:06 [DEBUG   ] Finished updating board flags in 1.409 seconds
2014-03-19 03:24:08 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-03-19 03:24:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 03:24:48 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2014-03-19 03:25:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 03:25:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 03:25:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:25:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:25:06 [DEBUG   ] Finished updating board flags in 1.406 seconds
2014-03-19 03:25:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 03:25:28 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-19 03:25:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 03:26:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 03:26:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 03:26:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:26:06 [DEBUG   ] Finished updating board flags in 1.451 seconds
2014-03-19 03:26:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 03:26:28 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-19 03:26:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 03:27:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 03:27:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 03:27:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 03:27:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 03:27:06 [DEBUG   ] Finished updating board flags in 1.424 seconds
2014-03-19 03:27:08 [DEBUG   ] Finished updating ant stats in 0.793 seconds
2014-03-19 03:27:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 03:27:43 [DEBUG   ] Got command RPT from MCS: ref #405127
2014-03-19 03:27:43 [DEBUG   ] summary = ERROR
2014-03-19 03:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405127  13 56735 12463617 A  ERRORERROR'
2014-03-19 03:27:43 [DEBUG   ] Got command RPT from MCS: ref #405128
2014-03-19 03:27:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 03:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405128  77 56735 12463618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 03:27:49 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-19 03:28:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 03:28:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:28:07 [DEBUG   ] Finished updating board flags in 2.221 seconds
2014-03-19 03:28:09 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 03:28:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 03:28:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 03:29:07 [DEBUG   ] Finished updating board flags in 2.153 seconds
2014-03-19 03:29:09 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 03:29:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 03:29:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 03:30:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2014-03-19 03:30:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:30:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 03:30:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:30:07 [DEBUG   ] Finished updating board flags in 2.018 seconds
2014-03-19 03:30:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 03:30:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 03:30:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 03:31:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:31:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 03:31:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:31:07 [DEBUG   ] Finished updating board flags in 2.094 seconds
2014-03-19 03:31:09 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2014-03-19 03:31:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 03:31:50 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-03-19 03:32:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 03:32:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 03:32:06 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 03:32:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:32:07 [DEBUG   ] Finished updating board flags in 1.892 seconds
2014-03-19 03:32:10 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 03:32:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 03:32:43 [DEBUG   ] Got command RPT from MCS: ref #405144
2014-03-19 03:32:43 [DEBUG   ] summary = ERROR
2014-03-19 03:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405144  13 56735 12763613 A  ERRORERROR'
2014-03-19 03:32:43 [DEBUG   ] Got command RPT from MCS: ref #405145
2014-03-19 03:32:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 03:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405145  77 56735 12763614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 03:32:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 03:33:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 03:33:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 03:33:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-19 03:33:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 03:33:07 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:33:07 [DEBUG   ] Finished updating board flags in 1.817 seconds
2014-03-19 03:33:10 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 03:33:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 03:33:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 03:34:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 03:34:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 03:34:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:34:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:34:07 [DEBUG   ] Finished updating board flags in 1.806 seconds
2014-03-19 03:34:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 03:34:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 03:34:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 03:35:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 03:35:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 03:35:07 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:35:07 [DEBUG   ] Finished updating board flags in 1.788 seconds
2014-03-19 03:35:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 03:35:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 03:35:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 03:36:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 03:36:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 03:36:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:36:07 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:36:07 [DEBUG   ] Finished updating board flags in 1.619 seconds
2014-03-19 03:36:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 03:36:31 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2014-03-19 03:36:51 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-19 03:37:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 03:37:07 [DEBUG   ] Finished updating board flags in 1.583 seconds
2014-03-19 03:37:11 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 03:37:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 03:37:43 [DEBUG   ] Got command RPT from MCS: ref #405161
2014-03-19 03:37:43 [DEBUG   ] summary = ERROR
2014-03-19 03:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405161  13 56735 13063609 A  ERRORERROR'
2014-03-19 03:37:43 [DEBUG   ] Got command RPT from MCS: ref #405162
2014-03-19 03:37:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 03:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405162  77 56735 13063610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 03:37:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 03:38:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 03:38:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 03:38:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 03:38:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:38:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 03:38:07 [DEBUG   ] Finished updating board flags in 1.417 seconds
2014-03-19 03:38:11 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 03:38:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 03:38:51 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2014-03-19 03:39:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 03:39:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 03:39:07 [DEBUG   ] Finished updating board flags in 1.384 seconds
2014-03-19 03:39:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 03:39:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 03:39:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 03:40:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 03:40:07 [DEBUG   ] Finished updating board flags in 1.357 seconds
2014-03-19 03:40:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 03:40:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 03:40:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 03:41:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 03:41:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:41:08 [DEBUG   ] Finished updating board flags in 2.083 seconds
2014-03-19 03:41:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 03:41:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 03:41:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 03:42:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 03:42:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 03:42:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:42:08 [DEBUG   ] Finished updating board flags in 1.963 seconds
2014-03-19 03:42:11 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2014-03-19 03:42:32 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-03-19 03:42:43 [DEBUG   ] Got command RPT from MCS: ref #405178
2014-03-19 03:42:43 [DEBUG   ] summary = ERROR
2014-03-19 03:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405178  13 56735 13363617 A  ERRORERROR'
2014-03-19 03:42:43 [DEBUG   ] Got command RPT from MCS: ref #405179
2014-03-19 03:42:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 03:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405179  77 56735 13363618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 03:42:52 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-19 03:43:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:43:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:43:08 [DEBUG   ] Finished updating board flags in 1.811 seconds
2014-03-19 03:43:11 [DEBUG   ] Finished updating ant stats in 0.409 seconds
2014-03-19 03:43:31 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2014-03-19 03:43:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-19 03:44:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 03:44:08 [DEBUG   ] Finished updating board flags in 1.810 seconds
2014-03-19 03:44:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 03:44:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 03:44:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 03:45:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 03:45:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:45:08 [DEBUG   ] Finished updating board flags in 1.793 seconds
2014-03-19 03:45:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 03:45:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 03:45:52 [DEBUG   ] Finished updating ant stats in 0.868 seconds
2014-03-19 03:46:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:46:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:46:08 [DEBUG   ] Finished updating board flags in 1.603 seconds
2014-03-19 03:46:12 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-19 03:46:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 03:46:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 03:47:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:47:08 [DEBUG   ] Finished updating board flags in 1.610 seconds
2014-03-19 03:47:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 03:47:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 03:47:43 [DEBUG   ] Got command RPT from MCS: ref #405195
2014-03-19 03:47:43 [DEBUG   ] summary = ERROR
2014-03-19 03:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405195  13 56735 13663617 A  ERRORERROR'
2014-03-19 03:47:43 [DEBUG   ] Got command RPT from MCS: ref #405196
2014-03-19 03:47:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 03:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405196  77 56735 13663618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 03:47:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 03:48:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 03:48:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 03:48:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:48:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-03-19 03:48:08 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:48:08 [DEBUG   ] Finished updating board flags in 1.584 seconds
2014-03-19 03:48:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 03:48:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-19 03:48:53 [DEBUG   ] Finished updating ant stats in 1.406 seconds
2014-03-19 03:49:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 03:49:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 03:49:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 03:49:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 03:49:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:49:08 [DEBUG   ] Finished updating board flags in 1.418 seconds
2014-03-19 03:49:13 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-19 03:49:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 03:49:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 03:50:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 03:50:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 03:50:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 03:50:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 03:50:08 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:50:08 [DEBUG   ] Finished updating board flags in 1.384 seconds
2014-03-19 03:50:13 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-03-19 03:50:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 03:50:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 03:51:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 03:51:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:51:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:51:08 [DEBUG   ] Finished updating board flags in 1.361 seconds
2014-03-19 03:51:13 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-19 03:51:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 03:51:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 03:52:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 03:52:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 03:52:09 [DEBUG   ] Finished updating board flags in 2.057 seconds
2014-03-19 03:52:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 03:52:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 03:52:43 [DEBUG   ] Got command RPT from MCS: ref #405212
2014-03-19 03:52:43 [DEBUG   ] summary = ERROR
2014-03-19 03:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405212  13 56735 13963621 A  ERRORERROR'
2014-03-19 03:52:43 [DEBUG   ] Got command RPT from MCS: ref #405213
2014-03-19 03:52:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 03:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405213  77 56735 13963622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 03:52:53 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-03-19 03:53:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:53:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:53:09 [DEBUG   ] Finished updating board flags in 1.985 seconds
2014-03-19 03:53:13 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-19 03:53:33 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2014-03-19 03:53:54 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 03:54:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 03:54:09 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 03:54:09 [DEBUG   ] Finished updating board flags in 1.815 seconds
2014-03-19 03:54:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 03:54:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 03:54:54 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-19 03:55:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 03:55:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:55:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 03:55:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:55:09 [DEBUG   ] Finished updating board flags in 1.792 seconds
2014-03-19 03:55:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 03:55:34 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 03:55:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 03:56:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:56:09 [DEBUG   ] Finished updating board flags in 1.610 seconds
2014-03-19 03:56:14 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2014-03-19 03:56:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 03:56:54 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 03:57:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 03:57:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-03-19 03:57:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:57:09 [DEBUG   ] Finished updating board flags in 1.661 seconds
2014-03-19 03:57:14 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-19 03:57:35 [DEBUG   ] Finished updating ant stats in 1.389 seconds
2014-03-19 03:57:43 [DEBUG   ] Got command RPT from MCS: ref #405229
2014-03-19 03:57:43 [DEBUG   ] summary = ERROR
2014-03-19 03:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405229  13 56735 14263617 A  ERRORERROR'
2014-03-19 03:57:43 [DEBUG   ] Got command RPT from MCS: ref #405230
2014-03-19 03:57:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 03:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405230  77 56735 14263618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 03:57:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 03:58:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 03:58:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-03-19 03:58:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 03:58:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:58:09 [DEBUG   ] Finished updating board flags in 1.537 seconds
2014-03-19 03:58:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 03:58:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 03:58:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 03:59:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 03:59:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 03:59:09 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 03:59:09 [DEBUG   ] Finished updating board flags in 1.413 seconds
2014-03-19 03:59:15 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2014-03-19 03:59:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 03:59:55 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2014-03-19 04:00:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 04:00:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 04:00:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2014-03-19 04:00:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 04:00:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-03-19 04:00:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 04:00:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:00:09 [DEBUG   ] Finished updating board flags in 1.386 seconds
2014-03-19 04:00:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 04:00:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 04:00:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 04:01:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 04:01:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 04:01:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 04:01:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 04:01:09 [DEBUG   ] Finished updating board flags in 1.407 seconds
2014-03-19 04:01:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 04:01:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 04:01:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 04:02:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 04:02:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 04:02:10 [DEBUG   ] Finished updating board flags in 2.229 seconds
2014-03-19 04:02:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 04:02:36 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-19 04:02:43 [DEBUG   ] Got command RPT from MCS: ref #405246
2014-03-19 04:02:43 [DEBUG   ] summary = ERROR
2014-03-19 04:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405246  13 56735 14563625 A  ERRORERROR'
2014-03-19 04:02:43 [DEBUG   ] Got command RPT from MCS: ref #405247
2014-03-19 04:02:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 04:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405247  77 56735 14563626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 04:02:56 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-19 04:03:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 04:03:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 04:03:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:03:10 [DEBUG   ] Finished updating board flags in 2.211 seconds
2014-03-19 04:03:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 04:03:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 04:03:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 04:04:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 04:04:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 04:04:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 04:04:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:04:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:04:10 [DEBUG   ] Finished updating board flags in 2.158 seconds
2014-03-19 04:04:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 04:04:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 04:04:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 04:05:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 04:05:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:05:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:05:10 [DEBUG   ] Finished updating board flags in 2.010 seconds
2014-03-19 04:05:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 04:05:36 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2014-03-19 04:05:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 04:06:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 04:06:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 04:06:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:06:10 [DEBUG   ] Finished updating board flags in 1.992 seconds
2014-03-19 04:06:16 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-03-19 04:06:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 04:06:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-19 04:07:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 04:07:10 [DEBUG   ] Finished updating board flags in 1.815 seconds
2014-03-19 04:07:16 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-19 04:07:37 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-19 04:07:43 [DEBUG   ] Got command RPT from MCS: ref #405263
2014-03-19 04:07:43 [DEBUG   ] summary = ERROR
2014-03-19 04:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405263  13 56735 14863625 A  ERRORERROR'
2014-03-19 04:07:43 [DEBUG   ] Got command RPT from MCS: ref #405264
2014-03-19 04:07:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 04:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405264  77 56735 14863626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 04:07:56 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-19 04:08:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 04:08:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 04:08:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 04:08:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 04:08:10 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:08:10 [DEBUG   ] Finished updating board flags in 1.789 seconds
2014-03-19 04:08:17 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-03-19 04:08:37 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-03-19 04:08:57 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2014-03-19 04:09:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-03-19 04:09:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 04:09:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 04:09:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 04:09:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:09:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:09:10 [DEBUG   ] Finished updating board flags in 1.615 seconds
2014-03-19 04:09:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 04:09:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 04:09:57 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-19 04:10:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 04:10:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 04:10:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 04:10:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:10:10 [DEBUG   ] Finished updating board flags in 1.593 seconds
2014-03-19 04:10:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 04:10:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 04:10:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 04:11:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 04:11:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 04:11:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 04:11:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:11:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:11:10 [DEBUG   ] Finished updating board flags in 1.416 seconds
2014-03-19 04:11:17 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-19 04:11:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 04:11:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 04:12:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:12:10 [DEBUG   ] Finished updating board flags in 1.389 seconds
2014-03-19 04:12:18 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-03-19 04:12:38 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2014-03-19 04:12:43 [DEBUG   ] Got command RPT from MCS: ref #405280
2014-03-19 04:12:43 [DEBUG   ] summary = ERROR
2014-03-19 04:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405280  13 56735 15163617 A  ERRORERROR'
2014-03-19 04:12:43 [DEBUG   ] Got command RPT from MCS: ref #405281
2014-03-19 04:12:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 04:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405281  77 56735 15163618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 04:12:58 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-19 04:13:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 04:13:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:13:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-03-19 04:13:10 [DEBUG   ] Finished updating board flags in 1.355 seconds
2014-03-19 04:13:18 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-03-19 04:13:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 04:13:58 [DEBUG   ] Finished updating ant stats in 1.183 seconds
2014-03-19 04:14:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 04:14:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 04:14:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 04:14:11 [DEBUG   ] Finished updating board flags in 2.051 seconds
2014-03-19 04:14:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 04:14:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 04:14:58 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-19 04:15:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 04:15:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:15:11 [DEBUG   ] Finished updating board flags in 2.013 seconds
2014-03-19 04:15:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 04:15:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 04:15:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 04:16:11 [DEBUG   ] Finished updating board flags in 1.982 seconds
2014-03-19 04:16:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 04:16:38 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 04:16:59 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-19 04:17:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 04:17:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 04:17:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 04:17:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:17:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-03-19 04:17:11 [DEBUG   ] Finished updating board flags in 1.819 seconds
2014-03-19 04:17:18 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-19 04:17:39 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-03-19 04:17:43 [DEBUG   ] Got command RPT from MCS: ref #405297
2014-03-19 04:17:43 [DEBUG   ] summary = ERROR
2014-03-19 04:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405297  13 56735 15463625 A  ERRORERROR'
2014-03-19 04:17:43 [DEBUG   ] Got command RPT from MCS: ref #405298
2014-03-19 04:17:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 04:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405298  77 56735 15463626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 04:17:59 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-03-19 04:18:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:18:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 04:18:11 [DEBUG   ] Finished updating board flags in 1.794 seconds
2014-03-19 04:18:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 04:18:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 04:18:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 04:19:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 04:19:11 [DEBUG   ] Finished updating board flags in 1.612 seconds
2014-03-19 04:19:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 04:19:39 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-19 04:19:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 04:20:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 04:20:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 04:20:11 [DEBUG   ] Finished updating board flags in 1.640 seconds
2014-03-19 04:20:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 04:20:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 04:20:59 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-03-19 04:21:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 04:21:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2014-03-19 04:21:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:21:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:21:11 [DEBUG   ] Finished updating board flags in 1.571 seconds
2014-03-19 04:21:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 04:21:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-19 04:22:00 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-03-19 04:22:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 04:22:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 04:22:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 04:22:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 04:22:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:22:11 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:22:11 [DEBUG   ] Finished updating board flags in 1.383 seconds
2014-03-19 04:22:20 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-19 04:22:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 04:22:43 [DEBUG   ] Got command RPT from MCS: ref #405314
2014-03-19 04:22:43 [DEBUG   ] summary = ERROR
2014-03-19 04:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405314  13 56735 15763621 A  ERRORERROR'
2014-03-19 04:22:43 [DEBUG   ] Got command RPT from MCS: ref #405315
2014-03-19 04:22:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 04:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405315  77 56735 15763622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 04:23:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 04:23:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 04:23:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 04:23:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 04:23:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 04:23:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 04:23:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:23:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-03-19 04:23:11 [DEBUG   ] Finished updating board flags in 1.380 seconds
2014-03-19 04:23:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 04:23:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 04:24:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 04:24:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 04:24:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 04:24:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 04:24:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:24:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:24:12 [DEBUG   ] Finished updating board flags in 2.040 seconds
2014-03-19 04:24:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 04:24:40 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-19 04:25:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 04:25:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:25:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:25:12 [DEBUG   ] Finished updating board flags in 2.047 seconds
2014-03-19 04:25:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 04:25:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 04:26:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 04:26:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 04:26:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 04:26:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:26:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:26:12 [DEBUG   ] Finished updating board flags in 2.007 seconds
2014-03-19 04:26:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 04:26:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 04:27:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 04:27:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 04:27:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 04:27:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 04:27:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:27:12 [DEBUG   ] Finished updating board flags in 1.948 seconds
2014-03-19 04:27:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 04:27:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 04:27:43 [DEBUG   ] Got command RPT from MCS: ref #405331
2014-03-19 04:27:43 [DEBUG   ] summary = ERROR
2014-03-19 04:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405331  13 56735 16063621 A  ERRORERROR'
2014-03-19 04:27:43 [DEBUG   ] Got command RPT from MCS: ref #405332
2014-03-19 04:27:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 04:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405332  77 56735 16063622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 04:28:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-19 04:28:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 04:28:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:28:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:28:12 [DEBUG   ] Finished updating board flags in 1.802 seconds
2014-03-19 04:28:21 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-03-19 04:28:41 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-19 04:29:01 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-19 04:29:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 04:29:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 04:29:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:29:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:29:12 [DEBUG   ] Finished updating board flags in 1.795 seconds
2014-03-19 04:29:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 04:29:41 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 04:30:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 04:30:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 04:30:12 [DEBUG   ] Finished updating board flags in 1.619 seconds
2014-03-19 04:30:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 04:30:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 04:31:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 04:31:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 04:31:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 04:31:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 04:31:12 [DEBUG   ] Finished updating board flags in 1.587 seconds
2014-03-19 04:31:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 04:31:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 04:32:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-19 04:32:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 04:32:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 04:32:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:32:12 [DEBUG   ] Finished updating board flags in 1.415 seconds
2014-03-19 04:32:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 04:32:41 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2014-03-19 04:32:43 [DEBUG   ] Got command RPT from MCS: ref #405348
2014-03-19 04:32:43 [DEBUG   ] summary = ERROR
2014-03-19 04:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405348  13 56735 16363625 A  ERRORERROR'
2014-03-19 04:32:43 [DEBUG   ] Got command RPT from MCS: ref #405349
2014-03-19 04:32:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 04:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405349  77 56735 16363626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 04:33:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-03-19 04:33:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:33:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:33:13 [DEBUG   ] Finished updating board flags in 1.768 seconds
2014-03-19 04:33:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 04:33:42 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-03-19 04:34:02 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-19 04:34:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 04:34:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 04:34:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 04:34:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:34:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:34:13 [DEBUG   ] Finished updating board flags in 2.159 seconds
2014-03-19 04:34:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 04:34:42 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 04:35:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 04:35:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 04:35:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 04:35:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 04:35:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:35:13 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:35:13 [DEBUG   ] Finished updating board flags in 2.014 seconds
2014-03-19 04:35:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 04:35:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 04:36:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 04:36:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 04:36:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 04:36:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 04:36:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:36:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:36:13 [DEBUG   ] Finished updating board flags in 1.984 seconds
2014-03-19 04:36:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 04:36:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 04:37:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 04:37:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 04:37:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 04:37:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:37:13 [DEBUG   ] Finished updating board flags in 1.809 seconds
2014-03-19 04:37:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 04:37:42 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 04:37:43 [DEBUG   ] Got command RPT from MCS: ref #405365
2014-03-19 04:37:43 [DEBUG   ] summary = ERROR
2014-03-19 04:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405365  13 56735 16663629 A  ERRORERROR'
2014-03-19 04:37:43 [DEBUG   ] Got command RPT from MCS: ref #405366
2014-03-19 04:37:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 04:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405366  77 56735 16663630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 04:38:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 04:38:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 04:38:13 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 04:38:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:38:13 [DEBUG   ] Finished updating board flags in 1.805 seconds
2014-03-19 04:38:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 04:38:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 04:39:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 04:39:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 04:39:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:39:13 [DEBUG   ] Finished updating board flags in 1.827 seconds
2014-03-19 04:39:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-19 04:39:42 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-19 04:40:03 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-03-19 04:40:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 04:40:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 04:40:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 04:40:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:40:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:40:13 [DEBUG   ] Finished updating board flags in 1.859 seconds
2014-03-19 04:40:23 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 04:40:43 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 04:41:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 04:41:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 04:41:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:41:13 [DEBUG   ] Finished updating board flags in 1.711 seconds
2014-03-19 04:41:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 04:41:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 04:42:03 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-19 04:42:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 04:42:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:42:14 [DEBUG   ] Finished updating board flags in 2.614 seconds
2014-03-19 04:42:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 04:42:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 04:42:43 [DEBUG   ] Got command RPT from MCS: ref #405382
2014-03-19 04:42:43 [DEBUG   ] summary = ERROR
2014-03-19 04:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405382  13 56735 16963633 A  ERRORERROR'
2014-03-19 04:42:43 [DEBUG   ] Got command RPT from MCS: ref #405383
2014-03-19 04:42:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 04:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405383  77 56735 16963634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 04:43:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 04:43:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 04:43:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:43:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:43:13 [DEBUG   ] Finished updating board flags in 1.587 seconds
2014-03-19 04:43:23 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-19 04:43:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 04:44:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 04:44:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 04:44:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 04:44:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 04:44:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:44:13 [DEBUG   ] Finished updating board flags in 1.414 seconds
2014-03-19 04:44:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 04:44:43 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2014-03-19 04:45:03 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 04:45:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-03-19 04:45:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 04:45:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:45:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:45:13 [DEBUG   ] Finished updating board flags in 1.468 seconds
2014-03-19 04:45:24 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-03-19 04:45:44 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 04:46:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 04:46:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 04:46:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 04:46:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 04:46:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 04:46:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:46:13 [DEBUG   ] Finished updating board flags in 1.432 seconds
2014-03-19 04:46:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 04:46:44 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-19 04:47:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 04:47:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 04:47:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 04:47:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 04:47:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 04:47:13 [DEBUG   ] Finished updating board flags in 1.431 seconds
2014-03-19 04:47:24 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2014-03-19 04:47:43 [DEBUG   ] Got command RPT from MCS: ref #405399
2014-03-19 04:47:43 [DEBUG   ] summary = ERROR
2014-03-19 04:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405399  13 56735 17263634 A  ERRORERROR'
2014-03-19 04:47:43 [DEBUG   ] Got command RPT from MCS: ref #405400
2014-03-19 04:47:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 04:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405400  77 56735 17263634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 04:47:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 04:48:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-03-19 04:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-03-19 04:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-03-19 04:48:13 [DEBUG   ] Finished updating board flags in 1.467 seconds
2014-03-19 04:48:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 04:48:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 04:49:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 04:49:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-19 04:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 04:49:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-19 04:49:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:49:13 [DEBUG   ] Finished updating board flags in 1.461 seconds
2014-03-19 04:49:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 04:49:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 04:50:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 04:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 04:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 04:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 04:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 04:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 04:50:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 04:50:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 04:50:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 04:50:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 04:50:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 04:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 04:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 04:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 04:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 04:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 04:50:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:50:14 [DEBUG   ] Finished updating board flags in 2.220 seconds
2014-03-19 04:50:25 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-03-19 04:50:45 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2014-03-19 04:51:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 04:51:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 04:51:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 04:51:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 04:51:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 04:51:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 04:51:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 04:51:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 04:51:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 04:51:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 04:51:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 04:51:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 04:51:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 04:51:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 04:51:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:51:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 04:51:14 [DEBUG   ] Finished updating board flags in 2.130 seconds
2014-03-19 04:51:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 04:51:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 04:52:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 04:52:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 04:52:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 04:52:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 04:52:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 04:52:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 04:52:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 04:52:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 04:52:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 04:52:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 04:52:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 04:52:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 04:52:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 04:52:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 04:52:14 [DEBUG   ] Finished updating board flags in 2.010 seconds
2014-03-19 04:52:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 04:52:43 [DEBUG   ] Got command RPT from MCS: ref #405416
2014-03-19 04:52:43 [DEBUG   ] summary = ERROR
2014-03-19 04:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405416  13 56735 17563629 A  ERRORERROR'
2014-03-19 04:52:43 [DEBUG   ] Got command RPT from MCS: ref #405417
2014-03-19 04:52:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 04:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405417  77 56735 17563630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 04:52:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 04:53:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 04:53:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 04:53:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 04:53:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 04:53:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 04:53:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 04:53:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 04:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 04:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 04:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 04:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 04:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 04:53:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 04:53:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 04:53:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:53:14 [DEBUG   ] Finished updating board flags in 1.986 seconds
2014-03-19 04:53:25 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-19 04:53:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 04:54:05 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 04:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 04:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 04:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 04:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 04:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 04:54:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 04:54:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 04:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 04:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 04:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 04:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 04:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 04:54:14 [DEBUG   ] Finished updating board flags in 1.823 seconds
2014-03-19 04:54:26 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-19 04:54:46 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-19 04:55:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 04:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 04:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 04:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 04:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 04:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 04:55:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 04:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 04:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 04:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 04:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 04:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 04:55:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:55:14 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:55:14 [DEBUG   ] Finished updating board flags in 1.775 seconds
2014-03-19 04:55:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 04:55:46 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-19 04:56:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 04:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 04:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 04:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 04:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 04:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 04:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 04:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 04:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 04:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 04:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 04:56:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 04:56:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:56:14 [DEBUG   ] Finished updating board flags in 1.628 seconds
2014-03-19 04:56:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 04:56:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 04:57:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 04:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 04:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 04:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 04:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 04:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 04:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 04:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 04:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 04:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 04:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 04:57:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:57:14 [DEBUG   ] Finished updating board flags in 1.581 seconds
2014-03-19 04:57:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 04:57:43 [DEBUG   ] Got command RPT from MCS: ref #405433
2014-03-19 04:57:43 [DEBUG   ] summary = ERROR
2014-03-19 04:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405433  13 56735 17863633 A  ERRORERROR'
2014-03-19 04:57:43 [DEBUG   ] Got command RPT from MCS: ref #405434
2014-03-19 04:57:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 04:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405434  77 56735 17863634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 04:57:47 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-03-19 04:58:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 04:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 04:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 04:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 04:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 04:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 04:58:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 04:58:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 04:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 04:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 04:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 04:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 04:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 04:58:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 04:58:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:58:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:58:14 [DEBUG   ] Finished updating board flags in 1.410 seconds
2014-03-19 04:58:27 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 04:58:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 04:59:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 04:59:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 04:59:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 04:59:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 04:59:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 04:59:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 04:59:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 04:59:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 04:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 04:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 04:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 04:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 04:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 04:59:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 04:59:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 04:59:14 [DEBUG   ] Finished updating board flags in 1.390 seconds
2014-03-19 04:59:27 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 04:59:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 05:00:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 05:00:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 05:00:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 05:00:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 05:00:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 05:00:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 05:00:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 05:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 05:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 05:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 05:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 05:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 05:00:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-03-19 05:00:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:00:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:00:14 [DEBUG   ] Finished updating board flags in 1.350 seconds
2014-03-19 05:00:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 05:00:47 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2014-03-19 05:01:07 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 05:01:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 05:01:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 05:01:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 05:01:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 05:01:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 05:01:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 05:01:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 05:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 05:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 05:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 05:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 05:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 05:01:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 05:01:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:01:15 [DEBUG   ] Finished updating board flags in 2.068 seconds
2014-03-19 05:01:28 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-19 05:01:48 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-19 05:02:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 05:02:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 05:02:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 05:02:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 05:02:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 05:02:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 05:02:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 05:02:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 05:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 05:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 05:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 05:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 05:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 05:02:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 05:02:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 05:02:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:02:15 [DEBUG   ] Finished updating board flags in 2.003 seconds
2014-03-19 05:02:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 05:02:43 [DEBUG   ] Got command RPT from MCS: ref #405450
2014-03-19 05:02:43 [DEBUG   ] summary = ERROR
2014-03-19 05:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405450  13 56735 18163637 A  ERRORERROR'
2014-03-19 05:02:43 [DEBUG   ] Got command RPT from MCS: ref #405451
2014-03-19 05:02:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 05:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405451  77 56735 18163638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 05:02:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 05:03:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 05:03:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 05:03:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 05:03:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 05:03:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 05:03:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 05:03:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 05:03:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 05:03:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 05:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 05:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 05:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 05:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 05:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 05:03:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:03:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:03:15 [DEBUG   ] Finished updating board flags in 2.021 seconds
2014-03-19 05:03:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 05:03:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 05:04:08 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2014-03-19 05:04:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 05:04:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 05:04:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 05:04:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 05:04:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 05:04:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 05:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 05:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 05:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 05:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 05:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 05:04:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:04:15 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:04:15 [DEBUG   ] Finished updating board flags in 1.969 seconds
2014-03-19 05:04:28 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 05:04:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 05:05:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 05:05:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 05:05:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 05:05:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 05:05:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 05:05:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 05:05:14 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 05:05:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 05:05:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 05:05:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 05:05:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 05:05:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 05:05:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 05:05:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:05:15 [DEBUG   ] Finished updating board flags in 1.812 seconds
2014-03-19 05:05:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 05:05:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 05:06:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 05:06:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 05:06:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 05:06:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 05:06:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 05:06:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 05:06:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 05:06:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 05:06:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 05:06:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 05:06:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 05:06:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:06:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:06:15 [DEBUG   ] Finished updating board flags in 1.802 seconds
2014-03-19 05:06:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 05:06:48 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-19 05:07:09 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-03-19 05:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 05:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 05:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 05:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 05:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 05:07:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 05:07:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 05:07:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 05:07:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 05:07:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 05:07:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 05:07:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:07:15 [DEBUG   ] Finished updating board flags in 1.799 seconds
2014-03-19 05:07:29 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 05:07:43 [DEBUG   ] Got command RPT from MCS: ref #405467
2014-03-19 05:07:43 [DEBUG   ] summary = ERROR
2014-03-19 05:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405467  13 56735 18463642 A  ERRORERROR'
2014-03-19 05:07:43 [DEBUG   ] Got command RPT from MCS: ref #405468
2014-03-19 05:07:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 05:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405468  77 56735 18463642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 05:07:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 05:08:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 05:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 05:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 05:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 05:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 05:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 05:08:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2014-03-19 05:08:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 05:08:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 05:08:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 05:08:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 05:08:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 05:08:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 05:08:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 05:08:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 05:08:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 05:08:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:08:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:08:15 [DEBUG   ] Finished updating board flags in 1.615 seconds
2014-03-19 05:08:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 05:08:49 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-19 05:09:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 05:09:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 05:09:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 05:09:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 05:09:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 05:09:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 05:09:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 05:09:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 05:09:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 05:09:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 05:09:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 05:09:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 05:09:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 05:09:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:09:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:09:15 [DEBUG   ] Finished updating board flags in 1.591 seconds
2014-03-19 05:09:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 05:09:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 05:10:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 05:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 05:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 05:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 05:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 05:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 05:10:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 05:10:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 05:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 05:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 05:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 05:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 05:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 05:10:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 05:10:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:10:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 05:10:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:10:15 [DEBUG   ] Finished updating board flags in 1.412 seconds
2014-03-19 05:10:30 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-19 05:10:50 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-19 05:11:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 05:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 05:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 05:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 05:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 05:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 05:11:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 05:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 05:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 05:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 05:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 05:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 05:11:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 05:11:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:11:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:11:15 [DEBUG   ] Finished updating board flags in 1.394 seconds
2014-03-19 05:11:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 05:11:50 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 05:12:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-03-19 05:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-03-19 05:12:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:12:15 [DEBUG   ] Finished updating board flags in 1.384 seconds
2014-03-19 05:12:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 05:12:43 [DEBUG   ] Got command RPT from MCS: ref #405484
2014-03-19 05:12:43 [DEBUG   ] summary = ERROR
2014-03-19 05:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405484  13 56735 18763641 A  ERRORERROR'
2014-03-19 05:12:43 [DEBUG   ] Got command RPT from MCS: ref #405485
2014-03-19 05:12:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 05:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405485  77 56735 18763642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 05:12:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 05:13:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 05:13:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-19 05:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-19 05:13:16 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:13:16 [DEBUG   ] Finished updating board flags in 2.038 seconds
2014-03-19 05:13:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-19 05:13:51 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-19 05:14:11 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-19 05:14:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:14:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:14:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:14:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:14:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:14:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 05:14:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 05:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:14:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 05:14:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:14:16 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:14:16 [DEBUG   ] Finished updating board flags in 1.988 seconds
2014-03-19 05:14:31 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 05:14:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 05:15:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 05:15:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:15:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:15:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:15:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:15:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:15:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 05:15:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 05:15:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:15:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:15:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:15:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:15:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:15:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:15:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 05:15:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:15:16 [DEBUG   ] Finished updating board flags in 1.806 seconds
2014-03-19 05:15:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 05:15:51 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 05:16:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 05:16:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:16:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:16:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:16:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:16:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:16:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 05:16:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 05:16:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:16:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:16:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:16:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:16:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:16:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 05:16:16 [DEBUG   ] Finished updating board flags in 1.793 seconds
2014-03-19 05:16:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 05:16:52 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-19 05:17:12 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-19 05:17:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:17:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:17:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:17:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:17:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:17:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 05:17:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 05:17:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:17:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:17:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:17:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:17:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:17:16 [DEBUG   ] Finished updating board flags in 1.613 seconds
2014-03-19 05:17:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 05:17:43 [DEBUG   ] Got command RPT from MCS: ref #405501
2014-03-19 05:17:43 [DEBUG   ] summary = ERROR
2014-03-19 05:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405501  13 56735 19063633 A  ERRORERROR'
2014-03-19 05:17:43 [DEBUG   ] Got command RPT from MCS: ref #405502
2014-03-19 05:17:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 05:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405502  77 56735 19063634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 05:17:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 05:18:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 05:18:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:18:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:18:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:18:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:18:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:18:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 05:18:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:18:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:18:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:18:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:18:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:18:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 05:18:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:18:16 [DEBUG   ] Finished updating board flags in 1.658 seconds
2014-03-19 05:18:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 05:18:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 05:19:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 05:19:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:19:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:19:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:19:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:19:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:19:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 05:19:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:19:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:19:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:19:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:19:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:19:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 05:19:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 05:19:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:19:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 05:19:16 [DEBUG   ] Finished updating board flags in 1.525 seconds
2014-03-19 05:19:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 05:19:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 05:20:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 05:20:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:20:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:20:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:20:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:20:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:20:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 05:20:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 05:20:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:20:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:20:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:20:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:20:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:20:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 05:20:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:20:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 05:20:16 [DEBUG   ] Finished updating board flags in 1.421 seconds
2014-03-19 05:20:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 05:20:52 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 05:21:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 05:21:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:21:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:21:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:21:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:21:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:21:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 05:21:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 05:21:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:21:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:21:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:21:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:21:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:21:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:21:16 [DEBUG   ] Finished updating board flags in 1.408 seconds
2014-03-19 05:21:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 05:21:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 05:22:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 05:22:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:22:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:22:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:22:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:22:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:22:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:22:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:22:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:22:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:22:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:22:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 05:22:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 05:22:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:22:16 [DEBUG   ] Finished updating board flags in 1.408 seconds
2014-03-19 05:22:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 05:22:43 [DEBUG   ] Got command RPT from MCS: ref #405518
2014-03-19 05:22:43 [DEBUG   ] summary = ERROR
2014-03-19 05:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405518  13 56735 19363633 A  ERRORERROR'
2014-03-19 05:22:43 [DEBUG   ] Got command RPT from MCS: ref #405519
2014-03-19 05:22:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 05:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405519  77 56735 19363634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 05:22:52 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 05:23:13 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-19 05:23:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:23:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:23:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:23:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:23:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:23:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:23:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:23:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:23:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:23:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:23:16 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 05:23:16 [DEBUG   ] Finished updating board flags in 1.403 seconds
2014-03-19 05:23:33 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 05:23:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 05:24:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 05:24:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:24:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:24:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:24:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:24:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:24:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 05:24:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 05:24:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:24:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:24:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:24:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:24:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:24:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:24:16 [DEBUG   ] Finished updating board flags in 1.371 seconds
2014-03-19 05:24:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 05:24:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 05:25:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 05:25:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:25:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:25:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:25:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:25:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:25:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 05:25:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 05:25:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:25:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:25:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:25:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:25:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:25:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 05:25:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 05:25:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:25:16 [DEBUG   ] Finished updating board flags in 1.501 seconds
2014-03-19 05:25:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 05:25:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 05:26:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 05:26:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:26:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:26:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:26:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:26:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:26:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 05:26:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 05:26:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:26:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:26:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:26:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:26:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:26:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:26:17 [DEBUG   ] Finished updating board flags in 2.226 seconds
2014-03-19 05:26:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 05:26:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 05:27:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 05:27:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:27:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:27:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:27:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:27:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:27:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 05:27:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 05:27:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:27:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:27:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:27:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:27:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:27:17 [DEBUG   ] Finished updating board flags in 2.125 seconds
2014-03-19 05:27:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 05:27:43 [DEBUG   ] Got command RPT from MCS: ref #405535
2014-03-19 05:27:43 [DEBUG   ] summary = ERROR
2014-03-19 05:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405535  13 56735 19663633 A  ERRORERROR'
2014-03-19 05:27:43 [DEBUG   ] Got command RPT from MCS: ref #405536
2014-03-19 05:27:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 05:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405536  77 56735 19663634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 05:27:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 05:28:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 05:28:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:28:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:28:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:28:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:28:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:28:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 05:28:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 05:28:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:28:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:28:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:28:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:28:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:28:17 [DEBUG   ] Finished updating board flags in 1.983 seconds
2014-03-19 05:28:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 05:28:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 05:29:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 05:29:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:29:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:29:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:29:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:29:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:29:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 05:29:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 05:29:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 05:29:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 05:29:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2014-03-19 05:29:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:29:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:29:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:29:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:29:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:29:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 05:29:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:29:17 [DEBUG   ] Finished updating board flags in 1.772 seconds
2014-03-19 05:29:33 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 05:29:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 05:30:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 05:30:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:30:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:30:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:30:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:30:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:30:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 05:30:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 05:30:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 05:30:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:30:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:30:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:30:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:30:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:30:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 05:30:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:30:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:30:17 [DEBUG   ] Finished updating board flags in 1.609 seconds
2014-03-19 05:30:33 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 05:30:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 05:31:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 05:31:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:31:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:31:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:31:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:31:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:31:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 05:31:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 05:31:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 05:31:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 05:31:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 05:31:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:31:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:31:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:31:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:31:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:31:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 05:31:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 05:31:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:31:17 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:31:17 [DEBUG   ] Finished updating board flags in 1.593 seconds
2014-03-19 05:31:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 05:31:53 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 05:32:14 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-19 05:32:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:32:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:32:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:32:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:32:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:32:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 05:32:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:32:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:32:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:32:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:32:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:32:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 05:32:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:32:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2014-03-19 05:32:17 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:32:17 [DEBUG   ] Finished updating board flags in 1.407 seconds
2014-03-19 05:32:34 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 05:32:43 [DEBUG   ] Got command RPT from MCS: ref #405552
2014-03-19 05:32:43 [DEBUG   ] summary = ERROR
2014-03-19 05:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405552  13 56735 19963637 A  ERRORERROR'
2014-03-19 05:32:43 [DEBUG   ] Got command RPT from MCS: ref #405553
2014-03-19 05:32:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 05:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405553  77 56735 19963638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 05:32:54 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-03-19 05:33:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 05:33:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:33:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:33:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:33:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:33:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:33:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 05:33:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-03-19 05:33:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 05:33:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:33:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:33:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:33:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:33:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:33:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:33:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2014-03-19 05:33:17 [DEBUG   ] Finished updating board flags in 1.413 seconds
2014-03-19 05:33:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 05:33:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 05:34:14 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-19 05:34:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:34:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:34:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:34:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:34:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:34:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 05:34:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 05:34:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 05:34:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:34:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:34:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:34:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:34:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:34:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 05:34:17 [DEBUG   ] Finished updating board flags in 1.415 seconds
2014-03-19 05:34:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 05:34:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 05:35:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 05:35:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:35:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:35:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:35:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:35:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:35:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-03-19 05:35:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:35:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:35:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:35:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:35:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:35:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 05:35:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:35:17 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:35:17 [DEBUG   ] Finished updating board flags in 1.378 seconds
2014-03-19 05:35:34 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-19 05:35:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-19 05:36:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-19 05:36:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:36:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:36:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:36:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:36:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:36:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 05:36:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:36:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:36:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:36:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:36:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:36:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 05:36:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:36:17 [DEBUG   ] Finished updating board flags in 1.369 seconds
2014-03-19 05:36:35 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-19 05:36:55 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-19 05:37:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 05:37:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:37:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:37:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:37:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:37:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:37:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 05:37:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 05:37:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 05:37:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:37:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:37:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:37:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:37:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:37:18 [DEBUG   ] Finished updating board flags in 2.044 seconds
2014-03-19 05:37:35 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 05:37:43 [DEBUG   ] Got command RPT from MCS: ref #405569
2014-03-19 05:37:43 [DEBUG   ] summary = ERROR
2014-03-19 05:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405569  13 56735 20263641 A  ERRORERROR'
2014-03-19 05:37:43 [DEBUG   ] Got command RPT from MCS: ref #405570
2014-03-19 05:37:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 05:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405570  77 56735 20263642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 05:37:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 05:38:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 05:38:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:38:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:38:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:38:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:38:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:38:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:38:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:38:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:38:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:38:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:38:18 [DEBUG   ] Finished updating board flags in 1.996 seconds
2014-03-19 05:38:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 05:38:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 05:39:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 05:39:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:39:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:39:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:39:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:39:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:39:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 05:39:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:39:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:39:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:39:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:39:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:39:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 05:39:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:39:18 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:39:18 [DEBUG   ] Finished updating board flags in 1.836 seconds
2014-03-19 05:39:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 05:39:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 05:40:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 05:40:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:40:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:40:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:40:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:40:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:40:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:40:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:40:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:40:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:40:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:40:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:40:18 [DEBUG   ] Finished updating board flags in 1.778 seconds
2014-03-19 05:40:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 05:40:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 05:41:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 05:41:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:41:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:41:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:41:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:41:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:41:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 05:41:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 05:41:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:41:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:41:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:41:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:41:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:41:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 05:41:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:41:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:41:18 [DEBUG   ] Finished updating board flags in 1.634 seconds
2014-03-19 05:41:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 05:41:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 05:42:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 05:42:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:42:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:42:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:42:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:42:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:42:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 05:42:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 05:42:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 05:42:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:42:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:42:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:42:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:42:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:42:18 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:42:18 [DEBUG   ] Finished updating board flags in 1.551 seconds
2014-03-19 05:42:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 05:42:43 [DEBUG   ] Got command RPT from MCS: ref #405586
2014-03-19 05:42:43 [DEBUG   ] summary = ERROR
2014-03-19 05:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405586  13 56735 20563637 A  ERRORERROR'
2014-03-19 05:42:43 [DEBUG   ] Got command RPT from MCS: ref #405587
2014-03-19 05:42:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 05:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405587  77 56735 20563638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 05:42:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 05:43:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 05:43:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:43:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:43:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:43:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:43:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:43:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-03-19 05:43:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:43:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:43:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:43:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:43:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:43:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 05:43:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:43:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:43:18 [DEBUG   ] Finished updating board flags in 1.417 seconds
2014-03-19 05:43:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 05:43:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 05:44:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 05:44:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:44:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:44:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:44:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:44:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:44:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:44:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:44:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:44:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:44:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:44:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 05:44:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:44:18 [DEBUG   ] Finished updating board flags in 1.502 seconds
2014-03-19 05:44:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 05:44:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 05:45:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 05:45:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:45:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:45:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:45:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:45:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:45:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 05:45:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 05:45:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:45:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:45:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:45:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:45:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:45:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:45:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 05:45:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:45:18 [DEBUG   ] Finished updating board flags in 1.508 seconds
2014-03-19 05:45:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 05:45:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 05:46:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 05:46:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:46:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:46:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:46:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:46:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:46:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 05:46:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 05:46:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 05:46:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:46:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:46:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:46:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:46:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:46:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 05:46:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-03-19 05:46:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:46:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-19 05:46:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:46:19 [DEBUG   ] Finished updating board flags in 2.282 seconds
2014-03-19 05:46:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 05:46:55 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 05:47:16 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-19 05:47:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:47:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:47:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:47:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:47:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:47:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-03-19 05:47:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 05:47:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 05:47:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:47:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:47:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:47:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:47:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:47:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 05:47:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:47:19 [DEBUG   ] Finished updating board flags in 2.115 seconds
2014-03-19 05:47:36 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 05:47:43 [DEBUG   ] Got command RPT from MCS: ref #405603
2014-03-19 05:47:43 [DEBUG   ] summary = ERROR
2014-03-19 05:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405603  13 56735 20863641 A  ERRORERROR'
2014-03-19 05:47:43 [DEBUG   ] Got command RPT from MCS: ref #405604
2014-03-19 05:47:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 05:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405604  77 56735 20863642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 05:47:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 05:48:16 [DEBUG   ] Finished updating ant stats in 1.186 seconds
2014-03-19 05:48:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:48:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:48:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:48:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:48:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:48:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 05:48:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:48:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:48:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:48:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:48:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:48:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 05:48:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 05:48:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:48:19 [DEBUG   ] Finished updating board flags in 2.006 seconds
2014-03-19 05:48:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 05:48:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 05:49:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 05:49:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:49:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:49:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:49:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:49:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:49:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 05:49:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 05:49:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2014-03-19 05:49:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:49:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:49:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:49:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:49:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:49:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 05:49:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 05:49:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2014-03-19 05:49:19 [DEBUG   ] Finished updating board flags in 1.987 seconds
2014-03-19 05:49:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 05:49:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 05:50:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 05:50:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:50:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:50:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:50:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:50:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:50:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 05:50:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:50:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:50:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:50:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:50:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:50:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:50:19 [DEBUG   ] Finished updating board flags in 1.849 seconds
2014-03-19 05:50:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 05:50:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 05:51:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 05:51:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:51:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:51:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:51:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:51:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:51:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 05:51:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 05:51:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 05:51:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:51:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:51:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:51:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:51:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:51:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:51:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:51:19 [DEBUG   ] Finished updating board flags in 1.752 seconds
2014-03-19 05:51:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 05:51:56 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 05:52:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 05:52:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:52:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:52:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:52:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:52:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:52:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:52:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:52:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:52:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:52:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:52:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:52:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:52:19 [DEBUG   ] Finished updating board flags in 1.619 seconds
2014-03-19 05:52:36 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-19 05:52:43 [DEBUG   ] Got command RPT from MCS: ref #405620
2014-03-19 05:52:43 [DEBUG   ] summary = ERROR
2014-03-19 05:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405620  13 56735 21163645 A  ERRORERROR'
2014-03-19 05:52:43 [DEBUG   ] Got command RPT from MCS: ref #405621
2014-03-19 05:52:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 05:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405621  77 56735 21163646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 05:52:57 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-03-19 05:53:17 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-19 05:53:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:53:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:53:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:53:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:53:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:53:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 05:53:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 05:53:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 05:53:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:53:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:53:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:53:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:53:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:53:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 05:53:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:53:19 [DEBUG   ] Finished updating board flags in 1.585 seconds
2014-03-19 05:53:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 05:53:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 05:54:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 05:54:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:54:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:54:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:54:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:54:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:54:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 05:54:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2014-03-19 05:54:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 05:54:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:54:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:54:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:54:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:54:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:54:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 05:54:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:54:19 [DEBUG   ] Finished updating board flags in 1.407 seconds
2014-03-19 05:54:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 05:54:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 05:55:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 05:55:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:55:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:55:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:55:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:55:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:55:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 05:55:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 05:55:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:55:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:55:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:55:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:55:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:55:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 05:55:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 05:55:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:55:19 [DEBUG   ] Finished updating board flags in 1.495 seconds
2014-03-19 05:55:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 05:55:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 05:56:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 05:56:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:56:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:56:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:56:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:56:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:56:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:56:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:56:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:56:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:56:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:56:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 05:56:19 [DEBUG   ] Finished updating board flags in 1.541 seconds
2014-03-19 05:56:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 05:56:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 05:57:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 05:57:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:57:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:57:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:57:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:57:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:57:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:57:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:57:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:57:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:57:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:57:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 05:57:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:57:20 [DEBUG   ] Finished updating board flags in 2.252 seconds
2014-03-19 05:57:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 05:57:43 [DEBUG   ] Got command RPT from MCS: ref #405637
2014-03-19 05:57:43 [DEBUG   ] summary = ERROR
2014-03-19 05:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405637  13 56735 21463641 A  ERRORERROR'
2014-03-19 05:57:43 [DEBUG   ] Got command RPT from MCS: ref #405638
2014-03-19 05:57:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 05:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405638  77 56735 21463642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 05:57:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 05:58:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 05:58:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:58:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:58:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:58:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:58:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:58:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:58:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:58:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:58:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:58:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:58:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 05:58:20 [DEBUG   ] Finished updating board flags in 2.161 seconds
2014-03-19 05:58:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 05:58:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 05:59:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 05:59:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 05:59:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 05:59:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 05:59:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 05:59:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 05:59:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 05:59:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 05:59:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 05:59:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 05:59:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 05:59:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 05:59:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 05:59:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 05:59:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 05:59:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 05:59:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 05:59:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 05:59:20 [DEBUG   ] Finished updating board flags in 2.032 seconds
2014-03-19 05:59:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 05:59:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 06:00:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 06:00:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 06:00:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 06:00:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 06:00:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 06:00:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 06:00:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 06:00:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 06:00:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 06:00:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 06:00:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 06:00:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 06:00:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 06:00:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 06:00:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:00:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 06:00:20 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:00:20 [DEBUG   ] Finished updating board flags in 1.924 seconds
2014-03-19 06:00:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 06:00:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 06:01:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 06:01:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 06:01:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 06:01:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 06:01:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 06:01:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 06:01:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 06:01:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 06:01:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 06:01:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 06:01:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 06:01:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 06:01:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 06:01:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 06:01:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:01:20 [DEBUG   ] Finished updating board flags in 1.817 seconds
2014-03-19 06:01:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 06:01:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 06:02:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 06:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 06:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 06:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 06:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 06:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 06:02:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 06:02:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 06:02:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 06:02:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 06:02:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 06:02:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 06:02:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 06:02:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 06:02:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-03-19 06:02:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:02:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:02:20 [DEBUG   ] Finished updating board flags in 1.827 seconds
2014-03-19 06:02:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 06:02:43 [DEBUG   ] Got command RPT from MCS: ref #405654
2014-03-19 06:02:43 [DEBUG   ] summary = ERROR
2014-03-19 06:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405654  13 56735 21763645 A  ERRORERROR'
2014-03-19 06:02:43 [DEBUG   ] Got command RPT from MCS: ref #405655
2014-03-19 06:02:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 06:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405655  77 56735 21763646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 06:02:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 06:03:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 06:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 06:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 06:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 06:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 06:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 06:03:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 06:03:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 06:03:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 06:03:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 06:03:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 06:03:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 06:03:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2014-03-19 06:03:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:03:20 [DEBUG   ] Finished updating board flags in 1.824 seconds
2014-03-19 06:03:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 06:03:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 06:04:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 06:04:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 06:04:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 06:04:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 06:04:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 06:04:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 06:04:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 06:04:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 06:04:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 06:04:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 06:04:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 06:04:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 06:04:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-03-19 06:04:20 [DEBUG   ] Finished updating board flags in 1.842 seconds
2014-03-19 06:04:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 06:04:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 06:05:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 06:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 06:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 06:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 06:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 06:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 06:05:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 06:05:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 06:05:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 06:05:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 06:05:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 06:05:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 06:05:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 06:05:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:05:20 [DEBUG   ] Finished updating board flags in 1.813 seconds
2014-03-19 06:05:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 06:05:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 06:06:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 06:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 06:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 06:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 06:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 06:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 06:06:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 06:06:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 06:06:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 06:06:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 06:06:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 06:06:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 06:06:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:06:20 [DEBUG   ] Finished updating board flags in 1.675 seconds
2014-03-19 06:06:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 06:06:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 06:07:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 06:07:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 06:07:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 06:07:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 06:07:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 06:07:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 06:07:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 06:07:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 06:07:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 06:07:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 06:07:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 06:07:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 06:07:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 06:07:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:07:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:07:20 [DEBUG   ] Finished updating board flags in 1.630 seconds
2014-03-19 06:07:37 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 06:07:43 [DEBUG   ] Got command RPT from MCS: ref #405671
2014-03-19 06:07:43 [DEBUG   ] summary = ERROR
2014-03-19 06:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405671  13 56735 22063641 A  ERRORERROR'
2014-03-19 06:07:43 [DEBUG   ] Got command RPT from MCS: ref #405672
2014-03-19 06:07:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 06:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405672  77 56735 22063642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 06:07:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 06:08:17 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 06:08:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 06:08:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 06:08:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 06:08:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 06:08:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 06:08:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 06:08:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 06:08:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 06:08:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 06:08:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 06:08:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 06:08:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 06:08:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 06:08:20 [DEBUG   ] Finished updating board flags in 1.573 seconds
2014-03-19 06:08:38 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-03-19 06:08:58 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-19 06:09:18 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 06:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 06:09:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 06:09:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 06:09:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 06:09:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 06:09:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 06:09:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:09:20 [DEBUG   ] Finished updating board flags in 1.417 seconds
2014-03-19 06:09:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 06:09:58 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-19 06:10:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 06:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 06:10:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 06:10:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 06:10:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 06:10:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 06:10:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 06:10:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 06:10:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 06:10:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 06:10:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:10:20 [DEBUG   ] Finished updating board flags in 1.407 seconds
2014-03-19 06:10:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 06:10:58 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 06:11:18 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2014-03-19 06:11:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2014-03-19 06:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2014-03-19 06:11:20 [DEBUG   ] Finished updating board flags in 1.437 seconds
2014-03-19 06:11:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 06:11:59 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-19 06:12:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-19 06:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-19 06:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-19 06:12:20 [DEBUG   ] Finished updating board flags in 1.434 seconds
2014-03-19 06:12:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 06:12:43 [DEBUG   ] Got command RPT from MCS: ref #405688
2014-03-19 06:12:43 [DEBUG   ] summary = ERROR
2014-03-19 06:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405688  13 56735 22363649 A  ERRORERROR'
2014-03-19 06:12:43 [DEBUG   ] Got command RPT from MCS: ref #405689
2014-03-19 06:12:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 06:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405689  77 56735 22363650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 06:12:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 06:13:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2014-03-19 06:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2014-03-19 06:13:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:13:20 [DEBUG   ] Finished updating board flags in 1.421 seconds
2014-03-19 06:13:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 06:13:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 06:14:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-19 06:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-19 06:14:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:14:20 [DEBUG   ] Finished updating board flags in 1.419 seconds
2014-03-19 06:14:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 06:14:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 06:15:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 06:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:15:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 06:15:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:15:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:15:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:15:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:15:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:15:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 06:15:20 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:15:20 [DEBUG   ] Finished updating board flags in 1.492 seconds
2014-03-19 06:15:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 06:15:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 06:16:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 06:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:16:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:16:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:16:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:16:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:16:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:16:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 06:16:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:16:21 [DEBUG   ] Finished updating board flags in 1.576 seconds
2014-03-19 06:16:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 06:16:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 06:17:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 06:17:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:17:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:17:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:17:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:17:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:17:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 06:17:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 06:17:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:17:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:17:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:17:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:17:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:17:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:17:21 [DEBUG   ] Finished updating board flags in 2.135 seconds
2014-03-19 06:17:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 06:17:43 [DEBUG   ] Got command RPT from MCS: ref #405705
2014-03-19 06:17:43 [DEBUG   ] summary = ERROR
2014-03-19 06:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405705  13 56735 22663645 A  ERRORERROR'
2014-03-19 06:17:43 [DEBUG   ] Got command RPT from MCS: ref #405706
2014-03-19 06:17:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 06:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405706  77 56735 22663646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 06:17:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 06:18:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 06:18:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:18:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:18:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:18:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:18:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:18:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 06:18:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:18:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:18:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:18:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:18:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:18:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-03-19 06:18:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:18:21 [DEBUG   ] Finished updating board flags in 1.900 seconds
2014-03-19 06:18:39 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 06:18:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 06:19:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 06:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:19:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 06:19:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:19:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:19:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:19:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:19:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:19:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 06:19:21 [DEBUG   ] Finished updating board flags in 1.809 seconds
2014-03-19 06:19:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 06:19:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 06:20:19 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 06:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:20:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 06:20:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:20:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:20:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:20:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:20:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:20:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:20:21 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:20:21 [DEBUG   ] Finished updating board flags in 1.782 seconds
2014-03-19 06:20:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 06:20:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 06:21:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 06:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:21:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2014-03-19 06:21:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 06:21:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:21:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:21:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:21:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:21:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:21:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2014-03-19 06:21:21 [DEBUG   ] Finished updating board flags in 1.627 seconds
2014-03-19 06:21:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 06:21:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 06:22:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 06:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:22:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 06:22:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:22:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:22:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:22:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:22:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:22:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:22:21 [DEBUG   ] Finished updating board flags in 1.588 seconds
2014-03-19 06:22:39 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 06:22:43 [DEBUG   ] Got command RPT from MCS: ref #405722
2014-03-19 06:22:43 [DEBUG   ] summary = ERROR
2014-03-19 06:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405722  13 56735 22963649 A  ERRORERROR'
2014-03-19 06:22:43 [DEBUG   ] Got command RPT from MCS: ref #405723
2014-03-19 06:22:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 06:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405723  77 56735 22963650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 06:23:00 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-19 06:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:23:20 [DEBUG   ] Finished updating ant stats in 1.245 seconds
2014-03-19 06:23:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 06:23:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:23:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:23:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:23:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:23:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:23:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:23:21 [DEBUG   ] Finished updating board flags in 1.394 seconds
2014-03-19 06:23:40 [DEBUG   ] Finished updating ant stats in 1.162 seconds
2014-03-19 06:24:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 06:24:20 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 06:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:24:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 06:24:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2014-03-19 06:24:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 06:24:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:24:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:24:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:24:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:24:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:24:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 06:24:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:24:21 [DEBUG   ] Finished updating board flags in 1.357 seconds
2014-03-19 06:24:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 06:25:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 06:25:20 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 06:25:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:25:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:25:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:25:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:25:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:25:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 06:25:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 06:25:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 06:25:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:25:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:25:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:25:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:25:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:25:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 06:25:22 [DEBUG   ] Finished updating board flags in 2.055 seconds
2014-03-19 06:25:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 06:26:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 06:26:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 06:26:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:26:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:26:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:26:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:26:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:26:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-03-19 06:26:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 06:26:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:26:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:26:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:26:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:26:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:26:22 [DEBUG   ] Finished updating board flags in 2.092 seconds
2014-03-19 06:26:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 06:27:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 06:27:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 06:27:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:27:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:27:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:27:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:27:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:27:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 06:27:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 06:27:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 06:27:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 06:27:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:27:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:27:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:27:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:27:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:27:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 06:27:22 [DEBUG   ] Finished updating board flags in 2.009 seconds
2014-03-19 06:27:40 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 06:27:43 [DEBUG   ] Got command RPT from MCS: ref #405739
2014-03-19 06:27:43 [DEBUG   ] summary = ERROR
2014-03-19 06:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405739  13 56735 23263657 A  ERRORERROR'
2014-03-19 06:27:43 [DEBUG   ] Got command RPT from MCS: ref #405740
2014-03-19 06:27:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 06:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405740  77 56735 23263658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 06:28:00 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-03-19 06:28:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 06:28:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:28:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:28:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:28:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:28:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:28:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 06:28:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 06:28:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 06:28:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:28:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:28:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:28:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:28:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:28:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:28:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:28:22 [DEBUG   ] Finished updating board flags in 1.912 seconds
2014-03-19 06:28:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 06:29:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 06:29:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 06:29:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:29:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:29:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:29:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:29:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:29:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2014-03-19 06:29:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-03-19 06:29:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:29:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:29:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:29:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:29:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:29:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:29:22 [DEBUG   ] Finished updating board flags in 1.790 seconds
2014-03-19 06:29:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 06:30:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 06:30:20 [DEBUG   ] Finished updating ant stats in 0.590 seconds
2014-03-19 06:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:30:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:30:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:30:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:30:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:30:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:30:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 06:30:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:30:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:30:22 [DEBUG   ] Finished updating board flags in 1.598 seconds
2014-03-19 06:30:40 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-03-19 06:31:01 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-19 06:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:31:21 [DEBUG   ] Finished updating ant stats in 1.254 seconds
2014-03-19 06:31:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 06:31:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:31:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:31:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:31:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:31:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:31:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:31:22 [DEBUG   ] Finished updating board flags in 1.401 seconds
2014-03-19 06:31:41 [DEBUG   ] Finished updating ant stats in 1.153 seconds
2014-03-19 06:32:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 06:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:32:21 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2014-03-19 06:32:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 06:32:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 06:32:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 06:32:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:32:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:32:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:32:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:32:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:32:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 06:32:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:32:22 [DEBUG   ] Finished updating board flags in 1.392 seconds
2014-03-19 06:32:41 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2014-03-19 06:32:43 [DEBUG   ] Got command RPT from MCS: ref #405756
2014-03-19 06:32:43 [DEBUG   ] summary = ERROR
2014-03-19 06:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405756  13 56735 23563657 A  ERRORERROR'
2014-03-19 06:32:43 [DEBUG   ] Got command RPT from MCS: ref #405757
2014-03-19 06:32:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 06:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405757  77 56735 23563658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 06:33:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 06:33:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 06:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:33:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 06:33:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:33:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:33:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:33:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:33:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:33:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 06:33:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:33:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:33:22 [DEBUG   ] Finished updating board flags in 1.357 seconds
2014-03-19 06:33:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 06:34:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 06:34:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 06:34:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:34:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:34:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:34:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:34:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:34:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 06:34:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:34:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:34:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:34:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:34:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:34:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:34:23 [DEBUG   ] Finished updating board flags in 2.074 seconds
2014-03-19 06:34:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 06:35:01 [DEBUG   ] Finished updating ant stats in 1.238 seconds
2014-03-19 06:35:21 [DEBUG   ] Finished updating ant stats in 0.766 seconds
2014-03-19 06:35:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:35:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:35:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:35:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:35:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:35:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 06:35:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-03-19 06:35:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 06:35:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:35:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:35:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:35:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:35:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:35:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 06:35:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:35:23 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:35:23 [DEBUG   ] Finished updating board flags in 1.983 seconds
2014-03-19 06:35:41 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-19 06:36:01 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2014-03-19 06:36:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:36:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:36:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:36:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:36:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:36:22 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-03-19 06:36:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 06:36:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-03-19 06:36:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:36:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:36:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:36:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:36:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:36:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 06:36:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:36:23 [DEBUG   ] Finished updating board flags in 1.810 seconds
2014-03-19 06:36:42 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-19 06:37:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 06:37:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:37:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:37:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:37:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:37:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:37:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 06:37:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 06:37:22 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2014-03-19 06:37:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 06:37:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:37:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:37:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:37:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:37:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:37:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:37:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:37:23 [DEBUG   ] Finished updating board flags in 1.785 seconds
2014-03-19 06:37:42 [DEBUG   ] Finished updating ant stats in 1.153 seconds
2014-03-19 06:37:43 [DEBUG   ] Got command RPT from MCS: ref #405773
2014-03-19 06:37:43 [DEBUG   ] summary = ERROR
2014-03-19 06:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405773  13 56735 23863657 A  ERRORERROR'
2014-03-19 06:37:43 [DEBUG   ] Got command RPT from MCS: ref #405774
2014-03-19 06:37:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 06:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405774  77 56735 23863658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 06:38:02 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 06:38:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:38:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:38:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:38:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:38:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:38:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 06:38:22 [DEBUG   ] Finished updating ant stats in 0.850 seconds
2014-03-19 06:38:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 06:38:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 06:38:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:38:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:38:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:38:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:38:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:38:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 06:38:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:38:23 [DEBUG   ] Finished updating board flags in 1.624 seconds
2014-03-19 06:38:42 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2014-03-19 06:39:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 06:39:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:39:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:39:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:39:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:39:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:39:22 [DEBUG   ] Finished updating ant stats in 0.651 seconds
2014-03-19 06:39:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 06:39:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:39:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:39:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:39:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:39:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:39:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:39:23 [DEBUG   ] Finished updating board flags in 1.583 seconds
2014-03-19 06:39:43 [DEBUG   ] Finished updating ant stats in 1.555 seconds
2014-03-19 06:40:02 [DEBUG   ] Finished updating ant stats in 0.750 seconds
2014-03-19 06:40:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:40:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:40:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:40:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:40:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:40:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:40:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:40:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:40:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:40:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:40:23 [DEBUG   ] Finished updating ant stats in 1.299 seconds
2014-03-19 06:40:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:40:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 06:40:23 [DEBUG   ] Finished updating board flags in 1.483 seconds
2014-03-19 06:40:43 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2014-03-19 06:41:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 06:41:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:41:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:41:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:41:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:41:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:41:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 06:41:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 06:41:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:41:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:41:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:41:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:41:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:41:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 06:41:23 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2014-03-19 06:41:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:41:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:41:23 [DEBUG   ] Finished updating board flags in 1.440 seconds
2014-03-19 06:41:43 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2014-03-19 06:42:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 06:42:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:42:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:42:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:42:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:42:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:42:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 06:42:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 06:42:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 06:42:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:42:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:42:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:42:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:42:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:42:23 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2014-03-19 06:42:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 06:42:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:42:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 06:42:23 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:42:23 [DEBUG   ] Finished updating board flags in 1.504 seconds
2014-03-19 06:42:43 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2014-03-19 06:42:43 [DEBUG   ] Got command RPT from MCS: ref #405790
2014-03-19 06:42:43 [DEBUG   ] summary = ERROR
2014-03-19 06:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405790  13 56735 24163657 A  ERRORERROR'
2014-03-19 06:42:43 [DEBUG   ] Got command RPT from MCS: ref #405791
2014-03-19 06:42:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 06:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405791  77 56735 24163658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 06:43:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-19 06:43:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:43:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:43:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:43:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:43:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:43:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 06:43:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:43:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:43:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:43:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:43:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:43:24 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-19 06:43:24 [DEBUG   ] Finished updating board flags in 2.200 seconds
2014-03-19 06:43:44 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 06:44:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 06:44:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:44:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:44:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:44:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:44:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:44:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:44:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:44:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:44:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:44:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:44:24 [DEBUG   ] Finished updating ant stats in 1.243 seconds
2014-03-19 06:44:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:44:24 [DEBUG   ] Finished updating board flags in 2.271 seconds
2014-03-19 06:44:44 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2014-03-19 06:45:04 [DEBUG   ] Finished updating ant stats in 1.009 seconds
2014-03-19 06:45:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:45:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:45:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:45:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:45:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:45:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 06:45:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:45:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:45:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:45:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:45:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:45:24 [DEBUG   ] Finished updating ant stats in 1.037 seconds
2014-03-19 06:45:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:45:24 [DEBUG   ] Finished updating board flags in 2.183 seconds
2014-03-19 06:45:44 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2014-03-19 06:46:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 06:46:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:46:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:46:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:46:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:46:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:46:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 06:46:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:46:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:46:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:46:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:46:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:46:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 06:46:24 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2014-03-19 06:46:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:46:24 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:46:24 [DEBUG   ] Finished updating board flags in 2.015 seconds
2014-03-19 06:46:44 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2014-03-19 06:47:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 06:47:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:47:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:47:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:47:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:47:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:47:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 06:47:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:47:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:47:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:47:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:47:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:47:24 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2014-03-19 06:47:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:47:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:47:24 [DEBUG   ] Finished updating board flags in 1.986 seconds
2014-03-19 06:47:43 [DEBUG   ] Got command RPT from MCS: ref #405807
2014-03-19 06:47:43 [DEBUG   ] summary = ERROR
2014-03-19 06:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405807  13 56735 24463657 A  ERRORERROR'
2014-03-19 06:47:43 [DEBUG   ] Got command RPT from MCS: ref #405808
2014-03-19 06:47:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 06:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405808  77 56735 24463658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 06:47:44 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2014-03-19 06:48:05 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-19 06:48:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:48:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:48:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:48:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:48:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:48:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 06:48:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:48:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:48:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:48:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:48:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:48:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:48:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:48:24 [DEBUG   ] Finished updating board flags in 1.816 seconds
2014-03-19 06:48:25 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-19 06:48:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 06:49:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 06:49:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:49:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:49:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:49:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:49:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:49:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:49:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:49:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:49:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:49:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:49:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 06:49:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:49:24 [DEBUG   ] Finished updating board flags in 1.803 seconds
2014-03-19 06:49:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 06:49:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 06:50:05 [DEBUG   ] Finished updating ant stats in 1.211 seconds
2014-03-19 06:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:50:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 06:50:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 06:50:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:50:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:50:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:50:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:50:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:50:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:50:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:50:24 [DEBUG   ] Finished updating board flags in 1.834 seconds
2014-03-19 06:50:25 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2014-03-19 06:50:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 06:51:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 06:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:51:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 06:51:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 06:51:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 06:51:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:51:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:51:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:51:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:51:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:51:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:51:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:51:24 [DEBUG   ] Finished updating board flags in 1.806 seconds
2014-03-19 06:51:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 06:51:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 06:52:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 06:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:52:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 06:52:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 06:52:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:52:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:52:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:52:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:52:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:52:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 06:52:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 06:52:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:52:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:52:24 [DEBUG   ] Finished updating board flags in 1.757 seconds
2014-03-19 06:52:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 06:52:43 [DEBUG   ] Got command RPT from MCS: ref #405824
2014-03-19 06:52:43 [DEBUG   ] summary = ERROR
2014-03-19 06:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405824  13 56735 24763653 A  ERRORERROR'
2014-03-19 06:52:43 [DEBUG   ] Got command RPT from MCS: ref #405825
2014-03-19 06:52:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 06:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405825  77 56735 24763654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 06:52:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 06:53:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 06:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:53:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 06:53:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-03-19 06:53:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 06:53:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:53:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:53:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:53:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:53:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:53:24 [DEBUG   ] Finished updating board flags in 1.584 seconds
2014-03-19 06:53:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 06:53:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 06:54:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 06:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:54:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 06:54:24 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 06:54:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:54:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:54:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:54:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:54:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:54:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 06:54:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:54:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 06:54:24 [DEBUG   ] Finished updating board flags in 1.451 seconds
2014-03-19 06:54:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 06:54:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 06:55:05 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-03-19 06:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:55:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 06:55:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 06:55:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 06:55:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:55:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:55:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:55:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:55:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:55:24 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 06:55:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 06:55:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:55:24 [DEBUG   ] Finished updating board flags in 1.504 seconds
2014-03-19 06:55:25 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-19 06:55:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 06:56:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 06:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 06:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 06:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 06:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 06:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 06:56:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 06:56:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 06:56:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 06:56:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 06:56:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 06:56:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 06:56:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 06:56:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 06:56:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 06:56:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:56:24 [DEBUG   ] Finished updating board flags in 1.500 seconds
2014-03-19 06:56:25 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 06:56:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 06:57:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-03-19 06:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-03-19 06:57:25 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-03-19 06:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-03-19 06:57:25 [DEBUG   ] Finished updating board flags in 2.204 seconds
2014-03-19 06:57:43 [DEBUG   ] Got command RPT from MCS: ref #405841
2014-03-19 06:57:43 [DEBUG   ] summary = ERROR
2014-03-19 06:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405841  13 56735 25063661 A  ERRORERROR'
2014-03-19 06:57:43 [DEBUG   ] Got command RPT from MCS: ref #405842
2014-03-19 06:57:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 06:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405842  77 56735 25063662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 06:57:45 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2014-03-19 06:58:06 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-19 06:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-19 06:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-19 06:58:25 [DEBUG   ] Finished updating board flags in 2.155 seconds
2014-03-19 06:58:26 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-19 06:58:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 06:59:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 06:59:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-19 06:59:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-19 06:59:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-19 06:59:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-19 06:59:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-19 06:59:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 06:59:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 06:59:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 06:59:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-19 06:59:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-19 06:59:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-19 06:59:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-19 06:59:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-19 06:59:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 06:59:25 [DEBUG   ] Finished updating board flags in 2.022 seconds
2014-03-19 06:59:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 06:59:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 07:00:06 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2014-03-19 07:00:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-19 07:00:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-19 07:00:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-19 07:00:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-19 07:00:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-19 07:00:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 07:00:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 07:00:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 07:00:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-19 07:00:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-19 07:00:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-19 07:00:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-19 07:00:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-19 07:00:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:00:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 07:00:25 [DEBUG   ] Finished updating board flags in 1.979 seconds
2014-03-19 07:00:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 07:00:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 07:01:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 07:01:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-19 07:01:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-19 07:01:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-19 07:01:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-19 07:01:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-19 07:01:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 07:01:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-19 07:01:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-19 07:01:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-19 07:01:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-19 07:01:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-19 07:01:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 07:01:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:01:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 07:01:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:01:25 [DEBUG   ] Finished updating board flags in 1.819 seconds
2014-03-19 07:01:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 07:01:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 07:02:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 07:02:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-19 07:02:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-19 07:02:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-19 07:02:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-19 07:02:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-19 07:02:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 07:02:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-19 07:02:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-19 07:02:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-19 07:02:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-19 07:02:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-19 07:02:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:02:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:02:25 [DEBUG   ] Finished updating board flags in 1.769 seconds
2014-03-19 07:02:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 07:02:43 [DEBUG   ] Got command RPT from MCS: ref #405858
2014-03-19 07:02:43 [DEBUG   ] summary = ERROR
2014-03-19 07:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405858  13 56735 25363665 A  ERRORERROR'
2014-03-19 07:02:43 [DEBUG   ] Got command RPT from MCS: ref #405859
2014-03-19 07:02:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 07:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405859  77 56735 25363666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 07:02:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 07:03:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 07:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-19 07:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-19 07:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-19 07:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-19 07:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-19 07:03:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 07:03:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 07:03:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 07:03:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-19 07:03:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-19 07:03:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-19 07:03:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-19 07:03:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-19 07:03:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:03:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 07:03:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:03:25 [DEBUG   ] Finished updating board flags in 1.577 seconds
2014-03-19 07:03:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 07:03:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 07:04:07 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-19 07:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-19 07:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-19 07:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-19 07:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-19 07:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-19 07:04:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 07:04:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-19 07:04:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-19 07:04:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-19 07:04:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-19 07:04:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-19 07:04:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 07:04:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 07:04:25 [DEBUG   ] Finished updating board flags in 1.418 seconds
2014-03-19 07:04:27 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-19 07:04:47 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-19 07:05:07 [DEBUG   ] Finished updating ant stats in 1.212 seconds
2014-03-19 07:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-19 07:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-19 07:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-19 07:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-19 07:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-19 07:05:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 07:05:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 07:05:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 07:05:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-19 07:05:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-19 07:05:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-19 07:05:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-19 07:05:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-19 07:05:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 07:05:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:05:25 [DEBUG   ] Finished updating board flags in 1.378 seconds
2014-03-19 07:05:27 [DEBUG   ] Finished updating ant stats in 1.189 seconds
2014-03-19 07:05:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 07:06:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 07:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-19 07:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-19 07:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-19 07:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-19 07:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-19 07:06:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 07:06:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-19 07:06:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-19 07:06:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-19 07:06:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-19 07:06:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-19 07:06:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 07:06:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-03-19 07:06:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:06:25 [DEBUG   ] Finished updating board flags in 1.392 seconds
2014-03-19 07:06:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 07:06:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 07:07:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 07:07:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-19 07:07:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-19 07:07:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-19 07:07:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-19 07:07:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-19 07:07:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 07:07:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-19 07:07:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-19 07:07:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-19 07:07:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-19 07:07:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-19 07:07:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 07:07:27 [DEBUG   ] Finished updating board flags in 2.982 seconds
2014-03-19 07:07:43 [DEBUG   ] Got command RPT from MCS: ref #405875
2014-03-19 07:07:43 [DEBUG   ] summary = ERROR
2014-03-19 07:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405875  13 56735 25663665 A  ERRORERROR'
2014-03-19 07:07:43 [DEBUG   ] Got command RPT from MCS: ref #405876
2014-03-19 07:07:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 07:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405876  77 56735 25663666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 07:07:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 07:08:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 07:08:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2014-03-19 07:08:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2014-03-19 07:08:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2014-03-19 07:08:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2014-03-19 07:08:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2014-03-19 07:08:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2014-03-19 07:08:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 07:08:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2014-03-19 07:08:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2014-03-19 07:08:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2014-03-19 07:08:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2014-03-19 07:08:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2014-03-19 07:08:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 07:08:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:08:26 [DEBUG   ] Finished updating board flags in 1.969 seconds
2014-03-19 07:08:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 07:08:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 07:09:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-03-19 07:09:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 5
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-03-19 07:09:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:09:26 [DEBUG   ] Finished updating board flags in 1.843 seconds
2014-03-19 07:09:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 07:09:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 07:10:07 [DEBUG   ] Finished updating ant stats in 1.017 seconds
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-19 07:10:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-19 07:10:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:10:26 [DEBUG   ] Finished updating board flags in 1.681 seconds
2014-03-19 07:10:27 [DEBUG   ] Finished updating ant stats in 0.985 seconds
2014-03-19 07:10:47 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 07:11:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 07:11:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2014-03-19 07:11:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2014-03-19 07:11:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2014-03-19 07:11:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2014-03-19 07:11:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2014-03-19 07:11:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-03-19 07:11:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2014-03-19 07:11:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2014-03-19 07:11:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2014-03-19 07:11:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2014-03-19 07:11:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2014-03-19 07:11:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 07:11:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:11:26 [DEBUG   ] Finished updating board flags in 1.566 seconds
2014-03-19 07:11:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 07:11:48 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-19 07:12:08 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 07:12:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2014-03-19 07:12:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2014-03-19 07:12:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2014-03-19 07:12:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2014-03-19 07:12:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2014-03-19 07:12:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 07:12:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 07:12:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2014-03-19 07:12:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2014-03-19 07:12:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2014-03-19 07:12:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2014-03-19 07:12:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2014-03-19 07:12:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:12:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:12:26 [DEBUG   ] Finished updating board flags in 1.413 seconds
2014-03-19 07:12:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 07:12:43 [DEBUG   ] Got command RPT from MCS: ref #405892
2014-03-19 07:12:43 [DEBUG   ] summary = ERROR
2014-03-19 07:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405892  13 56735 25963662 A  ERRORERROR'
2014-03-19 07:12:43 [DEBUG   ] Got command RPT from MCS: ref #405893
2014-03-19 07:12:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 07:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405893  77 56735 25963662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 07:12:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 07:13:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 07:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2014-03-19 07:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2014-03-19 07:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2014-03-19 07:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2014-03-19 07:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2014-03-19 07:13:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2014-03-19 07:13:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2014-03-19 07:13:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2014-03-19 07:13:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2014-03-19 07:13:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2014-03-19 07:13:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 07:13:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-03-19 07:13:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:13:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 07:13:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:13:26 [DEBUG   ] Finished updating board flags in 1.428 seconds
2014-03-19 07:13:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 07:13:48 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 07:14:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-03-19 07:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 07:14:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-03-19 07:14:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-03-19 07:14:26 [DEBUG   ] Finished updating board flags in 1.449 seconds
2014-03-19 07:14:28 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 07:14:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 07:15:08 [DEBUG   ] Finished updating ant stats in 0.813 seconds
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-19 07:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-19 07:15:26 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:15:26 [DEBUG   ] Finished updating board flags in 1.452 seconds
2014-03-19 07:15:28 [DEBUG   ] Finished updating ant stats in 0.789 seconds
2014-03-19 07:15:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 07:16:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 07:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:16:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 07:16:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 07:16:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 07:16:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:16:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:16:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:16:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:16:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:16:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:16:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 07:16:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:16:26 [DEBUG   ] Finished updating board flags in 1.425 seconds
2014-03-19 07:16:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 07:16:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 07:17:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 07:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:17:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 07:17:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 07:17:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:17:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:17:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:17:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:17:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:17:26 [DEBUG   ] Finished updating board flags in 1.474 seconds
2014-03-19 07:17:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 07:17:43 [DEBUG   ] Got command RPT from MCS: ref #405909
2014-03-19 07:17:43 [DEBUG   ] summary = ERROR
2014-03-19 07:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405909  13 56735 26263665 A  ERRORERROR'
2014-03-19 07:17:43 [DEBUG   ] Got command RPT from MCS: ref #405910
2014-03-19 07:17:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 07:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405910  77 56735 26263666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 07:17:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-19 07:18:08 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-03-19 07:18:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:18:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:18:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:18:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:18:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:18:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 07:18:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 07:18:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 07:18:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:18:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:18:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:18:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:18:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:18:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 07:18:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:18:27 [DEBUG   ] Finished updating board flags in 2.228 seconds
2014-03-19 07:18:28 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-19 07:18:48 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-19 07:19:08 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-19 07:19:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:19:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:19:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:19:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:19:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:19:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 07:19:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:19:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:19:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:19:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:19:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:19:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 07:19:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:19:27 [DEBUG   ] Finished updating board flags in 2.261 seconds
2014-03-19 07:19:28 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-03-19 07:19:48 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-19 07:20:09 [DEBUG   ] Finished updating ant stats in 1.413 seconds
2014-03-19 07:20:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:20:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:20:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:20:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:20:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:20:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:20:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:20:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:20:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:20:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:20:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-03-19 07:20:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:20:27 [DEBUG   ] Finished updating board flags in 2.079 seconds
2014-03-19 07:20:29 [DEBUG   ] Finished updating ant stats in 1.387 seconds
2014-03-19 07:20:49 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 07:21:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 07:21:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:21:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:21:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:21:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:21:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:21:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2014-03-19 07:21:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 07:21:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 07:21:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 07:21:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:21:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:21:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:21:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:21:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:21:27 [DEBUG   ] Finished updating board flags in 2.012 seconds
2014-03-19 07:21:29 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 07:21:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 07:22:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 07:22:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:22:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:22:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:22:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:22:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:22:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-03-19 07:22:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 07:22:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:22:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:22:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:22:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:22:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:22:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 07:22:27 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:22:27 [DEBUG   ] Finished updating board flags in 2.008 seconds
2014-03-19 07:22:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 07:22:43 [DEBUG   ] Got command RPT from MCS: ref #405926
2014-03-19 07:22:43 [DEBUG   ] summary = ERROR
2014-03-19 07:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405926  13 56735 26563665 A  ERRORERROR'
2014-03-19 07:22:43 [DEBUG   ] Got command RPT from MCS: ref #405927
2014-03-19 07:22:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 07:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405927  77 56735 26563666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 07:22:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 07:23:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 07:23:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:23:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:23:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:23:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:23:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:23:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 07:23:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 07:23:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 07:23:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:23:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:23:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:23:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:23:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:23:27 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 07:23:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:23:27 [DEBUG   ] Finished updating board flags in 1.984 seconds
2014-03-19 07:23:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 07:23:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 07:24:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 07:24:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:24:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:24:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:24:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:24:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:24:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2014-03-19 07:24:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:24:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:24:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:24:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:24:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:24:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 07:24:27 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:24:27 [DEBUG   ] Finished updating board flags in 1.806 seconds
2014-03-19 07:24:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 07:24:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 07:25:09 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2014-03-19 07:25:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:25:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:25:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:25:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:25:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:25:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 07:25:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 07:25:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 07:25:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 07:25:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:25:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:25:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:25:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:25:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:25:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:25:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 07:25:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:25:27 [DEBUG   ] Finished updating board flags in 1.809 seconds
2014-03-19 07:25:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 07:25:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 07:26:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 07:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:26:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 07:26:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 07:26:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:26:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:26:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:26:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:26:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:26:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 07:26:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 07:26:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:26:27 [DEBUG   ] Finished updating board flags in 1.782 seconds
2014-03-19 07:26:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 07:26:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 07:27:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 07:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:27:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 07:27:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:27:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:27:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:27:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:27:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:27:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:27:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 07:27:27 [DEBUG   ] Finished updating board flags in 1.708 seconds
2014-03-19 07:27:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 07:27:43 [DEBUG   ] Got command RPT from MCS: ref #405943
2014-03-19 07:27:43 [DEBUG   ] summary = ERROR
2014-03-19 07:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405943  13 56735 26863666 A  ERRORERROR'
2014-03-19 07:27:43 [DEBUG   ] Got command RPT from MCS: ref #405944
2014-03-19 07:27:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 07:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405944  77 56735 26863666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 07:27:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 07:28:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 07:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:28:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 07:28:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:28:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:28:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:28:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:28:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:28:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 07:28:27 [DEBUG   ] Finished updating board flags in 1.492 seconds
2014-03-19 07:28:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 07:28:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 07:29:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 07:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:29:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 07:29:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 07:29:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:29:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:29:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:29:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:29:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:29:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:29:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:29:27 [DEBUG   ] Finished updating board flags in 1.482 seconds
2014-03-19 07:29:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 07:29:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 07:30:09 [DEBUG   ] Finished updating ant stats in 0.613 seconds
2014-03-19 07:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:30:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 07:30:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:30:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:30:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:30:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:30:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:30:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 07:30:27 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:30:27 [DEBUG   ] Finished updating board flags in 1.503 seconds
2014-03-19 07:30:29 [DEBUG   ] Finished updating ant stats in 0.592 seconds
2014-03-19 07:30:50 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-19 07:31:10 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-19 07:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:31:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 07:31:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 07:31:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:31:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:31:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:31:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:31:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:31:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:31:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:31:27 [DEBUG   ] Finished updating board flags in 1.502 seconds
2014-03-19 07:31:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 07:31:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 07:32:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 07:32:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:32:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:32:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:32:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:32:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:32:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 07:32:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 07:32:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 07:32:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:32:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:32:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:32:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:32:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:32:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 07:32:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:32:28 [DEBUG   ] Finished updating board flags in 2.150 seconds
2014-03-19 07:32:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 07:32:43 [DEBUG   ] Got command RPT from MCS: ref #405960
2014-03-19 07:32:43 [DEBUG   ] summary = ERROR
2014-03-19 07:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405960  13 56735 27163665 A  ERRORERROR'
2014-03-19 07:32:43 [DEBUG   ] Got command RPT from MCS: ref #405961
2014-03-19 07:32:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 07:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405961  77 56735 27163666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 07:32:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 07:33:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 07:33:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:33:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:33:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:33:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:33:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:33:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:33:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:33:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:33:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:33:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:33:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:33:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:33:28 [DEBUG   ] Finished updating board flags in 1.971 seconds
2014-03-19 07:33:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 07:33:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 07:34:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 07:34:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:34:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:34:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:34:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:34:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:34:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 07:34:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 07:34:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:34:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:34:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:34:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:34:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:34:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:34:28 [DEBUG   ] Finished updating board flags in 1.911 seconds
2014-03-19 07:34:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 07:34:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 07:35:10 [DEBUG   ] Finished updating ant stats in 1.214 seconds
2014-03-19 07:35:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:35:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:35:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:35:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:35:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:35:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:35:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:35:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:35:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:35:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:35:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:35:28 [DEBUG   ] Finished updating board flags in 1.693 seconds
2014-03-19 07:35:30 [DEBUG   ] Finished updating ant stats in 1.192 seconds
2014-03-19 07:35:50 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-19 07:36:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 07:36:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:36:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:36:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:36:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:36:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:36:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 07:36:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 07:36:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:36:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:36:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:36:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:36:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:36:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:36:28 [DEBUG   ] Finished updating board flags in 1.621 seconds
2014-03-19 07:36:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 07:36:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 07:37:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:37:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:37:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:37:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:37:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:37:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:37:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-03-19 07:37:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:37:28 [CRITICAL] MGT underflow detected on beam(s) 1
2014-03-19 07:37:28 [DEBUG   ] Finished updating board flags in 1.574 seconds
2014-03-19 07:37:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 07:37:43 [DEBUG   ] Got command RPT from MCS: ref #405977
2014-03-19 07:37:43 [DEBUG   ] summary = ERROR
2014-03-19 07:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405977  13 56735 27463673 A  ERRORERROR'
2014-03-19 07:37:43 [DEBUG   ] Got command RPT from MCS: ref #405978
2014-03-19 07:37:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 07:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405978  77 56735 27463674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 07:37:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 07:38:10 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 07:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:38:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 07:38:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:38:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:38:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:38:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:38:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:38:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:38:28 [DEBUG   ] Finished updating board flags in 1.426 seconds
2014-03-19 07:38:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 07:38:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 07:39:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 07:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:39:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 07:39:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 07:39:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 07:39:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:39:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:39:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:39:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:39:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:39:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2014-03-19 07:39:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:39:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 07:39:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:39:28 [DEBUG   ] Finished updating board flags in 1.375 seconds
2014-03-19 07:39:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 07:39:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 07:40:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 07:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:40:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 07:40:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2014-03-19 07:40:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 07:40:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:40:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:40:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:40:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:40:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:40:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 07:40:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:40:28 [DEBUG   ] Finished updating board flags in 1.480 seconds
2014-03-19 07:40:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 07:40:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 07:41:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 07:41:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:41:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:41:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:41:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:41:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:41:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2014-03-19 07:41:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:41:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:41:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:41:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:41:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:41:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 07:41:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 07:41:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:41:29 [DEBUG   ] Finished updating board flags in 2.241 seconds
2014-03-19 07:41:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 07:41:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 07:42:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 07:42:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:42:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:42:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:42:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:42:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:42:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 07:42:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:42:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:42:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:42:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:42:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:42:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:42:29 [DEBUG   ] Finished updating board flags in 2.256 seconds
2014-03-19 07:42:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 07:42:43 [DEBUG   ] Got command RPT from MCS: ref #405994
2014-03-19 07:42:43 [DEBUG   ] summary = ERROR
2014-03-19 07:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405994  13 56735 27763665 A  ERRORERROR'
2014-03-19 07:42:43 [DEBUG   ] Got command RPT from MCS: ref #405995
2014-03-19 07:42:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 07:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   405995  77 56735 27763666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 07:42:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 07:43:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 07:43:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:43:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:43:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:43:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:43:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:43:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 07:43:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 07:43:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 07:43:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:43:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:43:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:43:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:43:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:43:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 07:43:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:43:29 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:43:29 [DEBUG   ] Finished updating board flags in 2.044 seconds
2014-03-19 07:43:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 07:43:50 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 07:44:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-19 07:44:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:44:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:44:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:44:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:44:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:44:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:44:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:44:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:44:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:44:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:44:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 07:44:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:44:29 [DEBUG   ] Finished updating board flags in 2.028 seconds
2014-03-19 07:44:31 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-19 07:44:51 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-19 07:45:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 07:45:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:45:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:45:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:45:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:45:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:45:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:45:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:45:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:45:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:45:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:45:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 07:45:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:45:29 [DEBUG   ] Finished updating board flags in 1.981 seconds
2014-03-19 07:45:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 07:45:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 07:46:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 07:46:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:46:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:46:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:46:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:46:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:46:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 07:46:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 07:46:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 07:46:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 07:46:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 07:46:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 07:46:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:46:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:46:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:46:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:46:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:46:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 07:46:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:46:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:46:29 [DEBUG   ] Finished updating board flags in 1.818 seconds
2014-03-19 07:46:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 07:46:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 07:47:11 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 07:47:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:47:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:47:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:47:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:47:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:47:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 07:47:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 07:47:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:47:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:47:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:47:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:47:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:47:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 07:47:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:47:29 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:47:29 [DEBUG   ] Finished updating board flags in 1.782 seconds
2014-03-19 07:47:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 07:47:43 [DEBUG   ] Got command RPT from MCS: ref #406011
2014-03-19 07:47:43 [DEBUG   ] summary = ERROR
2014-03-19 07:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406011  13 56735 28063669 A  ERRORERROR'
2014-03-19 07:47:43 [DEBUG   ] Got command RPT from MCS: ref #406012
2014-03-19 07:47:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 07:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406012  77 56735 28063670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 07:47:51 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 07:48:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 07:48:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:48:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:48:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:48:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:48:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:48:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 07:48:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:48:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:48:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:48:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:48:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:48:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:48:29 [DEBUG   ] Finished updating board flags in 1.613 seconds
2014-03-19 07:48:32 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-03-19 07:48:52 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 07:49:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 07:49:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2014-03-19 07:49:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2014-03-19 07:49:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2014-03-19 07:49:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2014-03-19 07:49:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2014-03-19 07:49:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 07:49:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2014-03-19 07:49:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2014-03-19 07:49:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2014-03-19 07:49:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2014-03-19 07:49:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2014-03-19 07:49:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 07:49:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 07:49:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 07:49:29 [DEBUG   ] Finished updating board flags in 1.582 seconds
2014-03-19 07:49:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 07:49:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 07:50:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-03-19 07:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-03-19 07:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-03-19 07:50:29 [DEBUG   ] Finished updating board flags in 1.432 seconds
2014-03-19 07:50:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 07:50:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 07:51:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-19 07:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 07:51:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-19 07:51:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:51:29 [DEBUG   ] Finished updating board flags in 1.385 seconds
2014-03-19 07:51:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 07:51:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 07:52:12 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 07:52:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 07:52:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 07:52:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 07:52:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 07:52:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 07:52:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 07:52:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 07:52:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 07:52:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 07:52:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 07:52:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:52:30 [DEBUG   ] Finished updating board flags in 2.199 seconds
2014-03-19 07:52:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 07:52:43 [DEBUG   ] Got command RPT from MCS: ref #406028
2014-03-19 07:52:43 [DEBUG   ] summary = ERROR
2014-03-19 07:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406028  13 56735 28363677 A  ERRORERROR'
2014-03-19 07:52:43 [DEBUG   ] Got command RPT from MCS: ref #406029
2014-03-19 07:52:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 07:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406029  77 56735 28363678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 07:52:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 07:53:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 07:53:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 07:53:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 07:53:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 07:53:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 07:53:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 07:53:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 07:53:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 07:53:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 07:53:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 07:53:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 07:53:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 07:53:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 07:53:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:53:30 [DEBUG   ] Finished updating board flags in 1.991 seconds
2014-03-19 07:53:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 07:53:52 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 07:54:13 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-19 07:54:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 07:54:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 07:54:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 07:54:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 07:54:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 07:54:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 07:54:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 07:54:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 07:54:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 07:54:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 07:54:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 07:54:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 07:54:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 07:54:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 07:54:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:54:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-03-19 07:54:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2014-03-19 07:54:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:54:30 [DEBUG   ] Finished updating board flags in 1.817 seconds
2014-03-19 07:54:33 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-19 07:54:53 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-03-19 07:55:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 07:55:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 07:55:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 07:55:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 07:55:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 07:55:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 07:55:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 07:55:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 07:55:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 07:55:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 07:55:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 07:55:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 07:55:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:55:30 [DEBUG   ] Finished updating board flags in 1.790 seconds
2014-03-19 07:55:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 07:55:53 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 07:56:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 07:56:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 07:56:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 07:56:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 07:56:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 07:56:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 07:56:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 07:56:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 07:56:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 07:56:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 07:56:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 07:56:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 07:56:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 07:56:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:56:30 [DEBUG   ] Finished updating board flags in 1.619 seconds
2014-03-19 07:56:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 07:56:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 07:57:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 07:57:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 07:57:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 07:57:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 07:57:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 07:57:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 07:57:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 07:57:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2014-03-19 07:57:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 07:57:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 07:57:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 07:57:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 07:57:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 07:57:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 07:57:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-03-19 07:57:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:57:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:57:30 [DEBUG   ] Finished updating board flags in 1.650 seconds
2014-03-19 07:57:33 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-19 07:57:43 [DEBUG   ] Got command RPT from MCS: ref #406045
2014-03-19 07:57:43 [DEBUG   ] summary = ERROR
2014-03-19 07:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406045  13 56735 28663669 A  ERRORERROR'
2014-03-19 07:57:43 [DEBUG   ] Got command RPT from MCS: ref #406046
2014-03-19 07:57:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 07:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406046  77 56735 28663670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 07:57:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-19 07:58:14 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-19 07:58:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 07:58:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 07:58:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 07:58:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 07:58:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 07:58:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 07:58:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 07:58:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 07:58:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 07:58:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 07:58:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 07:58:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 07:58:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:58:30 [DEBUG   ] Finished updating board flags in 1.537 seconds
2014-03-19 07:58:34 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-19 07:58:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 07:59:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 07:59:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 07:59:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 07:59:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 07:59:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 07:59:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 07:59:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 07:59:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 07:59:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 07:59:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 07:59:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 07:59:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 07:59:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 07:59:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 07:59:30 [DEBUG   ] Finished updating board flags in 1.411 seconds
2014-03-19 07:59:34 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 07:59:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 08:00:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 08:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:00:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 08:00:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:00:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:00:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:00:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:00:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:00:30 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 08:00:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 08:00:30 [DEBUG   ] Finished updating board flags in 1.390 seconds
2014-03-19 08:00:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 08:00:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 08:01:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 08:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:01:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 08:01:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 08:01:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:01:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:01:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:01:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:01:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:01:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:01:30 [DEBUG   ] Finished updating board flags in 1.391 seconds
2014-03-19 08:01:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 08:01:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 08:02:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 08:02:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:02:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:02:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:02:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:02:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:02:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 08:02:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:02:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:02:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:02:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:02:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:02:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 08:02:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 08:02:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 08:02:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 08:02:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:02:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:02:31 [DEBUG   ] Finished updating board flags in 2.057 seconds
2014-03-19 08:02:35 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-03-19 08:02:43 [DEBUG   ] Got command RPT from MCS: ref #406062
2014-03-19 08:02:43 [DEBUG   ] summary = ERROR
2014-03-19 08:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406062  13 56735 28963673 A  ERRORERROR'
2014-03-19 08:02:43 [DEBUG   ] Got command RPT from MCS: ref #406063
2014-03-19 08:02:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 08:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406063  77 56735 28963674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 08:02:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 08:03:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 08:03:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:03:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:03:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:03:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:03:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:03:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 08:03:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 08:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:03:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 08:03:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:03:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:03:31 [DEBUG   ] Finished updating board flags in 1.969 seconds
2014-03-19 08:03:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 08:03:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 08:04:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 08:04:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:04:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:04:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:04:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:04:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:04:30 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 08:04:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 08:04:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 08:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:04:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:04:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 08:04:31 [DEBUG   ] Finished updating board flags in 1.809 seconds
2014-03-19 08:04:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 08:04:55 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 08:05:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 08:05:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:05:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:05:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:05:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:05:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:05:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 08:05:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:05:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:05:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:05:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:05:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:05:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:05:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 08:05:31 [DEBUG   ] Finished updating board flags in 1.790 seconds
2014-03-19 08:05:35 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2014-03-19 08:05:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 08:06:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 08:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:06:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 08:06:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 08:06:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:06:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:06:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:06:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:06:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:06:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 08:06:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 08:06:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 08:06:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 08:06:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:06:31 [DEBUG   ] Finished updating board flags in 1.615 seconds
2014-03-19 08:06:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 08:06:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 08:07:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 08:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:07:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 08:07:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 08:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:07:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:07:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:07:31 [DEBUG   ] Finished updating board flags in 1.618 seconds
2014-03-19 08:07:35 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 08:07:43 [DEBUG   ] Got command RPT from MCS: ref #406079
2014-03-19 08:07:43 [DEBUG   ] summary = ERROR
2014-03-19 08:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406079  13 56735 29263681 A  ERRORERROR'
2014-03-19 08:07:43 [DEBUG   ] Got command RPT from MCS: ref #406080
2014-03-19 08:07:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 08:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406080  77 56735 29263682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 08:07:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 08:08:15 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 08:08:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:08:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:08:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:08:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:08:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:08:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 08:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:08:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:08:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:08:31 [DEBUG   ] Finished updating board flags in 1.611 seconds
2014-03-19 08:08:36 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2014-03-19 08:08:56 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 08:09:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 08:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:09:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 08:09:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 08:09:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:09:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:09:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:09:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:09:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:09:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:09:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:09:31 [DEBUG   ] Finished updating board flags in 1.566 seconds
2014-03-19 08:09:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 08:09:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 08:10:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 08:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:10:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 08:10:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:10:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:10:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:10:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:10:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:10:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 08:10:31 [DEBUG   ] Finished updating board flags in 1.415 seconds
2014-03-19 08:10:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 08:10:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 08:11:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 08:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:11:31 [DEBUG   ] Finished updating board flags in 1.480 seconds
2014-03-19 08:11:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 08:11:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 08:12:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 08:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:12:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 08:12:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 08:12:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2014-03-19 08:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:12:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 08:12:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:12:31 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:12:31 [DEBUG   ] Finished updating board flags in 1.479 seconds
2014-03-19 08:12:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 08:12:43 [DEBUG   ] Got command RPT from MCS: ref #406096
2014-03-19 08:12:43 [DEBUG   ] summary = ERROR
2014-03-19 08:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406096  13 56735 29563681 A  ERRORERROR'
2014-03-19 08:12:43 [DEBUG   ] Got command RPT from MCS: ref #406097
2014-03-19 08:12:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 08:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406097  77 56735 29563682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 08:12:56 [DEBUG   ] Finished updating ant stats in 0.500 seconds
2014-03-19 08:13:17 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2014-03-19 08:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:13:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 08:13:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 08:13:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:13:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:13:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:13:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:13:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:13:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:13:31 [DEBUG   ] Finished updating board flags in 1.482 seconds
2014-03-19 08:13:37 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-19 08:13:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 08:14:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 08:14:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:14:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:14:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:14:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:14:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:14:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 08:14:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:14:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:14:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:14:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:14:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:14:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:14:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-03-19 08:14:32 [DEBUG   ] Finished updating board flags in 2.236 seconds
2014-03-19 08:14:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 08:14:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 08:15:17 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2014-03-19 08:15:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:15:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:15:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:15:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:15:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:15:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 08:15:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 08:15:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:15:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:15:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:15:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:15:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:15:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 08:15:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:15:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:15:32 [DEBUG   ] Finished updating board flags in 2.155 seconds
2014-03-19 08:15:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 08:15:57 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 08:16:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-19 08:16:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:16:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:16:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:16:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:16:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:16:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 08:16:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 08:16:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:16:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:16:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:16:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:16:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:16:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:16:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 08:16:32 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:16:32 [DEBUG   ] Finished updating board flags in 1.974 seconds
2014-03-19 08:16:38 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-19 08:16:58 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-19 08:17:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 08:17:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:17:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:17:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:17:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:17:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:17:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 08:17:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 08:17:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 08:17:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 08:17:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 08:17:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 08:17:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 08:17:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:17:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:17:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:17:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:17:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:17:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 08:17:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:17:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:17:32 [DEBUG   ] Finished updating board flags in 1.809 seconds
2014-03-19 08:17:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 08:17:43 [DEBUG   ] Got command RPT from MCS: ref #406113
2014-03-19 08:17:43 [DEBUG   ] summary = ERROR
2014-03-19 08:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406113  13 56735 29863677 A  ERRORERROR'
2014-03-19 08:17:43 [DEBUG   ] Got command RPT from MCS: ref #406114
2014-03-19 08:17:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 08:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406114  77 56735 29863678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 08:17:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 08:18:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 08:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:18:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 08:18:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:18:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:18:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:18:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:18:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:18:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:18:32 [DEBUG   ] Finished updating board flags in 1.793 seconds
2014-03-19 08:18:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 08:18:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 08:19:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 08:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:19:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 08:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:19:32 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:19:32 [DEBUG   ] Finished updating board flags in 1.616 seconds
2014-03-19 08:19:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 08:19:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 08:20:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 08:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:20:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 08:20:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 08:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:20:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 08:20:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 08:20:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 08:20:32 [DEBUG   ] Finished updating board flags in 1.725 seconds
2014-03-19 08:20:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 08:20:59 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-19 08:21:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 08:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:21:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:21:32 [DEBUG   ] Finished updating board flags in 1.454 seconds
2014-03-19 08:21:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 08:21:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 08:22:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 08:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:22:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 08:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:22:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 08:22:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:22:32 [DEBUG   ] Finished updating board flags in 1.409 seconds
2014-03-19 08:22:39 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 08:22:43 [DEBUG   ] Got command RPT from MCS: ref #406130
2014-03-19 08:22:43 [DEBUG   ] summary = ERROR
2014-03-19 08:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406130  13 56735 30163677 A  ERRORERROR'
2014-03-19 08:22:43 [DEBUG   ] Got command RPT from MCS: ref #406131
2014-03-19 08:22:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 08:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406131  77 56735 30163678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 08:22:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 08:23:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 08:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:23:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 08:23:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 08:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:23:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 08:23:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:23:32 [DEBUG   ] Finished updating board flags in 1.387 seconds
2014-03-19 08:23:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 08:23:59 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 08:24:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 08:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:24:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 08:24:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 08:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:24:32 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 08:24:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 08:24:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:24:32 [DEBUG   ] Finished updating board flags in 1.403 seconds
2014-03-19 08:24:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 08:24:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 08:25:19 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 08:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:25:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 08:25:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:25:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:25:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:25:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:25:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:25:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 08:25:32 [DEBUG   ] Finished updating board flags in 1.328 seconds
2014-03-19 08:25:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 08:25:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 08:26:19 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-19 08:26:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:26:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:26:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:26:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:26:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:26:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 08:26:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:26:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:26:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:26:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:26:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:26:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 08:26:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 08:26:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:26:33 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:26:33 [DEBUG   ] Finished updating board flags in 2.095 seconds
2014-03-19 08:26:39 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2014-03-19 08:27:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 08:27:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 08:27:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:27:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:27:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:27:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:27:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:27:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 08:27:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 08:27:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:27:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:27:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:27:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:27:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:27:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:27:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:27:33 [DEBUG   ] Finished updating board flags in 1.985 seconds
2014-03-19 08:27:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 08:27:43 [DEBUG   ] Got command RPT from MCS: ref #406147
2014-03-19 08:27:43 [DEBUG   ] summary = ERROR
2014-03-19 08:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406147  13 56735 30463677 A  ERRORERROR'
2014-03-19 08:27:43 [DEBUG   ] Got command RPT from MCS: ref #406148
2014-03-19 08:27:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 08:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406148  77 56735 30463678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 08:28:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 08:28:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 08:28:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:28:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:28:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:28:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:28:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:28:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 08:28:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 08:28:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 08:28:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:28:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:28:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:28:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:28:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:28:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 08:28:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:28:33 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:28:33 [DEBUG   ] Finished updating board flags in 1.822 seconds
2014-03-19 08:28:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 08:29:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 08:29:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 08:29:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:29:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:29:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:29:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:29:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:29:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2014-03-19 08:29:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 08:29:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:29:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:29:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:29:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:29:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:29:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-03-19 08:29:33 [CRITICAL] MGT underflow detected on beam(s) 1
2014-03-19 08:29:33 [DEBUG   ] Finished updating board flags in 1.816 seconds
2014-03-19 08:29:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 08:30:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 08:30:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 08:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:30:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 08:30:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:30:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:30:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:30:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:30:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:30:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 08:30:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:30:33 [DEBUG   ] Finished updating board flags in 1.896 seconds
2014-03-19 08:30:40 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-19 08:31:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 08:31:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 08:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:31:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 08:31:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 08:31:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:31:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:31:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:31:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:31:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:31:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:31:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 08:31:33 [DEBUG   ] Finished updating board flags in 1.680 seconds
2014-03-19 08:31:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 08:32:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 08:32:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 08:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:32:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 08:32:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 08:32:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 08:32:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 08:32:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:32:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:32:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:32:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:32:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:32:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:32:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 08:32:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:32:33 [DEBUG   ] Finished updating board flags in 1.614 seconds
2014-03-19 08:32:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 08:32:43 [DEBUG   ] Got command RPT from MCS: ref #406164
2014-03-19 08:32:43 [DEBUG   ] summary = ERROR
2014-03-19 08:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406164  13 56735 30763686 A  ERRORERROR'
2014-03-19 08:32:43 [DEBUG   ] Got command RPT from MCS: ref #406165
2014-03-19 08:32:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 08:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406165  77 56735 30763686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 08:33:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 08:33:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-19 08:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:33:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 08:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:33:33 [DEBUG   ] Finished updating board flags in 1.584 seconds
2014-03-19 08:33:41 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-19 08:34:01 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 08:34:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 08:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:34:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:34:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 08:34:33 [DEBUG   ] Finished updating board flags in 1.406 seconds
2014-03-19 08:34:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 08:35:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 08:35:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 08:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:35:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 08:35:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 08:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:35:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 08:35:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:35:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:35:33 [DEBUG   ] Finished updating board flags in 1.415 seconds
2014-03-19 08:35:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 08:36:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-19 08:36:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 08:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:36:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 08:36:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:36:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:36:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:36:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:36:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:36:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 08:36:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 08:36:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:36:33 [DEBUG   ] Finished updating board flags in 1.417 seconds
2014-03-19 08:36:41 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 08:37:02 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-19 08:37:22 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 08:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:37:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 08:37:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 08:37:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 08:37:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:37:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:37:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:37:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:37:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:37:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:37:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 08:37:33 [DEBUG   ] Finished updating board flags in 1.418 seconds
2014-03-19 08:37:42 [DEBUG   ] Finished updating ant stats in 1.193 seconds
2014-03-19 08:37:43 [DEBUG   ] Got command RPT from MCS: ref #406181
2014-03-19 08:37:43 [DEBUG   ] summary = ERROR
2014-03-19 08:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406181  13 56735 31063689 A  ERRORERROR'
2014-03-19 08:37:43 [DEBUG   ] Got command RPT from MCS: ref #406182
2014-03-19 08:37:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 08:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406182  77 56735 31063690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 08:38:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 08:38:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 08:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:38:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 08:38:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 08:38:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:38:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:38:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:38:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:38:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:38:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-19 08:38:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:38:33 [DEBUG   ] Finished updating board flags in 1.411 seconds
2014-03-19 08:38:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 08:39:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 08:39:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 08:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:39:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:39:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:39:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:39:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:39:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:39:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 08:39:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:39:33 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:39:33 [DEBUG   ] Finished updating board flags in 1.422 seconds
2014-03-19 08:39:42 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 08:40:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 08:40:22 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 08:40:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:40:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:40:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:40:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:40:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:40:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 4
2014-03-19 08:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 08:40:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:40:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:40:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:40:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:40:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:40:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 08:40:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:40:33 [DEBUG   ] Finished updating board flags in 1.429 seconds
2014-03-19 08:40:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 08:41:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 08:41:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 08:41:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:41:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:41:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:41:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:41:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:41:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 08:41:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 08:41:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 08:41:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 08:41:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:41:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:41:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:41:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:41:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:41:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 08:41:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:41:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 08:41:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:41:33 [DEBUG   ] Finished updating board flags in 1.428 seconds
2014-03-19 08:41:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 08:42:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 08:42:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 08:42:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:42:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:42:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:42:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:42:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:42:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 08:42:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 08:42:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 08:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:42:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-03-19 08:42:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:42:33 [DEBUG   ] Finished updating board flags in 1.425 seconds
2014-03-19 08:42:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 08:42:43 [DEBUG   ] Got command RPT from MCS: ref #406198
2014-03-19 08:42:43 [DEBUG   ] summary = ERROR
2014-03-19 08:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406198  13 56735 31363685 A  ERRORERROR'
2014-03-19 08:42:43 [DEBUG   ] Got command RPT from MCS: ref #406199
2014-03-19 08:42:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 08:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406199  77 56735 31363686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 08:43:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 08:43:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 08:43:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:43:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:43:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:43:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:43:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:43:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 08:43:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 08:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:43:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 08:43:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:43:33 [DEBUG   ] Finished updating board flags in 1.547 seconds
2014-03-19 08:43:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 08:44:03 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-03-19 08:44:23 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-19 08:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:44:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 08:44:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 08:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:44:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:44:34 [DEBUG   ] Finished updating board flags in 2.209 seconds
2014-03-19 08:44:43 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 08:45:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 08:45:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 08:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:45:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 08:45:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-03-19 08:45:34 [DEBUG   ] Finished updating board flags in 2.107 seconds
2014-03-19 08:45:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 08:46:03 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 08:46:23 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 08:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:46:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 08:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:46:34 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 08:46:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:46:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-19 08:46:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 08:46:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:46:34 [DEBUG   ] Finished updating board flags in 2.052 seconds
2014-03-19 08:46:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 08:47:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 08:47:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 08:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:47:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-03-19 08:47:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 08:47:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 08:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:47:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 08:47:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:47:34 [DEBUG   ] Finished updating board flags in 1.953 seconds
2014-03-19 08:47:43 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 08:47:43 [DEBUG   ] Got command RPT from MCS: ref #406215
2014-03-19 08:47:43 [DEBUG   ] summary = ERROR
2014-03-19 08:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406215  13 56735 31663689 A  ERRORERROR'
2014-03-19 08:47:43 [DEBUG   ] Got command RPT from MCS: ref #406216
2014-03-19 08:47:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 08:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406216  77 56735 31663690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 08:48:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 08:48:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 08:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:48:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 08:48:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:48:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:48:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:48:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:48:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:48:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:48:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:48:34 [DEBUG   ] Finished updating board flags in 1.832 seconds
2014-03-19 08:48:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 08:49:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 08:49:23 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-19 08:49:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:49:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:49:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:49:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:49:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:49:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 08:49:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:49:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:49:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:49:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:49:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:49:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 08:49:34 [DEBUG   ] Finished updating board flags in 1.769 seconds
2014-03-19 08:49:44 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-19 08:50:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 08:50:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 08:50:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:50:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:50:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:50:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:50:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:50:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 08:50:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 08:50:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:50:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:50:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:50:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:50:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:50:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:50:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-03-19 08:50:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:50:34 [DEBUG   ] Finished updating board flags in 1.617 seconds
2014-03-19 08:50:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 08:51:04 [DEBUG   ] Finished updating ant stats in 1.188 seconds
2014-03-19 08:51:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 08:51:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:51:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:51:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:51:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:51:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:51:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 08:51:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 08:51:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 08:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:51:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:51:34 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:51:34 [DEBUG   ] Finished updating board flags in 1.584 seconds
2014-03-19 08:51:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 08:52:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 08:52:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 08:52:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:52:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:52:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:52:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:52:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:52:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 08:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:52:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:52:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:52:34 [DEBUG   ] Finished updating board flags in 1.407 seconds
2014-03-19 08:52:43 [DEBUG   ] Got command RPT from MCS: ref #406232
2014-03-19 08:52:43 [DEBUG   ] summary = ERROR
2014-03-19 08:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406232  13 56735 31963686 A  ERRORERROR'
2014-03-19 08:52:43 [DEBUG   ] Got command RPT from MCS: ref #406233
2014-03-19 08:52:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 08:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406233  77 56735 31963686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 08:52:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 08:53:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 08:53:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 08:53:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:53:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:53:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:53:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:53:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:53:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 08:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:53:34 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 08:53:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:53:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:53:34 [DEBUG   ] Finished updating board flags in 1.386 seconds
2014-03-19 08:53:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 08:54:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 08:54:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 08:54:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:54:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:54:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:54:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:54:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:54:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 08:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:54:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:54:34 [DEBUG   ] Finished updating board flags in 1.373 seconds
2014-03-19 08:54:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 08:55:05 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2014-03-19 08:55:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 08:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:55:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 08:55:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:55:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:55:35 [DEBUG   ] Finished updating board flags in 2.050 seconds
2014-03-19 08:55:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 08:56:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 08:56:25 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 08:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:56:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:56:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:56:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:56:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:56:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:56:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:56:35 [DEBUG   ] Finished updating board flags in 2.008 seconds
2014-03-19 08:56:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 08:57:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 08:57:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 08:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:57:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:57:35 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:57:35 [DEBUG   ] Finished updating board flags in 1.985 seconds
2014-03-19 08:57:43 [DEBUG   ] Got command RPT from MCS: ref #406249
2014-03-19 08:57:43 [DEBUG   ] summary = ERROR
2014-03-19 08:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406249  13 56735 32263689 A  ERRORERROR'
2014-03-19 08:57:43 [DEBUG   ] Got command RPT from MCS: ref #406250
2014-03-19 08:57:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 08:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406250  77 56735 32263690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 08:57:45 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 08:58:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 08:58:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 08:58:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:58:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:58:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:58:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:58:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:58:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 08:58:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:58:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:58:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:58:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:58:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:58:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-03-19 08:58:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:58:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 08:58:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 08:58:35 [DEBUG   ] Finished updating board flags in 1.822 seconds
2014-03-19 08:58:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 08:59:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 08:59:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 08:59:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 08:59:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 08:59:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 08:59:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 08:59:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 08:59:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 08:59:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 08:59:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 08:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 08:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 08:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 08:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 08:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 08:59:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 08:59:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 08:59:35 [DEBUG   ] Finished updating board flags in 1.777 seconds
2014-03-19 08:59:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 09:00:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 09:00:25 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 09:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:00:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 09:00:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 09:00:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 09:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:00:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 09:00:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:00:35 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:00:35 [DEBUG   ] Finished updating board flags in 1.677 seconds
2014-03-19 09:00:45 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 09:01:06 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-19 09:01:26 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-19 09:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:01:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 09:01:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 09:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:01:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 09:01:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:01:35 [DEBUG   ] Finished updating board flags in 1.530 seconds
2014-03-19 09:01:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 09:02:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 09:02:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 09:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:02:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 09:02:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 09:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:02:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 09:02:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 09:02:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 09:02:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2014-03-19 09:02:35 [DEBUG   ] Finished updating board flags in 1.412 seconds
2014-03-19 09:02:43 [DEBUG   ] Got command RPT from MCS: ref #406266
2014-03-19 09:02:43 [DEBUG   ] summary = ERROR
2014-03-19 09:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406266  13 56735 32563689 A  ERRORERROR'
2014-03-19 09:02:43 [DEBUG   ] Got command RPT from MCS: ref #406267
2014-03-19 09:02:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 09:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406267  77 56735 32563690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 09:02:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 09:03:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 09:03:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 09:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:03:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 09:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:03:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:03:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-03-19 09:03:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:03:35 [DEBUG   ] Finished updating board flags in 1.516 seconds
2014-03-19 09:03:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 09:04:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 09:04:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 09:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:04:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2014-03-19 09:04:35 [DEBUG   ] Finished updating board flags in 1.529 seconds
2014-03-19 09:04:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 09:05:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 09:05:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 09:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:05:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 09:05:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 09:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:05:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:05:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 09:05:36 [DEBUG   ] Finished updating board flags in 2.206 seconds
2014-03-19 09:05:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 09:06:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 09:06:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 09:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:06:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 09:06:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 09:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:06:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 09:06:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:06:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:06:36 [DEBUG   ] Finished updating board flags in 2.239 seconds
2014-03-19 09:06:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 09:07:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 09:07:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 09:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:07:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:07:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:07:36 [DEBUG   ] Finished updating board flags in 2.115 seconds
2014-03-19 09:07:43 [DEBUG   ] Got command RPT from MCS: ref #406283
2014-03-19 09:07:43 [DEBUG   ] summary = ERROR
2014-03-19 09:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406283  13 56735 32863697 A  ERRORERROR'
2014-03-19 09:07:43 [DEBUG   ] Got command RPT from MCS: ref #406284
2014-03-19 09:07:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 09:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406284  77 56735 32863698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 09:07:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 09:08:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 09:08:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 09:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:08:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 09:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:08:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:08:36 [DEBUG   ] Finished updating board flags in 2.025 seconds
2014-03-19 09:08:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 09:09:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 09:09:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 09:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:09:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 09:09:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 09:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:09:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:09:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:09:36 [DEBUG   ] Finished updating board flags in 1.971 seconds
2014-03-19 09:09:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 09:10:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 09:10:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 09:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:10:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 09:10:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 09:10:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 09:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:10:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 09:10:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:10:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:10:36 [DEBUG   ] Finished updating board flags in 1.831 seconds
2014-03-19 09:10:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 09:11:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 09:11:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 09:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:11:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:11:36 [DEBUG   ] Finished updating board flags in 1.775 seconds
2014-03-19 09:11:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 09:12:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 09:12:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 09:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:12:36 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 09:12:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:12:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 09:12:36 [DEBUG   ] Finished updating board flags in 1.660 seconds
2014-03-19 09:12:43 [DEBUG   ] Got command RPT from MCS: ref #406300
2014-03-19 09:12:43 [DEBUG   ] summary = ERROR
2014-03-19 09:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406300  13 56735 33163693 A  ERRORERROR'
2014-03-19 09:12:43 [DEBUG   ] Got command RPT from MCS: ref #406301
2014-03-19 09:12:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 09:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406301  77 56735 33163694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 09:12:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 09:13:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 09:13:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 09:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 09:13:36 [DEBUG   ] Finished updating board flags in 1.559 seconds
2014-03-19 09:13:46 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 09:14:06 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 09:14:27 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-19 09:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:14:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 09:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 09:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-03-19 09:14:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 09:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:14:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:14:36 [DEBUG   ] Finished updating board flags in 1.423 seconds
2014-03-19 09:14:47 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 09:15:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 09:15:27 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 09:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:15:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 09:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:15:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 09:15:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 09:15:36 [DEBUG   ] Finished updating board flags in 1.403 seconds
2014-03-19 09:15:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 09:16:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 09:16:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 09:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:16:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:16:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:16:36 [DEBUG   ] Finished updating board flags in 1.322 seconds
2014-03-19 09:16:47 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 09:17:07 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-03-19 09:17:28 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-03-19 09:17:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:17:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:17:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:17:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:17:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:17:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 09:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:17:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 09:17:36 [DEBUG   ] Finished updating board flags in 1.382 seconds
2014-03-19 09:17:43 [DEBUG   ] Got command RPT from MCS: ref #406317
2014-03-19 09:17:43 [DEBUG   ] summary = ERROR
2014-03-19 09:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406317  13 56735 33463689 A  ERRORERROR'
2014-03-19 09:17:43 [DEBUG   ] Got command RPT from MCS: ref #406318
2014-03-19 09:17:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 09:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406318  77 56735 33463690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 09:17:48 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-19 09:18:08 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-03-19 09:18:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 09:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:18:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 09:18:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 09:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:18:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 09:18:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 09:18:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:18:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:18:37 [DEBUG   ] Finished updating board flags in 2.043 seconds
2014-03-19 09:18:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 09:19:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 09:19:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 09:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:19:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 09:19:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 09:19:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 09:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:19:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2014-03-19 09:19:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 09:19:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-03-19 09:19:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:19:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:19:37 [DEBUG   ] Finished updating board flags in 1.996 seconds
2014-03-19 09:19:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 09:20:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 09:20:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 09:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:20:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 09:20:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 09:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:20:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 09:20:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:20:37 [DEBUG   ] Finished updating board flags in 1.822 seconds
2014-03-19 09:20:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 09:21:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 09:21:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 09:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:21:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:21:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:21:37 [DEBUG   ] Finished updating board flags in 1.779 seconds
2014-03-19 09:21:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 09:22:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 09:22:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 09:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:22:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 09:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:22:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:22:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 09:22:37 [DEBUG   ] Finished updating board flags in 1.634 seconds
2014-03-19 09:22:43 [DEBUG   ] Got command RPT from MCS: ref #406334
2014-03-19 09:22:43 [DEBUG   ] summary = ERROR
2014-03-19 09:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406334  13 56735 33763701 A  ERRORERROR'
2014-03-19 09:22:43 [DEBUG   ] Got command RPT from MCS: ref #406335
2014-03-19 09:22:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 09:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406335  77 56735 33763702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 09:22:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 09:23:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 09:23:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 09:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:23:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:23:37 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:23:37 [DEBUG   ] Finished updating board flags in 1.581 seconds
2014-03-19 09:23:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 09:24:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 09:24:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 09:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:24:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 09:24:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 09:24:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 09:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:24:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2014-03-19 09:24:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 09:24:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:24:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-19 09:24:37 [DEBUG   ] Finished updating board flags in 1.520 seconds
2014-03-19 09:24:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 09:25:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 09:25:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 09:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:25:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:25:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 09:25:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 09:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:25:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:25:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:25:37 [DEBUG   ] Finished updating board flags in 1.563 seconds
2014-03-19 09:25:48 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-19 09:26:09 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-19 09:26:29 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 09:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:26:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:26:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:26:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:26:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:26:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:26:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-03-19 09:26:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2014-03-19 09:26:38 [DEBUG   ] Finished updating board flags in 2.208 seconds
2014-03-19 09:26:49 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 09:27:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 09:27:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 09:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:27:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 09:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:27:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:27:38 [DEBUG   ] Finished updating board flags in 2.215 seconds
2014-03-19 09:27:43 [DEBUG   ] Got command RPT from MCS: ref #406351
2014-03-19 09:27:43 [DEBUG   ] summary = ERROR
2014-03-19 09:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406351  13 56735 34063693 A  ERRORERROR'
2014-03-19 09:27:43 [DEBUG   ] Got command RPT from MCS: ref #406352
2014-03-19 09:27:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 09:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406352  77 56735 34063694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 09:27:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 09:28:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 09:28:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 09:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:28:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 09:28:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 09:28:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 09:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:28:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 09:28:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:28:38 [DEBUG   ] Finished updating board flags in 2.091 seconds
2014-03-19 09:28:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 09:29:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 09:29:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 09:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:29:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 09:29:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 09:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:29:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:29:38 [DEBUG   ] Finished updating board flags in 2.022 seconds
2014-03-19 09:29:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 09:30:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 09:30:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 09:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:30:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 09:30:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:30:38 [DEBUG   ] Finished updating board flags in 2.008 seconds
2014-03-19 09:30:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 09:31:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 09:31:29 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 09:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:31:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-03-19 09:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:31:38 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:31:38 [DEBUG   ] Finished updating board flags in 2.007 seconds
2014-03-19 09:31:50 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-19 09:32:10 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2014-03-19 09:32:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 09:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:32:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 09:32:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 09:32:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 09:32:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:32:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:32:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:32:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:32:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:32:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 09:32:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:32:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:32:38 [DEBUG   ] Finished updating board flags in 1.975 seconds
2014-03-19 09:32:43 [DEBUG   ] Got command RPT from MCS: ref #406368
2014-03-19 09:32:43 [DEBUG   ] summary = ERROR
2014-03-19 09:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406368  13 56735 34363701 A  ERRORERROR'
2014-03-19 09:32:43 [DEBUG   ] Got command RPT from MCS: ref #406369
2014-03-19 09:32:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 09:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406369  77 56735 34363702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 09:32:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 09:33:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 09:33:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 09:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:33:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 09:33:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 09:33:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 09:33:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:33:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:33:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:33:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:33:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:33:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:33:38 [DEBUG   ] Finished updating board flags in 1.812 seconds
2014-03-19 09:33:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 09:34:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 09:34:30 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-19 09:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:34:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 09:34:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:34:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:34:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:34:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:34:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:34:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 09:34:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:34:38 [DEBUG   ] Finished updating board flags in 1.789 seconds
2014-03-19 09:34:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 09:35:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 09:35:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 09:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:35:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:35:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:35:38 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:35:38 [DEBUG   ] Finished updating board flags in 1.615 seconds
2014-03-19 09:35:50 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 09:36:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 09:36:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 09:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:36:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:36:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 09:36:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 09:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:36:38 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:36:38 [DEBUG   ] Finished updating board flags in 1.587 seconds
2014-03-19 09:36:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 09:37:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 09:37:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 09:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:37:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:37:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 09:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:37:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 09:37:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:37:38 [DEBUG   ] Finished updating board flags in 1.439 seconds
2014-03-19 09:37:43 [DEBUG   ] Got command RPT from MCS: ref #406385
2014-03-19 09:37:43 [DEBUG   ] summary = ERROR
2014-03-19 09:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406385  13 56735 34663705 A  ERRORERROR'
2014-03-19 09:37:43 [DEBUG   ] Got command RPT from MCS: ref #406386
2014-03-19 09:37:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 09:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406386  77 56735 34663706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 09:37:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 09:38:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 09:38:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 09:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:38:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:38:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 09:38:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 09:38:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 09:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:38:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 09:38:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:38:38 [DEBUG   ] Finished updating board flags in 1.559 seconds
2014-03-19 09:38:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 09:39:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 09:39:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 09:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:39:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:39:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2014-03-19 09:39:39 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:39:39 [DEBUG   ] Finished updating board flags in 1.568 seconds
2014-03-19 09:39:50 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2014-03-19 09:40:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-19 09:40:31 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-19 09:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:40:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:40:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:40:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:40:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:40:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:40:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 09:40:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:40:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:40:39 [DEBUG   ] Finished updating board flags in 2.160 seconds
2014-03-19 09:40:51 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 09:41:11 [DEBUG   ] Finished updating ant stats in 1.174 seconds
2014-03-19 09:41:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 09:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:41:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 09:41:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:41:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:41:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:41:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:41:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:41:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:41:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:41:39 [DEBUG   ] Finished updating board flags in 1.884 seconds
2014-03-19 09:41:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 09:42:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 09:42:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 09:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:42:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 09:42:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 09:42:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:42:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:42:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:42:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:42:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:42:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:42:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-19 09:42:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 09:42:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:42:39 [DEBUG   ] Finished updating board flags in 1.830 seconds
2014-03-19 09:42:43 [DEBUG   ] Got command RPT from MCS: ref #406402
2014-03-19 09:42:43 [DEBUG   ] summary = ERROR
2014-03-19 09:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406402  13 56735 34963705 A  ERRORERROR'
2014-03-19 09:42:43 [DEBUG   ] Got command RPT from MCS: ref #406403
2014-03-19 09:42:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 09:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406403  77 56735 34963706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 09:42:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 09:43:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 09:43:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 09:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:43:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 09:43:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 09:43:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:43:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:43:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:43:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:43:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:43:39 [DEBUG   ] Finished updating board flags in 1.820 seconds
2014-03-19 09:43:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 09:44:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 09:44:31 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 09:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:44:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 09:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:44:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:44:39 [DEBUG   ] Finished updating board flags in 1.757 seconds
2014-03-19 09:44:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 09:45:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 09:45:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 09:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:45:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 09:45:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 09:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:45:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 09:45:39 [DEBUG   ] Finished updating board flags in 1.572 seconds
2014-03-19 09:45:51 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 09:46:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 09:46:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 09:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:46:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 09:46:39 [DEBUG   ] Finished updating board flags in 1.381 seconds
2014-03-19 09:46:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 09:47:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 09:47:32 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-19 09:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:47:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 09:47:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 09:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:47:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:47:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 09:47:39 [DEBUG   ] Finished updating board flags in 1.370 seconds
2014-03-19 09:47:43 [DEBUG   ] Got command RPT from MCS: ref #406419
2014-03-19 09:47:43 [DEBUG   ] summary = ERROR
2014-03-19 09:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406419  13 56735 35263705 A  ERRORERROR'
2014-03-19 09:47:43 [DEBUG   ] Got command RPT from MCS: ref #406420
2014-03-19 09:47:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 09:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406420  77 56735 35263706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 09:47:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 09:48:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 09:48:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 09:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:48:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 09:48:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:48:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:48:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:48:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:48:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:48:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:48:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:48:40 [DEBUG   ] Finished updating board flags in 2.053 seconds
2014-03-19 09:48:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 09:49:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 09:49:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 09:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:49:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 09:49:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 09:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:49:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:49:40 [DEBUG   ] Finished updating board flags in 2.089 seconds
2014-03-19 09:49:52 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-19 09:50:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 09:50:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 09:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:50:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 09:50:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:50:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:50:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:50:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:50:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:50:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:50:40 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:50:40 [DEBUG   ] Finished updating board flags in 1.890 seconds
2014-03-19 09:50:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 09:51:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 09:51:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 09:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:51:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 09:51:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:51:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:51:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:51:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:51:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:51:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 09:51:40 [DEBUG   ] Finished updating board flags in 1.811 seconds
2014-03-19 09:51:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 09:52:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 09:52:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 09:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:52:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 09:52:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:52:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:52:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:52:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:52:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:52:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:52:40 [DEBUG   ] Finished updating board flags in 1.790 seconds
2014-03-19 09:52:43 [DEBUG   ] Got command RPT from MCS: ref #406436
2014-03-19 09:52:43 [DEBUG   ] summary = ERROR
2014-03-19 09:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406436  13 56735 35563717 A  ERRORERROR'
2014-03-19 09:52:43 [DEBUG   ] Got command RPT from MCS: ref #406437
2014-03-19 09:52:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 09:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406437  77 56735 35563718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 09:52:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 09:53:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 09:53:33 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-19 09:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:53:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 09:53:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:53:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:53:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:53:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:53:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:53:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:53:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 09:53:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:53:40 [DEBUG   ] Finished updating board flags in 1.616 seconds
2014-03-19 09:53:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 09:54:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 09:54:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 09:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:54:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:54:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:54:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:54:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:54:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:54:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2014-03-19 09:54:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:54:40 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:54:40 [DEBUG   ] Finished updating board flags in 1.591 seconds
2014-03-19 09:54:53 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2014-03-19 09:55:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 09:55:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 09:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:55:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:55:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:55:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:55:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:55:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:55:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 09:55:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:55:40 [DEBUG   ] Finished updating board flags in 1.419 seconds
2014-03-19 09:55:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 09:56:14 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-19 09:56:34 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 09:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:56:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 09:56:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:56:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:56:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:56:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:56:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:56:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 09:56:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 09:56:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:56:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:56:40 [DEBUG   ] Finished updating board flags in 1.389 seconds
2014-03-19 09:56:54 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 09:57:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 09:57:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 09:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:57:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 09:57:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 09:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:57:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:57:40 [DEBUG   ] Finished updating board flags in 1.367 seconds
2014-03-19 09:57:43 [DEBUG   ] Got command RPT from MCS: ref #406453
2014-03-19 09:57:43 [DEBUG   ] summary = ERROR
2014-03-19 09:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406453  13 56735 35863705 A  ERRORERROR'
2014-03-19 09:57:43 [DEBUG   ] Got command RPT from MCS: ref #406454
2014-03-19 09:57:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 09:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406454  77 56735 35863706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 09:57:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 09:58:14 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-19 09:58:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 09:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:58:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 09:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:58:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 09:58:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 09:58:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 09:58:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 09:58:41 [DEBUG   ] Finished updating board flags in 2.049 seconds
2014-03-19 09:58:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 09:59:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 09:59:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 09:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 09:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 09:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 09:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 09:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 09:59:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 09:59:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 09:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 09:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 09:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 09:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 09:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 09:59:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 09:59:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 09:59:41 [DEBUG   ] Finished updating board flags in 1.997 seconds
2014-03-19 09:59:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 10:00:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 10:00:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 10:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 10:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 10:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 10:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 10:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 10:00:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 10:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 10:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 10:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 10:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 10:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 10:00:41 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 10:00:41 [DEBUG   ] Finished updating board flags in 1.868 seconds
2014-03-19 10:00:54 [DEBUG   ] Finished updating ant stats in 0.593 seconds
2014-03-19 10:01:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-19 10:01:35 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-19 10:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 10:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 10:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 10:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 10:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 10:01:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 10:01:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 10:01:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2014-03-19 10:01:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 10:01:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 10:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 10:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 10:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 10:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 10:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 10:01:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 10:01:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 10:01:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:01:41 [DEBUG   ] Finished updating board flags in 1.765 seconds
2014-03-19 10:01:55 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 10:02:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 10:02:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 10:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 10:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 10:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 10:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 10:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 10:02:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 10:02:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 10:02:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 10:02:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 10:02:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 10:02:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 10:02:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 10:02:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 10:02:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 10:02:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:02:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-03-19 10:02:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 10:02:41 [DEBUG   ] Finished updating board flags in 1.568 seconds
2014-03-19 10:02:43 [DEBUG   ] Got command RPT from MCS: ref #406470
2014-03-19 10:02:43 [DEBUG   ] summary = ERROR
2014-03-19 10:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406470  13 56735 36163705 A  ERRORERROR'
2014-03-19 10:02:43 [DEBUG   ] Got command RPT from MCS: ref #406471
2014-03-19 10:02:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 10:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406471  77 56735 36163706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 10:02:55 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 10:03:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 10:03:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 10:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 10:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 10:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 10:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 10:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 10:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 10:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 10:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 10:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 10:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 10:03:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 10:03:41 [DEBUG   ] Finished updating board flags in 1.418 seconds
2014-03-19 10:03:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 10:04:15 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 10:04:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 10:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 10:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 10:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 10:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 10:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 10:04:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 10:04:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 10:04:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 10:04:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 10:04:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 10:04:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 10:04:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 10:04:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 10:04:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 10:04:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:04:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 10:04:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 10:04:41 [DEBUG   ] Finished updating board flags in 1.389 seconds
2014-03-19 10:04:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:05:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 10:05:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 10:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 10:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 10:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 10:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 10:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 10:05:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 10:05:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 10:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 10:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 10:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 10:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 10:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 10:05:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:05:41 [DEBUG   ] Finished updating board flags in 1.499 seconds
2014-03-19 10:05:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 10:06:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:06:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 10:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 10:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 10:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 10:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 10:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 10:06:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 10:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 10:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 10:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 10:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 10:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 10:06:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 10:06:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 10:06:42 [DEBUG   ] Finished updating board flags in 2.368 seconds
2014-03-19 10:06:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 10:07:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 10:07:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 10:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 10:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 10:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 10:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 10:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 10:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 10:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 10:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 10:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 10:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 10:07:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:07:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 10:07:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 10:07:42 [DEBUG   ] Finished updating board flags in 1.936 seconds
2014-03-19 10:07:43 [DEBUG   ] Got command RPT from MCS: ref #406487
2014-03-19 10:07:43 [DEBUG   ] summary = ERROR
2014-03-19 10:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406487  13 56735 36463709 A  ERRORERROR'
2014-03-19 10:07:43 [DEBUG   ] Got command RPT from MCS: ref #406488
2014-03-19 10:07:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 10:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406488  77 56735 36463710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 10:07:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 10:08:15 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 10:08:35 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-03-19 10:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 10:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 10:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 10:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 10:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 10:08:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 10:08:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 10:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 10:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 10:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 10:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 10:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 10:08:42 [DEBUG   ] Finished updating board flags in 1.829 seconds
2014-03-19 10:08:56 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-19 10:09:16 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-19 10:09:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 10:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 10:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 10:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 10:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 10:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 10:09:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 10:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 10:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 10:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 10:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 10:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 10:09:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:09:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2014-03-19 10:09:42 [DEBUG   ] Finished updating board flags in 1.780 seconds
2014-03-19 10:09:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 10:10:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 10:10:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 10:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 10:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 10:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 10:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 10:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 10:10:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 10:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 10:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 10:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 10:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 10:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 10:10:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 10:10:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 10:10:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:10:43 [DEBUG   ] Finished updating board flags in 2.066 seconds
2014-03-19 10:10:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 10:11:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 10:11:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 10:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 10:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 10:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 10:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 10:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 10:11:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 10:11:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-03-19 10:11:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 10:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 10:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 10:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 10:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 10:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 10:11:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 10:11:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 10:11:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:11:42 [DEBUG   ] Finished updating board flags in 1.532 seconds
2014-03-19 10:11:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 10:12:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 10:12:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 10:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 10:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 10:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 10:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 10:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 10:12:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 10:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 10:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 10:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 10:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 10:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 10:12:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 10:12:42 [DEBUG   ] Finished updating board flags in 1.754 seconds
2014-03-19 10:12:43 [DEBUG   ] Got command RPT from MCS: ref #406504
2014-03-19 10:12:43 [DEBUG   ] summary = ERROR
2014-03-19 10:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406504  13 56735 36763705 A  ERRORERROR'
2014-03-19 10:12:43 [DEBUG   ] Got command RPT from MCS: ref #406505
2014-03-19 10:12:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 10:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406505  77 56735 36763706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 10:12:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 10:13:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 10:13:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:13:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 10:13:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 10:13:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 10:13:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 10:13:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 10:13:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 10:13:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 10:13:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 10:13:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2014-03-19 10:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 10:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 10:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 10:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 10:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 10:13:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:13:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 10:13:42 [DEBUG   ] Finished updating board flags in 1.337 seconds
2014-03-19 10:13:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 10:14:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 10:14:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 10:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 10:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 10:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 10:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 10:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 10:14:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 10:14:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 10:14:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 10:14:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 10:14:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 10:14:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 10:14:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 10:14:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 10:14:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:14:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 10:14:43 [DEBUG   ] Finished updating board flags in 2.129 seconds
2014-03-19 10:14:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 10:15:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 10:15:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 10:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 10:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 10:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 10:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 10:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 10:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 10:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 10:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 10:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 10:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 10:15:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:15:43 [DEBUG   ] Finished updating board flags in 2.063 seconds
2014-03-19 10:15:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 10:16:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 10:16:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 10:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 10:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 10:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 10:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 10:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 10:16:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 10:16:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 10:16:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 10:16:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 10:16:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 10:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 10:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 10:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 10:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 10:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 10:16:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 10:16:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 10:16:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:16:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 10:16:43 [DEBUG   ] Finished updating board flags in 1.949 seconds
2014-03-19 10:16:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 10:17:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 10:17:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 10:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 10:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 10:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 10:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 10:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 10:17:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 10:17:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 10:17:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 10:17:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 10:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 10:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 10:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 10:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 10:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 10:17:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:17:43 [DEBUG   ] Finished updating board flags in 1.828 seconds
2014-03-19 10:17:43 [DEBUG   ] Got command RPT from MCS: ref #406521
2014-03-19 10:17:43 [DEBUG   ] summary = ERROR
2014-03-19 10:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406521  13 56735 37063709 A  ERRORERROR'
2014-03-19 10:17:43 [DEBUG   ] Got command RPT from MCS: ref #406522
2014-03-19 10:17:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 10:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406522  77 56735 37063710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 10:17:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 10:18:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 10:18:36 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 10:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 10:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 10:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 10:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 10:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 10:18:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 10:18:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 10:18:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 10:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 10:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 10:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 10:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 10:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 10:18:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:18:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 10:18:43 [DEBUG   ] Finished updating board flags in 1.760 seconds
2014-03-19 10:18:57 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2014-03-19 10:19:17 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 10:19:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 10:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2014-03-19 10:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2014-03-19 10:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2014-03-19 10:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2014-03-19 10:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2014-03-19 10:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2014-03-19 10:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2014-03-19 10:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2014-03-19 10:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2014-03-19 10:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2014-03-19 10:19:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:19:43 [DEBUG   ] Finished updating board flags in 1.621 seconds
2014-03-19 10:19:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 10:20:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 10:20:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998921
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998921
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998921
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998921
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998921
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-03-19 10:20:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998921
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998921
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998921
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998921
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998921
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-03-19 10:20:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 10:20:43 [DEBUG   ] Finished updating board flags in 1.596 seconds
2014-03-19 10:20:57 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 10:21:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 10:21:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998921
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998921
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998921
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998921
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998921
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-19 10:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998921
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998921
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998921
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998921
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998921
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-19 10:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-19 10:21:43 [DEBUG   ] Finished updating board flags in 1.421 seconds
2014-03-19 10:21:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 10:22:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:22:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998921
2014-03-19 10:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998921
2014-03-19 10:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998921
2014-03-19 10:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998921
2014-03-19 10:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998921
2014-03-19 10:22:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 10:22:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 10:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998921
2014-03-19 10:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998921
2014-03-19 10:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998921
2014-03-19 10:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998921
2014-03-19 10:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998921
2014-03-19 10:22:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:22:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 10:22:43 [DEBUG   ] Finished updating board flags in 1.403 seconds
2014-03-19 10:22:43 [DEBUG   ] Got command RPT from MCS: ref #406538
2014-03-19 10:22:43 [DEBUG   ] summary = ERROR
2014-03-19 10:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406538  13 56735 37363705 A  ERRORERROR'
2014-03-19 10:22:43 [DEBUG   ] Got command RPT from MCS: ref #406539
2014-03-19 10:22:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 10:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406539  77 56735 37363706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 10:22:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:23:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 10:23:37 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 10:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998921
2014-03-19 10:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998921
2014-03-19 10:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998921
2014-03-19 10:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998921
2014-03-19 10:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998921
2014-03-19 10:23:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 10:23:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 10:23:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 10:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998921
2014-03-19 10:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998921
2014-03-19 10:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998921
2014-03-19 10:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998921
2014-03-19 10:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998921
2014-03-19 10:23:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:23:43 [DEBUG   ] Finished updating board flags in 1.423 seconds
2014-03-19 10:23:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 10:24:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 10:24:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 10:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998921
2014-03-19 10:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998921
2014-03-19 10:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998921
2014-03-19 10:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998921
2014-03-19 10:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998921
2014-03-19 10:24:42 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 10:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998921
2014-03-19 10:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998921
2014-03-19 10:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998921
2014-03-19 10:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998921
2014-03-19 10:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998921
2014-03-19 10:24:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 10:24:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 10:24:43 [DEBUG   ] Finished updating board flags in 1.350 seconds
2014-03-19 10:24:57 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2014-03-19 10:25:18 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-19 10:25:38 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-19 10:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998921
2014-03-19 10:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998921
2014-03-19 10:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998921
2014-03-19 10:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998921
2014-03-19 10:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998921
2014-03-19 10:25:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 10:25:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 10:25:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2014-03-19 10:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998921
2014-03-19 10:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998921
2014-03-19 10:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998921
2014-03-19 10:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998921
2014-03-19 10:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998921
2014-03-19 10:25:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:25:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 10:25:43 [DEBUG   ] Finished updating board flags in 1.364 seconds
2014-03-19 10:25:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 10:26:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 10:26:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 10:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998921
2014-03-19 10:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998921
2014-03-19 10:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998921
2014-03-19 10:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998921
2014-03-19 10:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998921
2014-03-19 10:26:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 10:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998921
2014-03-19 10:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998921
2014-03-19 10:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998921
2014-03-19 10:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998921
2014-03-19 10:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998921
2014-03-19 10:26:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 10:26:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 10:26:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:26:44 [DEBUG   ] Finished updating board flags in 2.085 seconds
2014-03-19 10:26:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 10:27:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 10:27:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998823
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998823
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998823
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998823
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998823
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000058
2014-03-19 10:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000058
2014-03-19 10:27:43 [DEBUG   ] Got command RPT from MCS: ref #406555
2014-03-19 10:27:43 [DEBUG   ] summary = ERROR
2014-03-19 10:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406555  13 56735 37663714 A  ERRORERROR'
2014-03-19 10:27:43 [DEBUG   ] Got command RPT from MCS: ref #406556
2014-03-19 10:27:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 10:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406556  77 56735 37663714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998823
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998823
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998823
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998823
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998823
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000058
2014-03-19 10:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000058
2014-03-19 10:27:44 [DEBUG   ] Finished updating board flags in 1.977 seconds
2014-03-19 10:27:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 10:28:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 10:28:38 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998823
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998823
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998823
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998823
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998823
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-19 10:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998823
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998823
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998823
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998823
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998823
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-19 10:28:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2014-03-19 10:28:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 10:28:44 [DEBUG   ] Finished updating board flags in 1.810 seconds
2014-03-19 10:28:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 10:29:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 10:29:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998725
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998725
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998725
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998725
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998725
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-03-19 10:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998725
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998725
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998725
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998725
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998725
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-03-19 10:29:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 10:29:44 [DEBUG   ] Finished updating board flags in 1.778 seconds
2014-03-19 10:29:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:30:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:30:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998725
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998725
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998725
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998725
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998725
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-19 10:30:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998725
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998725
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998725
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998725
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998725
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-19 10:30:44 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 10:30:44 [DEBUG   ] Finished updating board flags in 1.626 seconds
2014-03-19 10:30:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 10:31:18 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-03-19 10:31:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 10:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998725
2014-03-19 10:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998725
2014-03-19 10:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998725
2014-03-19 10:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998725
2014-03-19 10:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998725
2014-03-19 10:31:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 10:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998725
2014-03-19 10:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998725
2014-03-19 10:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998725
2014-03-19 10:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998725
2014-03-19 10:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998725
2014-03-19 10:31:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:31:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 10:31:44 [DEBUG   ] Finished updating board flags in 1.575 seconds
2014-03-19 10:31:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-19 10:32:18 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-19 10:32:39 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-03-19 10:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998725
2014-03-19 10:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998725
2014-03-19 10:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998725
2014-03-19 10:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998725
2014-03-19 10:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998725
2014-03-19 10:32:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 10:32:43 [DEBUG   ] Got command RPT from MCS: ref #406572
2014-03-19 10:32:43 [DEBUG   ] summary = ERROR
2014-03-19 10:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406572  13 56735 37963710 A  ERRORERROR'
2014-03-19 10:32:43 [DEBUG   ] Got command RPT from MCS: ref #406573
2014-03-19 10:32:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 10:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406573  77 56735 37963710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 10:32:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 10:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998725
2014-03-19 10:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998725
2014-03-19 10:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998725
2014-03-19 10:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998725
2014-03-19 10:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998725
2014-03-19 10:32:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:32:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2014-03-19 10:32:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 10:32:44 [DEBUG   ] Finished updating board flags in 1.411 seconds
2014-03-19 10:32:59 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 10:33:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 10:33:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 10:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998725
2014-03-19 10:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998725
2014-03-19 10:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998725
2014-03-19 10:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998725
2014-03-19 10:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998725
2014-03-19 10:33:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 10:33:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 10:33:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 10:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998725
2014-03-19 10:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998725
2014-03-19 10:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998725
2014-03-19 10:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998725
2014-03-19 10:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998725
2014-03-19 10:33:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 10:33:44 [DEBUG   ] Finished updating board flags in 1.384 seconds
2014-03-19 10:33:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 10:34:19 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 10:34:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 10:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998725
2014-03-19 10:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998725
2014-03-19 10:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998725
2014-03-19 10:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998725
2014-03-19 10:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998725
2014-03-19 10:34:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 10:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998725
2014-03-19 10:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998725
2014-03-19 10:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998725
2014-03-19 10:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998725
2014-03-19 10:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998725
2014-03-19 10:34:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 10:34:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:34:44 [DEBUG   ] Finished updating board flags in 1.461 seconds
2014-03-19 10:34:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 10:35:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 10:35:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 10:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998725
2014-03-19 10:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998725
2014-03-19 10:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998725
2014-03-19 10:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998725
2014-03-19 10:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998725
2014-03-19 10:35:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 10:35:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 10:35:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998725
2014-03-19 10:35:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998725
2014-03-19 10:35:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998725
2014-03-19 10:35:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998725
2014-03-19 10:35:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998725
2014-03-19 10:35:45 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 10:35:45 [DEBUG   ] Finished updating board flags in 2.194 seconds
2014-03-19 10:35:59 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 10:36:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:36:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 10:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998725
2014-03-19 10:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998725
2014-03-19 10:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998725
2014-03-19 10:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998725
2014-03-19 10:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998725
2014-03-19 10:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998725
2014-03-19 10:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998725
2014-03-19 10:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998725
2014-03-19 10:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998725
2014-03-19 10:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998725
2014-03-19 10:36:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:36:45 [DEBUG   ] Finished updating board flags in 1.963 seconds
2014-03-19 10:36:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 10:37:19 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 10:37:39 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 10:37:43 [DEBUG   ] Got command RPT from MCS: ref #406589
2014-03-19 10:37:43 [DEBUG   ] summary = ERROR
2014-03-19 10:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406589  13 56735 38263713 A  ERRORERROR'
2014-03-19 10:37:43 [DEBUG   ] Got command RPT from MCS: ref #406590
2014-03-19 10:37:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 10:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406590  77 56735 38263714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 10:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998725
2014-03-19 10:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998725
2014-03-19 10:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998725
2014-03-19 10:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998725
2014-03-19 10:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998725
2014-03-19 10:37:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 10:37:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2014-03-19 10:37:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2014-03-19 10:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998725
2014-03-19 10:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998725
2014-03-19 10:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998725
2014-03-19 10:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998725
2014-03-19 10:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998725
2014-03-19 10:37:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 10:37:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 10:37:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2014-03-19 10:37:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:37:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2014-03-19 10:37:45 [DEBUG   ] Finished updating board flags in 1.801 seconds
2014-03-19 10:38:00 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2014-03-19 10:38:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 10:38:40 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 10:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998725
2014-03-19 10:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998725
2014-03-19 10:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998725
2014-03-19 10:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998725
2014-03-19 10:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998725
2014-03-19 10:38:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 10:38:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 10:38:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 10:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998725
2014-03-19 10:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998725
2014-03-19 10:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998725
2014-03-19 10:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998725
2014-03-19 10:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998725
2014-03-19 10:38:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 10:38:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:38:45 [DEBUG   ] Finished updating board flags in 1.809 seconds
2014-03-19 10:39:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 10:39:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 10:39:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 10:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998725
2014-03-19 10:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998725
2014-03-19 10:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998725
2014-03-19 10:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998725
2014-03-19 10:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998725
2014-03-19 10:39:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 10:39:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2014-03-19 10:39:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 10:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998725
2014-03-19 10:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998725
2014-03-19 10:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998725
2014-03-19 10:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998725
2014-03-19 10:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998725
2014-03-19 10:39:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:39:45 [DEBUG   ] Finished updating board flags in 1.781 seconds
2014-03-19 10:40:00 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2014-03-19 10:40:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 10:40:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 10:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998725
2014-03-19 10:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998725
2014-03-19 10:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998725
2014-03-19 10:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998725
2014-03-19 10:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998725
2014-03-19 10:40:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 10:40:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 10:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998725
2014-03-19 10:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998725
2014-03-19 10:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998725
2014-03-19 10:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998725
2014-03-19 10:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998725
2014-03-19 10:40:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:40:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 10:40:45 [DEBUG   ] Finished updating board flags in 1.617 seconds
2014-03-19 10:41:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 10:41:21 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-03-19 10:41:41 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 10:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998725
2014-03-19 10:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998725
2014-03-19 10:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998725
2014-03-19 10:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998725
2014-03-19 10:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998725
2014-03-19 10:41:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2014-03-19 10:41:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2014-03-19 10:41:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 10:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998725
2014-03-19 10:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998725
2014-03-19 10:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998725
2014-03-19 10:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998725
2014-03-19 10:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998725
2014-03-19 10:41:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 10:41:45 [DEBUG   ] Finished updating board flags in 1.610 seconds
2014-03-19 10:42:01 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 10:42:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 10:42:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 10:42:43 [DEBUG   ] Got command RPT from MCS: ref #406606
2014-03-19 10:42:43 [DEBUG   ] summary = ERROR
2014-03-19 10:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406606  13 56735 38563713 A  ERRORERROR'
2014-03-19 10:42:43 [DEBUG   ] Got command RPT from MCS: ref #406607
2014-03-19 10:42:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 10:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406607  77 56735 38563714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 10:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998725
2014-03-19 10:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998725
2014-03-19 10:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998725
2014-03-19 10:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998725
2014-03-19 10:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998725
2014-03-19 10:42:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 10:42:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2014-03-19 10:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998725
2014-03-19 10:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998725
2014-03-19 10:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998725
2014-03-19 10:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998725
2014-03-19 10:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998725
2014-03-19 10:42:45 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 10:42:45 [DEBUG   ] Finished updating board flags in 1.585 seconds
2014-03-19 10:43:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 10:43:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 10:43:41 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 10:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998725
2014-03-19 10:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998725
2014-03-19 10:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998725
2014-03-19 10:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998725
2014-03-19 10:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998725
2014-03-19 10:43:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 10:43:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2014-03-19 10:43:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 10:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998725
2014-03-19 10:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998725
2014-03-19 10:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998725
2014-03-19 10:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998725
2014-03-19 10:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998725
2014-03-19 10:43:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 10:43:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:43:45 [DEBUG   ] Finished updating board flags in 1.408 seconds
2014-03-19 10:44:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 10:44:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 10:44:41 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 10:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998725
2014-03-19 10:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998725
2014-03-19 10:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998725
2014-03-19 10:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998725
2014-03-19 10:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998725
2014-03-19 10:44:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2014-03-19 10:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998725
2014-03-19 10:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998725
2014-03-19 10:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998725
2014-03-19 10:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998725
2014-03-19 10:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998725
2014-03-19 10:44:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2014-03-19 10:44:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 10:44:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:44:45 [DEBUG   ] Finished updating board flags in 1.401 seconds
2014-03-19 10:45:02 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-19 10:45:22 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 10:45:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 10:45:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998725
2014-03-19 10:45:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998725
2014-03-19 10:45:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998725
2014-03-19 10:45:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998725
2014-03-19 10:45:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998725
2014-03-19 10:45:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 10:45:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2014-03-19 10:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998725
2014-03-19 10:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998725
2014-03-19 10:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998725
2014-03-19 10:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998725
2014-03-19 10:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998725
2014-03-19 10:45:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2014-03-19 10:45:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2014-03-19 10:45:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 10:45:45 [DEBUG   ] Finished updating board flags in 1.401 seconds
2014-03-19 10:46:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 10:46:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 10:46:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 10:46:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998725
2014-03-19 10:46:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998725
2014-03-19 10:46:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998725
2014-03-19 10:46:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998725
2014-03-19 10:46:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998725
2014-03-19 10:46:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 10:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998725
2014-03-19 10:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998725
2014-03-19 10:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998725
2014-03-19 10:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998725
2014-03-19 10:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998725
2014-03-19 10:46:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2014-03-19 10:46:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 10:46:45 [DEBUG   ] Finished updating board flags in 1.460 seconds
2014-03-19 10:47:00 [DEBUG   ] Got command INI from MCS: ref #406623
2014-03-19 10:47:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2014-03-19 10:47:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   406623   8 56735 38820814 ABOOTING'
2014-03-19 10:47:02 [DEBUG   ] Finished updating ant stats in 1.235 seconds
2014-03-19 10:47:24 [INFO    ] -------------------
2014-03-19 10:47:24 [INFO    ]  LWA board status
2014-03-19 10:47:24 [INFO    ] -------------------
2014-03-19 10:47:24 [INFO    ] DP 1: 2 lwa27
2014-03-19 10:47:24 [INFO    ] DP 1: 3 lwa24
2014-03-19 10:47:24 [INFO    ] DP 1: 4 lwa23
2014-03-19 10:47:24 [INFO    ] DP 1: 5 lwa18
2014-03-19 10:47:24 [INFO    ] DP 1: 6 lwa10
2014-03-19 10:47:24 [INFO    ] DP 1: 7 lwa32
2014-03-19 10:47:24 [INFO    ] DP 1: 8 lwa11
2014-03-19 10:47:24 [INFO    ] DP 1: 9 lwa30
2014-03-19 10:47:24 [INFO    ] DP 1: 10 lwa12
2014-03-19 10:47:24 [INFO    ] DP 1: 11 lwa8
2014-03-19 10:47:24 [INFO    ] DP 1: 12 lwa13
2014-03-19 10:47:24 [INFO    ] DP 1: 13 lwa26
2014-03-19 10:47:24 [INFO    ] DP 1: 14 lwa14
2014-03-19 10:47:24 [INFO    ] DP 1: 16 lwa22
2014-03-19 10:47:24 [INFO    ] DP 1: 17 lwa20
2014-03-19 10:47:24 [INFO    ] DP 1: 18 lwa1
2014-03-19 10:47:24 [INFO    ] DP 1: 19 lwa5
2014-03-19 10:47:24 [INFO    ] DP 1: 20 lwa25
2014-03-19 10:47:24 [INFO    ] DP 1: 21 lwa35
2014-03-19 10:47:24 [INFO    ] DP 1: 22 lwa19
2014-03-19 10:47:24 [INFO    ] DP 1: 23 lwa21
2014-03-19 10:47:24 [INFO    ] DP 1: 24 lwa6
2014-03-19 10:47:24 [INFO    ] DP 1: 25 lwa7
2014-03-19 10:47:24 [INFO    ] DP 1: 26 lwa33
2014-03-19 10:47:24 [INFO    ] DP 1: 27 lwa15
2014-03-19 10:47:24 [INFO    ] DP 1: 28 lwa28
2014-03-19 10:47:24 [INFO    ] DP 2: 1 lwa16
2014-03-19 10:47:24 [INFO    ] DP 2: 15 lwa34
2014-03-19 10:47:24 [INFO    ] Total of 28 boards
2014-03-19 10:47:24 [INFO    ] Total of 260 stands
2014-03-19 10:47:24 [INFO    ] -------------------
2014-03-19 10:47:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30258
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30259
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30260
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30261
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30262
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30263
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30264
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30265
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30266
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30267
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30268
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30269
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30270
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30271
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30272
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30273
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30274
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30275
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30276
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30277
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30278
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30279
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30280
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30281
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30282
2014-03-19 10:47:31 [DEBUG   ] 2014-03-19 10:47:31 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30283
2014-03-19 10:47:43 [DEBUG   ] Got command RPT from MCS: ref #406624
2014-03-19 10:47:43 [DEBUG   ] summary = BOOTING
2014-03-19 10:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406624  15 56735 38863718 ABOOTINGBOOTING'
2014-03-19 10:47:43 [DEBUG   ] Got command RPT from MCS: ref #406625
2014-03-19 10:47:43 [DEBUG   ] info = Running INI sequence
2014-03-19 10:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406625  28 56735 38863718 ABOOTINGRunning INI sequence'
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30258 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30259 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30260 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30261 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30262 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30263 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30264 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30265 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30266 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30267 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30268 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30269 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30270 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30271 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30272 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30273 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30274 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30275 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30276 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30277 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30278 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30279 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30280 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30281 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30282 exited with status 0
2014-03-19 10:47:43 [DEBUG   ] 2014-03-19 10:47:43 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30283 exited with status 0
2014-03-19 10:47:43 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2014-03-19 10:47:43 [DEBUG   ] spawn_process: at 2014-03-19 10:47:43 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:43 [DEBUG   ] spawn_process: at 2014-03-19 10:47:43 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:43 [DEBUG   ] spawn_process: at 2014-03-19 10:47:43 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:43 [DEBUG   ] spawn_process: at 2014-03-19 10:47:43 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:43 [DEBUG   ] spawn_process: at 2014-03-19 10:47:43 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:43 [DEBUG   ] spawn_process: at 2014-03-19 10:47:43 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:43 [DEBUG   ] spawn_process: at 2014-03-19 10:47:43 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:43 [DEBUG   ] spawn_process: at 2014-03-19 10:47:43 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:43 [DEBUG   ] spawn_process: at 2014-03-19 10:47:43 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:43 [DEBUG   ] spawn_process: at 2014-03-19 10:47:43 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:43 [DEBUG   ] spawn_process: at 2014-03-19 10:47:43 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:43 [DEBUG   ] spawn_process: at 2014-03-19 10:47:43 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:43 [DEBUG   ] spawn_process: at 2014-03-19 10:47:43 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:44 [DEBUG   ] spawn_process: at 2014-03-19 10:47:43 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:44 [DEBUG   ] spawn_process: at 2014-03-19 10:47:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:44 [DEBUG   ] spawn_process: at 2014-03-19 10:47:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:44 [DEBUG   ] spawn_process: at 2014-03-19 10:47:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:44 [DEBUG   ] spawn_process: at 2014-03-19 10:47:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:44 [DEBUG   ] spawn_process: at 2014-03-19 10:47:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:44 [DEBUG   ] spawn_process: at 2014-03-19 10:47:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:44 [DEBUG   ] spawn_process: at 2014-03-19 10:47:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:44 [DEBUG   ] spawn_process: at 2014-03-19 10:47:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:44 [DEBUG   ] spawn_process: at 2014-03-19 10:47:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:44 [DEBUG   ] spawn_process: at 2014-03-19 10:47:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:44 [DEBUG   ] spawn_process: at 2014-03-19 10:47:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:44 [DEBUG   ] spawn_process: at 2014-03-19 10:47:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2014-03-19 10:47:44 [DEBUG   ] 2014-03-19 10:47:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 30310
2014-03-19 10:47:44 [DEBUG   ] 2014-03-19 10:47:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 30311
2014-03-19 10:47:49 [DEBUG   ] 2014-03-19 10:47:49 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 30310 exited with status 0
2014-03-19 10:47:49 [DEBUG   ] 2014-03-19 10:47:49 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 30311 exited with status 0
2014-03-19 10:47:49 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2014-03-19 10:47:49 [DEBUG   ] spawn_process: at 2014-03-19 10:47:49 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2014-03-19 10:47:49 [DEBUG   ] spawn_process: at 2014-03-19 10:47:49 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2014-03-19 10:47:49 [INFO    ] Setting Beam 1 xbars
2014-03-19 10:47:49 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2014-03-19 10:47:49 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2014-03-19 10:47:49 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2014-03-19 10:47:49 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2014-03-19 10:47:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2014-03-19 10:47:50 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2014-03-19 10:47:50 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2014-03-19 10:47:50 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2014-03-19 10:47:50 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2014-03-19 10:47:50 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2014-03-19 10:47:50 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2014-03-19 10:47:50 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2014-03-19 10:47:50 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2014-03-19 10:47:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2014-03-19 10:47:51 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2014-03-19 10:47:51 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2014-03-19 10:47:51 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2014-03-19 10:47:51 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2014-03-19 10:47:51 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2014-03-19 10:47:51 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2014-03-19 10:47:51 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2014-03-19 10:47:51 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2014-03-19 10:47:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2014-03-19 10:47:52 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2014-03-19 10:47:52 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2014-03-19 10:47:52 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2014-03-19 10:47:52 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2014-03-19 10:47:52 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2014-03-19 10:47:52 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2014-03-19 10:47:52 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2014-03-19 10:47:52 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2014-03-19 10:47:53 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2014-03-19 10:47:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2014-03-19 10:47:53 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2014-03-19 10:47:53 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2014-03-19 10:47:53 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2014-03-19 10:47:53 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2014-03-19 10:47:53 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2014-03-19 10:47:53 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2014-03-19 10:47:53 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2014-03-19 10:47:54 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2014-03-19 10:47:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2014-03-19 10:47:54 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2014-03-19 10:47:54 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2014-03-19 10:47:54 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2014-03-19 10:47:54 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2014-03-19 10:47:54 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2014-03-19 10:47:54 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2014-03-19 10:47:54 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2014-03-19 10:47:54 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2014-03-19 10:47:55 [INFO    ] Setting Beam 2 xbars
2014-03-19 10:47:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2014-03-19 10:47:55 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2014-03-19 10:47:55 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2014-03-19 10:47:55 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2014-03-19 10:47:55 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2014-03-19 10:47:55 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2014-03-19 10:47:55 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2014-03-19 10:47:55 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2014-03-19 10:47:55 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2014-03-19 10:47:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2014-03-19 10:47:56 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2014-03-19 10:47:56 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2014-03-19 10:47:56 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2014-03-19 10:47:56 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2014-03-19 10:47:56 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2014-03-19 10:47:56 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2014-03-19 10:47:56 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2014-03-19 10:47:56 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2014-03-19 10:47:57 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2014-03-19 10:47:57 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2014-03-19 10:47:57 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2014-03-19 10:47:57 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2014-03-19 10:47:57 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2014-03-19 10:47:57 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2014-03-19 10:47:57 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2014-03-19 10:47:57 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2014-03-19 10:47:57 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2014-03-19 10:47:58 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2014-03-19 10:47:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2014-03-19 10:47:58 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2014-03-19 10:47:58 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2014-03-19 10:47:58 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2014-03-19 10:47:58 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2014-03-19 10:47:58 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2014-03-19 10:47:58 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2014-03-19 10:47:58 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2014-03-19 10:47:58 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2014-03-19 10:47:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2014-03-19 10:47:59 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2014-03-19 10:47:59 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2014-03-19 10:47:59 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2014-03-19 10:47:59 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2014-03-19 10:47:59 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2014-03-19 10:47:59 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2014-03-19 10:47:59 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2014-03-19 10:47:59 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2014-03-19 10:48:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2014-03-19 10:48:00 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2014-03-19 10:48:00 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2014-03-19 10:48:00 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2014-03-19 10:48:00 [INFO    ] Setting Beam 3 xbars
2014-03-19 10:48:00 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2014-03-19 10:48:00 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2014-03-19 10:48:00 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2014-03-19 10:48:00 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2014-03-19 10:48:00 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2014-03-19 10:48:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2014-03-19 10:48:01 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2014-03-19 10:48:01 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2014-03-19 10:48:01 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2014-03-19 10:48:01 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2014-03-19 10:48:01 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2014-03-19 10:48:01 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2014-03-19 10:48:01 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2014-03-19 10:48:01 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2014-03-19 10:48:02 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2014-03-19 10:48:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2014-03-19 10:48:02 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2014-03-19 10:48:02 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2014-03-19 10:48:02 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2014-03-19 10:48:02 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2014-03-19 10:48:02 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2014-03-19 10:48:02 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2014-03-19 10:48:02 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2014-03-19 10:48:03 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2014-03-19 10:48:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2014-03-19 10:48:03 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2014-03-19 10:48:03 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2014-03-19 10:48:03 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2014-03-19 10:48:03 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2014-03-19 10:48:03 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2014-03-19 10:48:03 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2014-03-19 10:48:03 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2014-03-19 10:48:03 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2014-03-19 10:48:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2014-03-19 10:48:04 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2014-03-19 10:48:04 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2014-03-19 10:48:04 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2014-03-19 10:48:04 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2014-03-19 10:48:04 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2014-03-19 10:48:04 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2014-03-19 10:48:04 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2014-03-19 10:48:04 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2014-03-19 10:48:05 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2014-03-19 10:48:05 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2014-03-19 10:48:05 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2014-03-19 10:48:05 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2014-03-19 10:48:05 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2014-03-19 10:48:05 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2014-03-19 10:48:05 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2014-03-19 10:48:05 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2014-03-19 10:48:05 [INFO    ] Setting Beam 4 xbars
2014-03-19 10:48:05 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2014-03-19 10:48:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2014-03-19 10:48:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2014-03-19 10:48:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2014-03-19 10:48:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2014-03-19 10:48:06 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2014-03-19 10:48:06 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2014-03-19 10:48:06 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2014-03-19 10:48:06 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2014-03-19 10:48:06 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2014-03-19 10:48:07 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2014-03-19 10:48:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2014-03-19 10:48:07 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2014-03-19 10:48:07 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2014-03-19 10:48:07 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2014-03-19 10:48:07 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2014-03-19 10:48:07 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2014-03-19 10:48:07 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2014-03-19 10:48:07 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2014-03-19 10:48:08 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2014-03-19 10:48:08 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2014-03-19 10:48:08 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2014-03-19 10:48:08 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2014-03-19 10:48:08 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2014-03-19 10:48:08 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2014-03-19 10:48:08 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2014-03-19 10:48:08 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2014-03-19 10:48:08 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2014-03-19 10:48:09 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2014-03-19 10:48:09 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2014-03-19 10:48:09 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2014-03-19 10:48:09 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2014-03-19 10:48:09 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2014-03-19 10:48:09 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2014-03-19 10:48:09 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2014-03-19 10:48:09 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2014-03-19 10:48:09 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2014-03-19 10:48:09 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2014-03-19 10:48:10 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2014-03-19 10:48:10 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2014-03-19 10:48:10 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2014-03-19 10:48:10 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2014-03-19 10:48:10 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2014-03-19 10:48:10 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2014-03-19 10:48:10 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2014-03-19 10:48:10 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2014-03-19 10:48:10 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2014-03-19 10:48:11 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2014-03-19 10:48:11 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2014-03-19 10:48:11 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2014-03-19 10:48:11 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2014-03-19 10:48:11 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2014-03-19 10:48:11 [INFO    ] All xbars set
2014-03-19 10:48:11 [INFO    ] Setting adder chain routing for all beams
2014-03-19 10:48:16 [INFO    ] Setting beam ids
2014-03-19 10:48:26 [INFO    ] Starting beam delay calibration
2014-03-19 10:48:38 [INFO    ] Beam 1 latency is 5710
2014-03-19 10:48:38 [INFO    ] Beam 2 latency is 5782
2014-03-19 10:48:38 [INFO    ] Beam 3 latency is 5757
2014-03-19 10:48:38 [INFO    ] Beam 4 latency is 5707
2014-03-19 10:48:38 [INFO    ] Stop calibration
2014-03-19 10:48:46 [INFO    ] Beam delay calibration successful
2014-03-19 10:48:46 [INFO    ] Calibration passed
2014-03-19 10:48:46 [DEBUG   ] spawn_process: at 2014-03-19 10:48:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2014-03-19 10:48:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2014-03-19 10:48:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2014-03-19 10:48:46 [DEBUG   ] spawn_process: at 2014-03-19 10:48:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2014-03-19 10:48:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2014-03-19 10:48:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2014-03-19 10:48:46 [DEBUG   ] spawn_process: at 2014-03-19 10:48:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2014-03-19 10:48:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2014-03-19 10:48:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2014-03-19 10:48:46 [DEBUG   ] spawn_process: at 2014-03-19 10:48:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2014-03-19 10:48:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2014-03-19 10:48:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2014-03-19 10:48:46 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2014-03-19 10:48:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 265 ms (1395226127.267 s) with PID 31892 and time 1395226128
2014-03-19 10:48:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2014-03-19 10:48:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 354 ms (1395226127.357 s) with PID 31895 and time 1395226128
2014-03-19 10:48:48 [DEBUG   ] Finished updating ant stats in 0.891 seconds
2014-03-19 10:48:48 [INFO    ] Started antennas statistics background thread
2014-03-19 10:48:48 [INFO    ] Started board flags background thread
2014-03-19 10:48:48 [INFO    ] Started BAM background thread
2014-03-19 10:48:48 [INFO    ] Finished the INI process (ref. #406623) in 107.664 s
2014-03-19 10:48:49 [DEBUG   ] Finished updating board flags in 1.075 seconds
2014-03-19 10:49:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:49:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:49:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:49:49 [DEBUG   ] Finished updating board flags in 1.010 seconds
2014-03-19 10:50:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 10:50:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:50:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:50:49 [DEBUG   ] Finished updating board flags in 1.001 seconds
2014-03-19 10:51:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 10:51:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:51:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:51:49 [DEBUG   ] Finished updating board flags in 1.018 seconds
2014-03-19 10:52:00 [DEBUG   ] Got command RPT from MCS: ref #406641
2014-03-19 10:52:00 [DEBUG   ] summary = NORMAL
2014-03-19 10:52:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406641  14 56735 39120817 A NORMALNORMAL'
2014-03-19 10:52:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 10:52:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:52:43 [DEBUG   ] Got command RPT from MCS: ref #406642
2014-03-19 10:52:43 [DEBUG   ] summary = NORMAL
2014-03-19 10:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406642  14 56735 39163721 A NORMALNORMAL'
2014-03-19 10:52:43 [DEBUG   ] Got command RPT from MCS: ref #406643
2014-03-19 10:52:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-19 10:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406643  48 56735 39163722 A NORMALSystem calibrated and operating normally'
2014-03-19 10:52:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:52:50 [DEBUG   ] Finished updating board flags in 2.063 seconds
2014-03-19 10:53:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:53:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:53:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 10:53:49 [DEBUG   ] Finished updating board flags in 1.358 seconds
2014-03-19 10:54:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:54:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:54:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:54:49 [DEBUG   ] Finished updating board flags in 1.234 seconds
2014-03-19 10:55:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:55:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 10:55:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:55:49 [DEBUG   ] Finished updating board flags in 1.171 seconds
2014-03-19 10:56:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:56:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 10:56:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 10:56:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 10:56:49 [DEBUG   ] Finished updating board flags in 1.042 seconds
2014-03-19 10:57:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:57:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:57:43 [DEBUG   ] Got command RPT from MCS: ref #406659
2014-03-19 10:57:43 [DEBUG   ] summary = NORMAL
2014-03-19 10:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406659  14 56735 39463717 A NORMALNORMAL'
2014-03-19 10:57:43 [DEBUG   ] Got command RPT from MCS: ref #406660
2014-03-19 10:57:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-19 10:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406660  48 56735 39463718 A NORMALSystem calibrated and operating normally'
2014-03-19 10:57:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 10:57:50 [DEBUG   ] Finished updating board flags in 1.601 seconds
2014-03-19 10:58:08 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 10:58:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 10:58:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 10:58:49 [DEBUG   ] Finished updating board flags in 0.951 seconds
2014-03-19 10:59:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 10:59:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 10:59:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 10:59:50 [DEBUG   ] Finished updating board flags in 1.379 seconds
2014-03-19 10:59:58 [DEBUG   ] Got command TBN from MCS: ref #406677
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '1', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '2', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] tbn = exited with status True, code 0x00
2014-03-19 10:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   406677   8 56735 39598010 A NORMAL'
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '3', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '4', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '5', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '6', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '7', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '8', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '9', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '10', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '11', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '12', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '13', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '14', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '15', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '16', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '17', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '18', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '19', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '20', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '21', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '22', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '23', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '24', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '25', '1395226799']
2014-03-19 10:59:58 [DEBUG   ] spawn_process: at 2014-03-19 10:59:58 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '55250000.0', '7', '20', '0', '26', '1395226799']
2014-03-19 10:59:58 [INFO    ] Finished spawning TBN in 0.047 s
2014-03-19 11:00:08 [DEBUG   ] Finished updating ant stats in 0.670 seconds
2014-03-19 11:00:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 11:00:48 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 11:00:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 11:00:50 [DEBUG   ] Finished updating board flags in 1.434 seconds
2014-03-19 11:01:09 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2014-03-19 11:01:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-19 11:01:48 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-19 11:01:50 [DEBUG   ] Finished updating board flags in 1.375 seconds
2014-03-19 11:02:09 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2014-03-19 11:02:29 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 11:02:43 [DEBUG   ] Got command RPT from MCS: ref #406679
2014-03-19 11:02:43 [DEBUG   ] summary = NORMAL
2014-03-19 11:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406679  14 56735 39763713 A NORMALNORMAL'
2014-03-19 11:02:43 [DEBUG   ] Got command RPT from MCS: ref #406680
2014-03-19 11:02:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-19 11:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406680  48 56735 39763714 A NORMALSystem calibrated and operating normally'
2014-03-19 11:02:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 11:02:50 [DEBUG   ] Finished updating board flags in 1.386 seconds
2014-03-19 11:03:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 11:03:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 11:03:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 11:03:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 11:03:51 [DEBUG   ] Finished updating board flags in 2.035 seconds
2014-03-19 11:04:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 11:04:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 11:04:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-03-19 11:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-03-19 11:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-03-19 11:04:51 [DEBUG   ] Finished updating board flags in 2.014 seconds
2014-03-19 11:05:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 11:05:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 11:05:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999921
2014-03-19 11:05:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999921
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-19 11:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-19 11:05:51 [DEBUG   ] Finished updating board flags in 2.010 seconds
2014-03-19 11:06:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 11:06:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 11:06:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-19 11:06:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-19 11:06:51 [DEBUG   ] Finished updating board flags in 1.977 seconds
2014-03-19 11:07:09 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 11:07:30 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-19 11:07:43 [DEBUG   ] Got command RPT from MCS: ref #406696
2014-03-19 11:07:43 [DEBUG   ] summary = NORMAL
2014-03-19 11:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406696  14 56735 40063717 A NORMALNORMAL'
2014-03-19 11:07:43 [DEBUG   ] Got command RPT from MCS: ref #406697
2014-03-19 11:07:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-19 11:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406697  48 56735 40063718 A NORMALSystem calibrated and operating normally'
2014-03-19 11:07:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-19 11:07:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 11:07:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 11:07:51 [DEBUG   ] Finished updating board flags in 1.799 seconds
2014-03-19 11:08:10 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-03-19 11:08:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 11:08:50 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2014-03-19 11:08:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 11:08:51 [DEBUG   ] Finished updating board flags in 1.611 seconds
2014-03-19 11:09:10 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2014-03-19 11:09:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 11:09:50 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2014-03-19 11:09:51 [DEBUG   ] Finished updating board flags in 1.588 seconds
2014-03-19 11:10:10 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2014-03-19 11:10:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-03-19 11:10:50 [DEBUG   ] Finished updating ant stats in 0.649 seconds
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-03-19 11:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-03-19 11:10:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 11:10:51 [DEBUG   ] Finished updating board flags in 1.433 seconds
2014-03-19 11:11:10 [DEBUG   ] Finished updating ant stats in 0.553 seconds
2014-03-19 11:11:31 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-19 11:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-19 11:11:51 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-19 11:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-19 11:11:51 [DEBUG   ] Finished updating board flags in 1.453 seconds
2014-03-19 11:12:11 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2014-03-19 11:12:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 11:12:43 [DEBUG   ] Got command RPT from MCS: ref #406713
2014-03-19 11:12:43 [DEBUG   ] summary = NORMAL
2014-03-19 11:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406713  14 56735 40363721 A NORMALNORMAL'
2014-03-19 11:12:43 [DEBUG   ] Got command RPT from MCS: ref #406714
2014-03-19 11:12:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-19 11:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406714  48 56735 40363722 A NORMALSystem calibrated and operating normally'
2014-03-19 11:12:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 11:12:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 11:12:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 11:12:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 11:12:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 11:12:51 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2014-03-19 11:12:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 11:12:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 11:12:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 11:12:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 11:12:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 11:12:52 [DEBUG   ] Finished updating board flags in 2.333 seconds
2014-03-19 11:13:11 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-03-19 11:13:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 11:13:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 11:13:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 11:13:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 11:13:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 11:13:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 11:13:51 [DEBUG   ] Finished updating ant stats in 0.650 seconds
2014-03-19 11:13:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 11:13:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 11:13:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 11:13:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 11:13:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 11:13:52 [DEBUG   ] Finished updating board flags in 2.186 seconds
2014-03-19 11:14:11 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2014-03-19 11:14:32 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-19 11:14:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 11:14:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 11:14:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 11:14:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 11:14:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 11:14:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 11:14:51 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2014-03-19 11:14:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 11:14:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 11:14:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 11:14:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 11:14:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 11:14:52 [DEBUG   ] Finished updating board flags in 2.011 seconds
2014-03-19 11:15:12 [DEBUG   ] Finished updating ant stats in 1.354 seconds
2014-03-19 11:15:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 11:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 11:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 11:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 11:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 11:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 11:15:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 11:15:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 11:15:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 11:15:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 11:15:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 11:15:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 11:15:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 11:15:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 11:15:53 [DEBUG   ] Finished updating board flags in 3.008 seconds
2014-03-19 11:16:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 11:16:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 11:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 11:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 11:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 11:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 11:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 11:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 11:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 11:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 11:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 11:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 11:16:52 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2014-03-19 11:16:52 [DEBUG   ] Finished updating board flags in 2.043 seconds
2014-03-19 11:17:12 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2014-03-19 11:17:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 11:17:43 [DEBUG   ] Got command RPT from MCS: ref #406730
2014-03-19 11:17:43 [DEBUG   ] summary = NORMAL
2014-03-19 11:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406730  14 56735 40663721 A NORMALNORMAL'
2014-03-19 11:17:43 [DEBUG   ] Got command RPT from MCS: ref #406731
2014-03-19 11:17:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-19 11:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406731  48 56735 40663722 A NORMALSystem calibrated and operating normally'
2014-03-19 11:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 11:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 11:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 11:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 11:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 11:17:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 11:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 11:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 11:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 11:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 11:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 11:17:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 11:17:53 [DEBUG   ] Finished updating board flags in 2.404 seconds
2014-03-19 11:18:12 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-03-19 11:18:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 11:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 11:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 11:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 11:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 11:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 11:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 11:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 11:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 11:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 11:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 11:18:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 11:18:52 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2014-03-19 11:18:52 [DEBUG   ] Finished updating board flags in 2.006 seconds
2014-03-19 11:19:12 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2014-03-19 11:19:33 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-19 11:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2014-03-19 11:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2014-03-19 11:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2014-03-19 11:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2014-03-19 11:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2014-03-19 11:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2014-03-19 11:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2014-03-19 11:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2014-03-19 11:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2014-03-19 11:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2014-03-19 11:19:52 [DEBUG   ] Finished updating board flags in 2.006 seconds
2014-03-19 11:19:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 11:20:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 11:20:33 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999960
2014-03-19 11:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999960
2014-03-19 11:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999960
2014-03-19 11:20:52 [DEBUG   ] Finished updating board flags in 1.994 seconds
2014-03-19 11:20:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 11:21:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 11:21:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-19 11:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-19 11:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-19 11:21:52 [DEBUG   ] Finished updating board flags in 1.809 seconds
2014-03-19 11:21:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 11:22:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 11:22:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 11:22:43 [DEBUG   ] Got command RPT from MCS: ref #406747
2014-03-19 11:22:43 [DEBUG   ] summary = NORMAL
2014-03-19 11:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406747  14 56735 40963729 A NORMALNORMAL'
2014-03-19 11:22:43 [DEBUG   ] Got command RPT from MCS: ref #406748
2014-03-19 11:22:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-19 11:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406748  48 56735 40963730 A NORMALSystem calibrated and operating normally'
2014-03-19 11:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 11:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 11:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 11:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 11:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 11:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 11:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 11:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 11:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 11:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 11:22:52 [DEBUG   ] Finished updating board flags in 1.862 seconds
2014-03-19 11:22:53 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 11:23:13 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-19 11:23:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2014-03-19 11:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 11:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 11:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 11:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 11:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 11:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 11:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 11:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 11:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 11:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 11:23:52 [DEBUG   ] Finished updating board flags in 1.692 seconds
2014-03-19 11:23:54 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-19 11:24:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 11:24:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 11:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 11:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 11:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 11:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 11:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 11:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 11:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 11:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 11:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 11:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 11:24:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 11:24:52 [DEBUG   ] Finished updating board flags in 1.626 seconds
2014-03-19 11:24:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 11:25:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 11:25:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 11:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 11:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 11:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 11:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 11:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 11:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 11:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 11:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 11:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 11:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 11:25:52 [DEBUG   ] Finished updating board flags in 1.572 seconds
2014-03-19 11:25:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 11:26:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 11:26:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 11:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 11:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 11:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 11:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 11:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 11:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 11:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 11:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 11:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 11:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 11:26:52 [DEBUG   ] Finished updating board flags in 1.421 seconds
2014-03-19 11:26:54 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-19 11:27:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 11:27:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2014-03-19 11:27:43 [DEBUG   ] Got command RPT from MCS: ref #406764
2014-03-19 11:27:43 [DEBUG   ] summary = NORMAL
2014-03-19 11:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406764  14 56735 41263725 A NORMALNORMAL'
2014-03-19 11:27:43 [DEBUG   ] Got command RPT from MCS: ref #406765
2014-03-19 11:27:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-19 11:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406765  48 56735 41263726 A NORMALSystem calibrated and operating normally'
2014-03-19 11:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 11:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 11:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 11:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 11:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 11:27:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 11:27:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 11:27:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 11:27:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 11:27:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 11:27:52 [DEBUG   ] Finished updating board flags in 1.377 seconds
2014-03-19 11:27:54 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 11:28:15 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2014-03-19 11:28:35 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-19 11:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 11:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 11:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 11:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 11:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 11:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 11:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 11:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 11:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 11:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 11:28:52 [DEBUG   ] Finished updating board flags in 1.378 seconds
2014-03-19 11:28:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 11:29:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 11:29:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2014-03-19 11:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 11:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 11:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 11:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 11:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 11:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 11:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 11:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 11:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 11:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 11:29:53 [DEBUG   ] Finished updating board flags in 2.040 seconds
2014-03-19 11:29:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 11:30:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 11:30:35 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 11:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 11:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 11:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 11:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 11:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 11:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 11:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 11:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 11:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 11:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 11:30:53 [DEBUG   ] Finished updating board flags in 2.009 seconds
2014-03-19 11:30:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 11:31:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 11:31:35 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2014-03-19 11:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 11:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 11:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 11:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 11:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 11:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 11:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 11:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 11:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 11:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 11:31:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 11:31:53 [DEBUG   ] Finished updating board flags in 1.986 seconds
2014-03-19 11:31:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 11:32:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 11:32:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 11:32:43 [DEBUG   ] Got command RPT from MCS: ref #406781
2014-03-19 11:32:43 [DEBUG   ] summary = NORMAL
2014-03-19 11:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406781  14 56735 41563722 A NORMALNORMAL'
2014-03-19 11:32:43 [DEBUG   ] Got command RPT from MCS: ref #406782
2014-03-19 11:32:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-19 11:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406782  48 56735 41563722 A NORMALSystem calibrated and operating normally'
2014-03-19 11:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 11:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 11:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 11:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 11:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 11:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 11:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 11:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 11:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 11:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 11:32:53 [DEBUG   ] Finished updating board flags in 1.807 seconds
2014-03-19 11:32:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 11:33:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 11:33:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 11:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 11:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 11:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 11:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 11:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 11:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 11:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 11:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 11:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 11:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 11:33:53 [DEBUG   ] Finished updating board flags in 1.809 seconds
2014-03-19 11:33:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 11:34:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 11:34:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 11:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 11:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 11:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 11:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 11:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 11:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 11:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 11:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 11:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 11:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 11:34:53 [DEBUG   ] Finished updating board flags in 1.896 seconds
2014-03-19 11:34:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 11:35:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 11:35:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-03-19 11:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-03-19 11:35:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 11:35:53 [DEBUG   ] Finished updating board flags in 1.727 seconds
2014-03-19 11:35:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 11:36:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 11:36:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-19 11:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-19 11:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-19 11:36:53 [DEBUG   ] Finished updating board flags in 1.611 seconds
2014-03-19 11:36:55 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2014-03-19 11:37:15 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-03-19 11:37:36 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2014-03-19 11:37:43 [DEBUG   ] Got command RPT from MCS: ref #406798
2014-03-19 11:37:43 [DEBUG   ] summary = NORMAL
2014-03-19 11:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406798  14 56735 41863733 A NORMALNORMAL'
2014-03-19 11:37:43 [DEBUG   ] Got command RPT from MCS: ref #406799
2014-03-19 11:37:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-19 11:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406799  48 56735 41863734 A NORMALSystem calibrated and operating normally'
2014-03-19 11:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-19 11:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-19 11:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-19 11:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-19 11:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-19 11:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-19 11:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-19 11:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-19 11:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-19 11:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-19 11:37:53 [DEBUG   ] Finished updating board flags in 1.558 seconds
2014-03-19 11:37:56 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 11:38:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 11:38:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 11:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-19 11:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-19 11:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-19 11:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-19 11:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-19 11:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-19 11:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-19 11:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-19 11:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-19 11:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-19 11:38:53 [DEBUG   ] Finished updating board flags in 1.423 seconds
2014-03-19 11:38:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 11:39:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 11:39:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 11:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-19 11:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-19 11:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-19 11:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-19 11:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-19 11:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-19 11:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-19 11:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-19 11:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-19 11:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-19 11:39:53 [DEBUG   ] Finished updating board flags in 1.435 seconds
2014-03-19 11:39:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 11:40:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 11:40:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-19 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-19 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-19 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-19 11:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-19 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-19 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-19 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-19 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-19 11:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-19 11:40:53 [DEBUG   ] Finished updating board flags in 1.442 seconds
2014-03-19 11:40:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 11:41:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2014-03-19 11:41:36 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-19 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-19 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-19 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-19 11:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-19 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-19 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-19 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-19 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-19 11:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-19 11:41:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 11:41:53 [DEBUG   ] Finished updating board flags in 1.460 seconds
2014-03-19 11:41:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 11:42:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 11:42:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2014-03-19 11:42:43 [DEBUG   ] Got command RPT from MCS: ref #406815
2014-03-19 11:42:43 [DEBUG   ] summary = NORMAL
2014-03-19 11:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406815  14 56735 42163733 A NORMALNORMAL'
2014-03-19 11:42:43 [DEBUG   ] Got command RPT from MCS: ref #406816
2014-03-19 11:42:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-19 11:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406816  48 56735 42163734 A NORMALSystem calibrated and operating normally'
2014-03-19 11:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2014-03-19 11:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2014-03-19 11:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2014-03-19 11:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2014-03-19 11:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2014-03-19 11:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2014-03-19 11:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2014-03-19 11:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2014-03-19 11:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2014-03-19 11:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2014-03-19 11:42:53 [DEBUG   ] Finished updating board flags in 1.464 seconds
2014-03-19 11:42:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 11:43:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 11:43:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-03-19 11:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-03-19 11:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-03-19 11:43:54 [DEBUG   ] Finished updating board flags in 2.244 seconds
2014-03-19 11:43:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 11:44:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 11:44:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-19 11:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-19 11:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-19 11:44:54 [DEBUG   ] Finished updating board flags in 2.211 seconds
2014-03-19 11:44:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 11:45:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 11:45:37 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2014-03-19 11:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 11:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 11:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 11:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 11:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 11:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 11:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 11:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 11:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 11:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 11:45:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 11:45:54 [DEBUG   ] Finished updating board flags in 2.147 seconds
2014-03-19 11:45:57 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-19 11:46:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 11:46:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 11:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 11:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 11:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 11:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 11:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 11:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 11:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 11:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 11:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 11:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 11:46:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 11:46:54 [DEBUG   ] Finished updating board flags in 2.006 seconds
2014-03-19 11:46:57 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2014-03-19 11:47:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 11:47:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 11:47:43 [DEBUG   ] Got command RPT from MCS: ref #406832
2014-03-19 11:47:43 [DEBUG   ] summary = NORMAL
2014-03-19 11:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406832  14 56735 42463725 A NORMALNORMAL'
2014-03-19 11:47:43 [DEBUG   ] Got command RPT from MCS: ref #406833
2014-03-19 11:47:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-19 11:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406833  48 56735 42463726 A NORMALSystem calibrated and operating normally'
2014-03-19 11:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 11:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 11:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 11:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 11:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 11:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 11:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 11:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 11:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 11:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 11:47:54 [DEBUG   ] Finished updating board flags in 1.985 seconds
2014-03-19 11:47:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 11:48:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2014-03-19 11:48:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 11:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 11:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 11:48:54 [DEBUG   ] Finished updating board flags in 1.821 seconds
2014-03-19 11:48:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 11:49:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 11:49:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 11:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 11:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 11:49:54 [DEBUG   ] Finished updating board flags in 1.782 seconds
2014-03-19 11:49:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 11:50:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2014-03-19 11:50:37 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 11:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 11:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 11:50:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 11:50:54 [DEBUG   ] Finished updating board flags in 1.654 seconds
2014-03-19 11:50:58 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2014-03-19 11:51:18 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 11:51:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 11:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 11:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 11:51:54 [DEBUG   ] Finished updating board flags in 1.589 seconds
2014-03-19 11:51:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 11:52:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 11:52:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 11:52:43 [DEBUG   ] Got command RPT from MCS: ref #406849
2014-03-19 11:52:43 [DEBUG   ] summary = NORMAL
2014-03-19 11:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406849  14 56735 42763730 A NORMALNORMAL'
2014-03-19 11:52:43 [DEBUG   ] Got command RPT from MCS: ref #406850
2014-03-19 11:52:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-19 11:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406850  48 56735 42763730 A NORMALSystem calibrated and operating normally'
2014-03-19 11:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 11:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 11:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 11:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 11:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 11:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 11:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 11:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 11:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 11:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 11:52:54 [DEBUG   ] Finished updating board flags in 1.445 seconds
2014-03-19 11:52:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 11:53:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2014-03-19 11:53:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 11:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 11:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 11:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 11:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 11:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 11:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 11:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 11:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 11:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 11:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 11:53:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 11:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2014-03-19 11:53:54 [CRITICAL] MGT underflow detected on beam(s) 1
2014-03-19 11:53:54 [DEBUG   ] Finished updating board flags in 1.460 seconds
2014-03-19 11:53:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2014-03-19 11:54:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 11:54:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 11:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 11:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 11:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 11:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 11:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 11:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 11:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 11:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 11:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 11:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 11:54:54 [DEBUG   ] Finished updating board flags in 1.484 seconds
2014-03-19 11:54:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 11:55:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2014-03-19 11:55:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 11:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 11:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 11:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 11:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 11:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 11:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 11:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 11:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 11:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 11:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 11:55:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 11:55:55 [DEBUG   ] Finished updating board flags in 2.294 seconds
2014-03-19 11:55:58 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2014-03-19 11:56:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 11:56:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2014-03-19 11:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 11:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 11:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 11:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 11:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 11:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 11:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 11:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 11:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 11:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 11:56:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 11:56:55 [DEBUG   ] Finished updating board flags in 2.091 seconds
2014-03-19 11:56:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2014-03-19 11:57:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 11:57:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 11:57:43 [DEBUG   ] Got command RPT from MCS: ref #406866
2014-03-19 11:57:43 [DEBUG   ] summary = ERROR
2014-03-19 11:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406866  13 56735 43063729 A  ERRORERROR'
2014-03-19 11:57:43 [DEBUG   ] Got command RPT from MCS: ref #406867
2014-03-19 11:57:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 11:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406867  77 56735 43063730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 11:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 11:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 11:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 11:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 11:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 11:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 11:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 11:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 11:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 11:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 11:57:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 11:57:55 [DEBUG   ] Finished updating board flags in 2.021 seconds
2014-03-19 11:57:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 11:58:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 11:58:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 11:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 11:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 11:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 11:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 11:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 11:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 11:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 11:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 11:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 11:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 11:58:55 [DEBUG   ] Finished updating board flags in 1.990 seconds
2014-03-19 11:58:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 11:59:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 11:59:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 11:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 11:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 11:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 11:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 11:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 11:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 11:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 11:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 11:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 11:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 11:59:55 [DEBUG   ] Finished updating board flags in 1.820 seconds
2014-03-19 11:59:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:00:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 12:00:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 12:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 12:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 12:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 12:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 12:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 12:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 12:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 12:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 12:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 12:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 12:00:55 [DEBUG   ] Finished updating board flags in 1.785 seconds
2014-03-19 12:00:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:01:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 12:01:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2014-03-19 12:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 12:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 12:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 12:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 12:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 12:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 12:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 12:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 12:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 12:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 12:01:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 12:01:55 [DEBUG   ] Finished updating board flags in 1.717 seconds
2014-03-19 12:01:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2014-03-19 12:02:18 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 12:02:38 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2014-03-19 12:02:43 [DEBUG   ] Got command RPT from MCS: ref #406883
2014-03-19 12:02:43 [DEBUG   ] summary = ERROR
2014-03-19 12:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406883  13 56735 43363741 A  ERRORERROR'
2014-03-19 12:02:43 [DEBUG   ] Got command RPT from MCS: ref #406884
2014-03-19 12:02:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2014-03-19 12:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406884  77 56735 43363742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2014-03-19 12:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 12:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 12:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 12:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 12:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 12:02:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 12:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 12:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 12:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 12:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 12:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 12:02:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 12:02:55 [DEBUG   ] Finished updating board flags in 1.485 seconds
2014-03-19 12:02:59 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-19 12:03:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2014-03-19 12:03:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 12:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 12:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 12:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 12:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 12:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 12:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 12:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 12:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 12:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 12:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 12:03:55 [DEBUG   ] Finished updating board flags in 1.466 seconds
2014-03-19 12:03:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 12:04:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2014-03-19 12:04:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2014-03-19 12:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2014-03-19 12:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2014-03-19 12:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2014-03-19 12:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2014-03-19 12:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2014-03-19 12:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2014-03-19 12:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2014-03-19 12:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2014-03-19 12:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2014-03-19 12:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2014-03-19 12:04:55 [DEBUG   ] Finished updating board flags in 1.485 seconds
2014-03-19 12:04:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2014-03-19 12:05:00 [DEBUG   ] Got command INI from MCS: ref #406900
2014-03-19 12:05:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2014-03-19 12:05:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   406900   8 56735 43500930 ABOOTING'
2014-03-19 12:05:24 [INFO    ] -------------------
2014-03-19 12:05:24 [INFO    ]  LWA board status
2014-03-19 12:05:24 [INFO    ] -------------------
2014-03-19 12:05:24 [INFO    ] DP 1: 2 lwa27
2014-03-19 12:05:24 [INFO    ] DP 1: 3 lwa24
2014-03-19 12:05:24 [INFO    ] DP 1: 4 lwa23
2014-03-19 12:05:24 [INFO    ] DP 1: 5 lwa18
2014-03-19 12:05:24 [INFO    ] DP 1: 6 lwa10
2014-03-19 12:05:24 [INFO    ] DP 1: 7 lwa32
2014-03-19 12:05:24 [INFO    ] DP 1: 8 lwa11
2014-03-19 12:05:24 [INFO    ] DP 1: 9 lwa30
2014-03-19 12:05:24 [INFO    ] DP 1: 10 lwa12
2014-03-19 12:05:24 [INFO    ] DP 1: 11 lwa8
2014-03-19 12:05:24 [INFO    ] DP 1: 12 lwa13
2014-03-19 12:05:24 [INFO    ] DP 1: 13 lwa26
2014-03-19 12:05:24 [INFO    ] DP 1: 14 lwa14
2014-03-19 12:05:24 [INFO    ] DP 1: 16 lwa22
2014-03-19 12:05:24 [INFO    ] DP 1: 17 lwa20
2014-03-19 12:05:24 [INFO    ] DP 1: 18 lwa1
2014-03-19 12:05:24 [INFO    ] DP 1: 19 lwa5
2014-03-19 12:05:24 [INFO    ] DP 1: 20 lwa25
2014-03-19 12:05:24 [INFO    ] DP 1: 21 lwa35
2014-03-19 12:05:24 [INFO    ] DP 1: 22 lwa19
2014-03-19 12:05:24 [INFO    ] DP 1: 23 lwa21
2014-03-19 12:05:24 [INFO    ] DP 1: 24 lwa6
2014-03-19 12:05:24 [INFO    ] DP 1: 25 lwa7
2014-03-19 12:05:24 [INFO    ] DP 1: 26 lwa33
2014-03-19 12:05:24 [INFO    ] DP 1: 27 lwa15
2014-03-19 12:05:24 [INFO    ] DP 1: 28 lwa28
2014-03-19 12:05:24 [INFO    ] DP 2: 1 lwa16
2014-03-19 12:05:24 [INFO    ] DP 2: 15 lwa34
2014-03-19 12:05:24 [INFO    ] Total of 28 boards
2014-03-19 12:05:24 [INFO    ] Total of 260 stands
2014-03-19 12:05:24 [INFO    ] -------------------
2014-03-19 12:05:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8320
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8321
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8322
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8323
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8324
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8325
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8326
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8327
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8328
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8329
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8330
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8331
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8332
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8333
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8334
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8335
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8336
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8337
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8338
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8339
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8340
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8341
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8342
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8343
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8344
2014-03-19 12:05:31 [DEBUG   ] 2014-03-19 12:05:31 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8345
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8320 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8321 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8322 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8323 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8324 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8325 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8326 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8327 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8328 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8329 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8330 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8331 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8332 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8333 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8334 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8335 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8336 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8337 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8338 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8339 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8340 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8341 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8342 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8343 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8344 exited with status 0
2014-03-19 12:05:43 [DEBUG   ] 2014-03-19 12:05:43 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8345 exited with status 0
2014-03-19 12:05:43 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2014-03-19 12:05:43 [DEBUG   ] spawn_process: at 2014-03-19 12:05:43 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:43 [DEBUG   ] spawn_process: at 2014-03-19 12:05:43 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:43 [DEBUG   ] spawn_process: at 2014-03-19 12:05:43 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:43 [DEBUG   ] spawn_process: at 2014-03-19 12:05:43 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:43 [DEBUG   ] spawn_process: at 2014-03-19 12:05:43 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:43 [DEBUG   ] spawn_process: at 2014-03-19 12:05:43 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:43 [DEBUG   ] spawn_process: at 2014-03-19 12:05:43 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:43 [DEBUG   ] spawn_process: at 2014-03-19 12:05:43 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:43 [DEBUG   ] spawn_process: at 2014-03-19 12:05:43 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:43 [DEBUG   ] spawn_process: at 2014-03-19 12:05:43 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:43 [DEBUG   ] spawn_process: at 2014-03-19 12:05:43 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:43 [DEBUG   ] spawn_process: at 2014-03-19 12:05:43 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:44 [DEBUG   ] spawn_process: at 2014-03-19 12:05:44 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:44 [DEBUG   ] spawn_process: at 2014-03-19 12:05:44 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:44 [DEBUG   ] spawn_process: at 2014-03-19 12:05:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:44 [DEBUG   ] spawn_process: at 2014-03-19 12:05:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:44 [DEBUG   ] spawn_process: at 2014-03-19 12:05:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:44 [DEBUG   ] spawn_process: at 2014-03-19 12:05:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:44 [DEBUG   ] spawn_process: at 2014-03-19 12:05:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:44 [DEBUG   ] spawn_process: at 2014-03-19 12:05:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:44 [DEBUG   ] spawn_process: at 2014-03-19 12:05:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:44 [DEBUG   ] spawn_process: at 2014-03-19 12:05:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:44 [DEBUG   ] spawn_process: at 2014-03-19 12:05:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:44 [DEBUG   ] spawn_process: at 2014-03-19 12:05:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:44 [DEBUG   ] spawn_process: at 2014-03-19 12:05:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:44 [DEBUG   ] spawn_process: at 2014-03-19 12:05:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2014-03-19 12:05:44 [DEBUG   ] 2014-03-19 12:05:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 8373
2014-03-19 12:05:44 [DEBUG   ] 2014-03-19 12:05:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 8374
2014-03-19 12:05:49 [DEBUG   ] 2014-03-19 12:05:49 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 8373 exited with status 0
2014-03-19 12:05:49 [DEBUG   ] 2014-03-19 12:05:49 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 8374 exited with status 0
2014-03-19 12:05:49 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2014-03-19 12:05:49 [DEBUG   ] spawn_process: at 2014-03-19 12:05:49 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2014-03-19 12:05:49 [DEBUG   ] spawn_process: at 2014-03-19 12:05:49 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2014-03-19 12:05:49 [INFO    ] Setting Beam 1 xbars
2014-03-19 12:05:49 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2014-03-19 12:05:49 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2014-03-19 12:05:49 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2014-03-19 12:05:49 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2014-03-19 12:05:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2014-03-19 12:05:50 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2014-03-19 12:05:50 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2014-03-19 12:05:50 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2014-03-19 12:05:50 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2014-03-19 12:05:50 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2014-03-19 12:05:50 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2014-03-19 12:05:50 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2014-03-19 12:05:50 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2014-03-19 12:05:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2014-03-19 12:05:51 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2014-03-19 12:05:51 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2014-03-19 12:05:51 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2014-03-19 12:05:51 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2014-03-19 12:05:51 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2014-03-19 12:05:51 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2014-03-19 12:05:51 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2014-03-19 12:05:51 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2014-03-19 12:05:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2014-03-19 12:05:52 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2014-03-19 12:05:52 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2014-03-19 12:05:52 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2014-03-19 12:05:52 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2014-03-19 12:05:52 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2014-03-19 12:05:52 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2014-03-19 12:05:52 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2014-03-19 12:05:52 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2014-03-19 12:05:52 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2014-03-19 12:05:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2014-03-19 12:05:53 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2014-03-19 12:05:53 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2014-03-19 12:05:53 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2014-03-19 12:05:53 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2014-03-19 12:05:53 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2014-03-19 12:05:53 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2014-03-19 12:05:53 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2014-03-19 12:05:53 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2014-03-19 12:05:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2014-03-19 12:05:54 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2014-03-19 12:05:54 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2014-03-19 12:05:54 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2014-03-19 12:05:54 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2014-03-19 12:05:54 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2014-03-19 12:05:54 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2014-03-19 12:05:54 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2014-03-19 12:05:54 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2014-03-19 12:05:55 [INFO    ] Setting Beam 2 xbars
2014-03-19 12:05:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2014-03-19 12:05:55 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2014-03-19 12:05:55 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2014-03-19 12:05:55 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2014-03-19 12:05:55 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2014-03-19 12:05:55 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2014-03-19 12:05:55 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2014-03-19 12:05:55 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2014-03-19 12:05:55 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2014-03-19 12:05:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2014-03-19 12:05:56 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2014-03-19 12:05:56 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2014-03-19 12:05:56 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2014-03-19 12:05:56 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2014-03-19 12:05:56 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2014-03-19 12:05:56 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2014-03-19 12:05:56 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2014-03-19 12:05:56 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2014-03-19 12:05:57 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2014-03-19 12:05:57 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2014-03-19 12:05:57 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2014-03-19 12:05:57 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2014-03-19 12:05:57 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2014-03-19 12:05:57 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2014-03-19 12:05:57 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2014-03-19 12:05:57 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2014-03-19 12:05:57 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2014-03-19 12:05:58 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2014-03-19 12:05:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2014-03-19 12:05:58 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2014-03-19 12:05:58 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2014-03-19 12:05:58 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2014-03-19 12:05:58 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2014-03-19 12:05:58 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2014-03-19 12:05:58 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2014-03-19 12:05:58 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2014-03-19 12:05:58 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2014-03-19 12:05:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2014-03-19 12:05:59 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2014-03-19 12:05:59 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2014-03-19 12:05:59 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2014-03-19 12:05:59 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2014-03-19 12:05:59 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2014-03-19 12:05:59 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2014-03-19 12:05:59 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2014-03-19 12:05:59 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2014-03-19 12:06:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2014-03-19 12:06:00 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2014-03-19 12:06:00 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2014-03-19 12:06:00 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2014-03-19 12:06:00 [INFO    ] Setting Beam 3 xbars
2014-03-19 12:06:00 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2014-03-19 12:06:00 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2014-03-19 12:06:00 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2014-03-19 12:06:00 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2014-03-19 12:06:00 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2014-03-19 12:06:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2014-03-19 12:06:01 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2014-03-19 12:06:01 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2014-03-19 12:06:01 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2014-03-19 12:06:01 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2014-03-19 12:06:01 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2014-03-19 12:06:01 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2014-03-19 12:06:01 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2014-03-19 12:06:01 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2014-03-19 12:06:02 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2014-03-19 12:06:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2014-03-19 12:06:02 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2014-03-19 12:06:02 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2014-03-19 12:06:02 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2014-03-19 12:06:02 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2014-03-19 12:06:02 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2014-03-19 12:06:02 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2014-03-19 12:06:02 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2014-03-19 12:06:03 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2014-03-19 12:06:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2014-03-19 12:06:03 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2014-03-19 12:06:03 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2014-03-19 12:06:03 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2014-03-19 12:06:03 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2014-03-19 12:06:03 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2014-03-19 12:06:03 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2014-03-19 12:06:03 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2014-03-19 12:06:03 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2014-03-19 12:06:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2014-03-19 12:06:04 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2014-03-19 12:06:04 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2014-03-19 12:06:04 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2014-03-19 12:06:04 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2014-03-19 12:06:04 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2014-03-19 12:06:04 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2014-03-19 12:06:04 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2014-03-19 12:06:04 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2014-03-19 12:06:05 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2014-03-19 12:06:05 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2014-03-19 12:06:05 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2014-03-19 12:06:05 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2014-03-19 12:06:05 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2014-03-19 12:06:05 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2014-03-19 12:06:05 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2014-03-19 12:06:05 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2014-03-19 12:06:05 [INFO    ] Setting Beam 4 xbars
2014-03-19 12:06:05 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2014-03-19 12:06:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2014-03-19 12:06:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2014-03-19 12:06:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2014-03-19 12:06:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2014-03-19 12:06:06 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2014-03-19 12:06:06 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2014-03-19 12:06:06 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2014-03-19 12:06:06 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2014-03-19 12:06:06 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2014-03-19 12:06:07 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2014-03-19 12:06:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2014-03-19 12:06:07 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2014-03-19 12:06:07 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2014-03-19 12:06:07 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2014-03-19 12:06:07 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2014-03-19 12:06:07 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2014-03-19 12:06:07 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2014-03-19 12:06:07 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2014-03-19 12:06:08 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2014-03-19 12:06:08 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2014-03-19 12:06:08 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2014-03-19 12:06:08 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2014-03-19 12:06:08 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2014-03-19 12:06:08 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2014-03-19 12:06:08 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2014-03-19 12:06:08 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2014-03-19 12:06:08 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2014-03-19 12:06:08 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2014-03-19 12:06:09 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2014-03-19 12:06:09 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2014-03-19 12:06:09 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2014-03-19 12:06:09 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2014-03-19 12:06:09 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2014-03-19 12:06:09 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2014-03-19 12:06:09 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2014-03-19 12:06:09 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2014-03-19 12:06:09 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2014-03-19 12:06:10 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2014-03-19 12:06:10 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2014-03-19 12:06:10 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2014-03-19 12:06:10 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2014-03-19 12:06:10 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2014-03-19 12:06:10 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2014-03-19 12:06:10 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2014-03-19 12:06:10 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2014-03-19 12:06:10 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2014-03-19 12:06:11 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2014-03-19 12:06:11 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2014-03-19 12:06:11 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2014-03-19 12:06:11 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2014-03-19 12:06:11 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2014-03-19 12:06:11 [INFO    ] All xbars set
2014-03-19 12:06:11 [INFO    ] Setting adder chain routing for all beams
2014-03-19 12:06:16 [INFO    ] Setting beam ids
2014-03-19 12:06:26 [INFO    ] Starting beam delay calibration
2014-03-19 12:06:39 [INFO    ] Beam 1 latency is 5723
2014-03-19 12:06:39 [INFO    ] Beam 2 latency is 5751
2014-03-19 12:06:39 [INFO    ] Beam 3 latency is 5743
2014-03-19 12:06:39 [INFO    ] Beam 4 latency is 5729
2014-03-19 12:06:39 [INFO    ] Stop calibration
2014-03-19 12:06:47 [INFO    ] Beam delay calibration successful
2014-03-19 12:06:47 [INFO    ] Calibration passed
2014-03-19 12:06:47 [DEBUG   ] spawn_process: at 2014-03-19 12:06:47 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2014-03-19 12:06:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2014-03-19 12:06:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2014-03-19 12:06:47 [DEBUG   ] spawn_process: at 2014-03-19 12:06:47 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2014-03-19 12:06:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2014-03-19 12:06:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2014-03-19 12:06:47 [DEBUG   ] spawn_process: at 2014-03-19 12:06:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2014-03-19 12:06:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2014-03-19 12:06:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2014-03-19 12:06:47 [DEBUG   ] spawn_process: at 2014-03-19 12:06:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2014-03-19 12:06:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2014-03-19 12:06:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2014-03-19 12:06:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2014-03-19 12:06:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 291 ms (1395230808.293 s) with PID 9949 and time 1395230809
2014-03-19 12:06:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2014-03-19 12:06:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 381 ms (1395230808.383 s) with PID 9952 and time 1395230809
2014-03-19 12:06:49 [DEBUG   ] Finished updating ant stats in 0.864 seconds
2014-03-19 12:06:49 [INFO    ] Started antennas statistics background thread
2014-03-19 12:06:49 [INFO    ] Started board flags background thread
2014-03-19 12:06:49 [INFO    ] Started BAM background thread
2014-03-19 12:06:49 [INFO    ] Finished the INI process (ref. #406900) in 108.576 s
2014-03-19 12:06:50 [DEBUG   ] Finished updating board flags in 1.054 seconds
2014-03-19 12:07:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 12:07:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 12:07:43 [DEBUG   ] Got command RPT from MCS: ref #406901
2014-03-19 12:07:43 [DEBUG   ] summary = NORMAL
2014-03-19 12:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406901  14 56735 43663737 A NORMALNORMAL'
2014-03-19 12:07:43 [DEBUG   ] Got command RPT from MCS: ref #406902
2014-03-19 12:07:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-19 12:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406902  48 56735 43663738 A NORMALSystem calibrated and operating normally'
2014-03-19 12:07:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2014-03-19 12:07:50 [DEBUG   ] Finished updating board flags in 0.987 seconds
2014-03-19 12:08:09 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2014-03-19 12:08:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:08:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-03-19 12:08:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 12:08:50 [DEBUG   ] Finished updating board flags in 1.289 seconds
2014-03-19 12:09:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:09:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:09:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-19 12:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-19 12:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-19 12:09:51 [DEBUG   ] Finished updating board flags in 1.756 seconds
2014-03-19 12:10:00 [DEBUG   ] Got command RPT from MCS: ref #406918
2014-03-19 12:10:00 [DEBUG   ] summary = NORMAL
2014-03-19 12:10:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406918  14 56735 43800921 A NORMALNORMAL'
2014-03-19 12:10:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:10:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2014-03-19 12:10:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:10:51 [DEBUG   ] Finished updating board flags in 1.597 seconds
2014-03-19 12:11:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:11:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:11:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:11:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 12:11:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 12:11:51 [DEBUG   ] Finished updating board flags in 1.377 seconds
2014-03-19 12:12:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:12:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:12:43 [DEBUG   ] Got command RPT from MCS: ref #406919
2014-03-19 12:12:43 [DEBUG   ] summary = NORMAL
2014-03-19 12:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406919  14 56735 43963737 A NORMALNORMAL'
2014-03-19 12:12:43 [DEBUG   ] Got command RPT from MCS: ref #406920
2014-03-19 12:12:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-19 12:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406920  48 56735 43963738 A NORMALSystem calibrated and operating normally'
2014-03-19 12:12:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:12:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 12:12:51 [DEBUG   ] Finished updating board flags in 1.234 seconds
2014-03-19 12:13:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:13:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:13:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:13:51 [DEBUG   ] Finished updating board flags in 1.161 seconds
2014-03-19 12:14:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:14:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:14:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:14:51 [DEBUG   ] Finished updating board flags in 1.019 seconds
2014-03-19 12:15:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:15:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 12:15:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2014-03-19 12:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2014-03-19 12:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2014-03-19 12:15:51 [DEBUG   ] Finished updating board flags in 1.020 seconds
2014-03-19 12:16:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-19 12:16:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-19 12:16:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2014-03-19 12:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2014-03-19 12:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2014-03-19 12:16:52 [DEBUG   ] Finished updating board flags in 2.033 seconds
2014-03-19 12:17:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-19 12:17:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-19 12:17:43 [DEBUG   ] Got command RPT from MCS: ref #406936
2014-03-19 12:17:43 [DEBUG   ] summary = NORMAL
2014-03-19 12:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406936  14 56735 44263733 A NORMALNORMAL'
2014-03-19 12:17:43 [DEBUG   ] Got command RPT from MCS: ref #406937
2014-03-19 12:17:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-19 12:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406937  48 56735 44263734 A NORMALSystem calibrated and operating normally'
2014-03-19 12:17:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2014-03-19 12:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 12:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 12:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 12:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 12:17:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 12:17:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2014-03-19 12:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 12:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 12:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 12:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 12:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 12:17:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 12:17:52 [DEBUG   ] Finished updating board flags in 1.932 seconds
2014-03-19 12:18:00 [DEBUG   ] Got command TBN from MCS: ref #406953
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '1', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '2', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '3', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] tbn = exited with status True, code 0x00
2014-03-19 12:18:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   406953   8 56735 44280942 A NORMAL'
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '4', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '5', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '6', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '7', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '8', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '9', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '10', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '11', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '12', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '13', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '14', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '15', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '16', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '17', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '18', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '19', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '20', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '21', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '22', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '23', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '24', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '25', '1395231482']
2014-03-19 12:18:00 [DEBUG   ] spawn_process: at 2014-03-19 12:18:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '26', '1395231482']
2014-03-19 12:18:00 [INFO    ] Finished spawning TBN in 0.047 s
2014-03-19 12:18:09 [DEBUG   ] Finished updating ant stats in 0.468 seconds
2014-03-19 12:18:30 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2014-03-19 12:18:50 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2014-03-19 12:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 12:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 12:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 12:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 12:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 12:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 12:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 12:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 12:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 12:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 12:18:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2014-03-19 12:18:52 [DEBUG   ] Finished updating board flags in 2.037 seconds
2014-03-19 12:19:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2014-03-19 12:19:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2014-03-19 12:19:50 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2014-03-19 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 12:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 12:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 12:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 12:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 12:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 12:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 12:19:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 12:19:52 [DEBUG   ] Finished updating board flags in 1.999 seconds
2014-03-19 12:20:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2014-03-19 12:20:30 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2014-03-19 12:20:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 12:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 12:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 12:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 12:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 12:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 12:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 12:20:52 [DEBUG   ] Finished updating board flags in 1.786 seconds
2014-03-19 12:21:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2014-03-19 12:21:30 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2014-03-19 12:21:50 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2014-03-19 12:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 12:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 12:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 12:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 12:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 12:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 12:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 12:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 12:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 12:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 12:21:52 [DEBUG   ] Finished updating board flags in 1.606 seconds
2014-03-19 12:22:11 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2014-03-19 12:22:31 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2014-03-19 12:22:43 [DEBUG   ] Got command RPT from MCS: ref #406954
2014-03-19 12:22:43 [DEBUG   ] summary = NORMAL
2014-03-19 12:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406954  14 56735 44563737 A NORMALNORMAL'
2014-03-19 12:22:43 [DEBUG   ] Got command RPT from MCS: ref #406955
2014-03-19 12:22:43 [DEBUG   ] info = System calibrated and operating normally
2014-03-19 12:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   406955  48 56735 44563738 A NORMALSystem calibrated and operating normally'
2014-03-19 12:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 12:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 12:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 12:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 12:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 12:22:51 [DEBUG   ] Finished updating ant stats in 1.245 seconds
2014-03-19 12:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 12:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 12:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 12:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 12:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 12:22:52 [DEBUG   ] Finished updating board flags in 1.626 seconds
2014-03-19 12:23:11 [DEBUG   ] Finished updating ant stats in 1.154 seconds
2014-03-19 12:23:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2014-03-19 12:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 12:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 12:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 12:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 12:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 12:23:51 [DEBUG   ] Finished updating ant stats in 0.851 seconds
2014-03-19 12:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 12:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 12:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 12:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 12:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 12:23:52 [DEBUG   ] Finished updating board flags in 1.570 seconds
2014-03-19 12:24:11 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2014-03-19 12:24:31 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2014-03-19 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2014-03-19 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2014-03-19 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2014-03-19 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2014-03-19 12:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2014-03-19 12:24:51 [DEBUG   ] Finished updating ant stats in 0.449 seconds
2014-03-19 12:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2014-03-19 12:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2014-03-19 12:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2014-03-19 12:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2014-03-19 12:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2014-03-19 12:24:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2014-03-19 12:24:52 [DEBUG   ] Finished updating board flags in 1.426 seconds
